[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:24:48.587544 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:33531
I20260709 12:24:48.589098 20873 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:24:48.590170 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:48.607703 20879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:48.607753 20880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:48.608454 20882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:48.609025 20873 server_base.cc:1061] running on GCE node
I20260709 12:24:49.801678 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:49.801999 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:49.802264 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599889802234 us; error 0 us; skew 500 ppm
I20260709 12:24:49.803206 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:49.808948 20873 webserver.cc:533] Webserver started at http://127.20.98.126:38985/ using document root <none> and password file <none>
I20260709 12:24:49.809944 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:49.810214 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:49.810688 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:49.816776 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-g3x6"
I20260709 12:24:49.825161 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:24:49.830788 20888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:49.832229 20873 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:49.832582 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d"
format_stamp: "Formatted at 2026-07-09 12:24:49 on dist-test-slave-g3x6"
I20260709 12:24:49.832903 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:49.898052 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:49.899603 20873 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:24:49.900038 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:49.974685 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:33531
I20260709 12:24:49.974766 20940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:33531 every 8 connection(s)
I20260709 12:24:49.982756 20941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.005234 20941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d: Bootstrap starting.
I20260709 12:24:50.011577 20941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.013688 20941 log.cc:826] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d: Log is configured to *not* fsync() on all Append() calls
I20260709 12:24:50.018487 20941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d: No bootstrap required, opened a new log
I20260709 12:24:50.039671 20941 raft_consensus.cc:359] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" member_type: VOTER }
I20260709 12:24:50.040264 20941 raft_consensus.cc:385] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.040671 20941 raft_consensus.cc:740] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934ff3b6e5be4bc8b5f4fd8d22ecaf0d, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.041775 20941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" member_type: VOTER }
I20260709 12:24:50.042320 20941 raft_consensus.cc:399] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:50.042632 20941 raft_consensus.cc:493] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:50.043020 20941 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.047298 20941 raft_consensus.cc:515] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" member_type: VOTER }
I20260709 12:24:50.048144 20941 leader_election.cc:304] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 934ff3b6e5be4bc8b5f4fd8d22ecaf0d; no voters: 
I20260709 12:24:50.050038 20941 leader_election.cc:290] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:50.050454 20944 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.053442 20944 raft_consensus.cc:697] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 1 LEADER]: Becoming Leader. State: Replica: 934ff3b6e5be4bc8b5f4fd8d22ecaf0d, State: Running, Role: LEADER
I20260709 12:24:50.054450 20944 consensus_queue.cc:237] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" member_type: VOTER }
I20260709 12:24:50.055395 20941 sys_catalog.cc:565] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:50.068804 20945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" member_type: VOTER } }
I20260709 12:24:50.069096 20946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 934ff3b6e5be4bc8b5f4fd8d22ecaf0d. Latest consensus state: current_term: 1 leader_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "934ff3b6e5be4bc8b5f4fd8d22ecaf0d" member_type: VOTER } }
I20260709 12:24:50.069586 20945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:50.069794 20946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:50.072721 20954 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:50.085784 20954 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:50.088538 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:50.106758 20954 catalog_manager.cc:1383] Generated new cluster ID: dd440067dd06442ab4f9ef01e5a306c3
I20260709 12:24:50.107084 20954 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:50.132560 20954 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:50.134348 20954 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:50.148890 20954 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d: Generated new TSK 0
I20260709 12:24:50.150031 20954 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:50.155915 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:50.165858 20963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:50.167172 20964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:50.171132 20873 server_base.cc:1061] running on GCE node
W20260709 12:24:50.171375 20966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:50.172487 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:50.172787 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:50.172993 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599890172975 us; error 0 us; skew 500 ppm
I20260709 12:24:50.173843 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:50.178107 20873 webserver.cc:533] Webserver started at http://127.20.98.65:37733/ using document root <none> and password file <none>
I20260709 12:24:50.178838 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:50.179085 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:50.179445 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:50.181020 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "775fb2fc412047558a105b0c400d7a10"
format_stamp: "Formatted at 2026-07-09 12:24:50 on dist-test-slave-g3x6"
I20260709 12:24:50.188222 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:50.193735 20971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.194734 20873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:24:50.195122 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "775fb2fc412047558a105b0c400d7a10"
format_stamp: "Formatted at 2026-07-09 12:24:50 on dist-test-slave-g3x6"
I20260709 12:24:50.195547 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:50.227396 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:50.229306 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:50.232172 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:50.237951 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:50.238304 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.238634 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:50.238870 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.356179 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:40497
I20260709 12:24:50.356314 21034 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:40497 every 8 connection(s)
I20260709 12:24:50.363893 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:50.379936 21039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:50.381681 21040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:50.402655 21035 heartbeater.cc:344] Connected to a master server at 127.20.98.126:33531
I20260709 12:24:50.403301 21035 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:50.404906 21035 heartbeater.cc:507] Master 127.20.98.126:33531 requested a full tablet report, sending...
W20260709 12:24:50.406073 21043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:50.408524 20873 server_base.cc:1061] running on GCE node
I20260709 12:24:50.409030 20905 ts_manager.cc:194] Registered new tserver with Master: 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497)
I20260709 12:24:50.409654 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:50.409950 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:50.410168 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599890410151 us; error 0 us; skew 500 ppm
I20260709 12:24:50.411020 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:50.412007 20905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41576
I20260709 12:24:50.416000 20873 webserver.cc:533] Webserver started at http://127.20.98.66:34287/ using document root <none> and password file <none>
I20260709 12:24:50.416733 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:50.416985 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:50.417347 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:50.418870 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
format_stamp: "Formatted at 2026-07-09 12:24:50 on dist-test-slave-g3x6"
I20260709 12:24:50.425961 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:50.431190 21047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.432731 20873 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:24:50.433130 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
format_stamp: "Formatted at 2026-07-09 12:24:50 on dist-test-slave-g3x6"
I20260709 12:24:50.433557 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:50.447405 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:50.448854 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:50.451248 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:50.454468 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:50.454731 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.455014 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:50.455267 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.556752 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:45579
I20260709 12:24:50.557024 21109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:45579 every 8 connection(s)
I20260709 12:24:50.566363 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:50.573499 21113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:50.575349 21114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:50.579107 21110 heartbeater.cc:344] Connected to a master server at 127.20.98.126:33531
I20260709 12:24:50.579538 21110 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:50.580557 21110 heartbeater.cc:507] Master 127.20.98.126:33531 requested a full tablet report, sending...
I20260709 12:24:50.583108 20905 ts_manager.cc:194] Registered new tserver with Master: a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:50.584874 20873 server_base.cc:1061] running on GCE node
I20260709 12:24:50.584986 20905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41592
W20260709 12:24:50.585855 21117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:50.587103 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:50.587384 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:50.587589 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599890587569 us; error 0 us; skew 500 ppm
I20260709 12:24:50.588191 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:50.590842 20873 webserver.cc:533] Webserver started at http://127.20.98.67:41109/ using document root <none> and password file <none>
I20260709 12:24:50.591367 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:50.591568 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:50.591848 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:50.592864 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
format_stamp: "Formatted at 2026-07-09 12:24:50 on dist-test-slave-g3x6"
I20260709 12:24:50.597713 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:24:50.601271 21121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.602111 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:24:50.602427 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
format_stamp: "Formatted at 2026-07-09 12:24:50 on dist-test-slave-g3x6"
I20260709 12:24:50.602756 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:50.625815 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:50.627068 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:50.629441 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:50.633024 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:50.633302 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:24:50.633559 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:50.633751 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:50.731571 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:45723
I20260709 12:24:50.732151 21184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:45723 every 8 connection(s)
I20260709 12:24:50.749522 21185 heartbeater.cc:344] Connected to a master server at 127.20.98.126:33531
I20260709 12:24:50.749925 21185 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:50.750788 21185 heartbeater.cc:507] Master 127.20.98.126:33531 requested a full tablet report, sending...
I20260709 12:24:50.752959 20905 ts_manager.cc:194] Registered new tserver with Master: 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:50.753883 20873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017138135s
I20260709 12:24:50.754572 20905 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41604
I20260709 12:24:50.809389 20905 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41620:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:50.813107 20905 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:50.908540 20999 tablet_service.cc:1511] Processing CreateTablet for tablet 13c4697f16524ea783ced75747da7b59 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:50.911090 20999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c4697f16524ea783ced75747da7b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.918653 21075 tablet_service.cc:1511] Processing CreateTablet for tablet 13c4697f16524ea783ced75747da7b59 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:50.920280 21075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c4697f16524ea783ced75747da7b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.927420 21074 tablet_service.cc:1511] Processing CreateTablet for tablet 35e2ac1b006a407cbd7ef2e6caab8b27 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:50.929075 21074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e2ac1b006a407cbd7ef2e6caab8b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.935999 21073 tablet_service.cc:1511] Processing CreateTablet for tablet b7f8132647ef483dbf5ad98ebfc849d1 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:50.937835 21073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f8132647ef483dbf5ad98ebfc849d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.938714 21203 tablet_bootstrap.cc:492] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:50.942631 21072 tablet_service.cc:1511] Processing CreateTablet for tablet ea8e0e58ebb147ad8476403ae91181a6 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:50.944377 21072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8e0e58ebb147ad8476403ae91181a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.947172 20998 tablet_service.cc:1511] Processing CreateTablet for tablet b7f8132647ef483dbf5ad98ebfc849d1 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:50.948621 20998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f8132647ef483dbf5ad98ebfc849d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.949054 20999 tablet_service.cc:1511] Processing CreateTablet for tablet 35e2ac1b006a407cbd7ef2e6caab8b27 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:50.950479 20999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e2ac1b006a407cbd7ef2e6caab8b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.950484 20997 tablet_service.cc:1511] Processing CreateTablet for tablet ea8e0e58ebb147ad8476403ae91181a6 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:50.950630 21071 tablet_service.cc:1511] Processing CreateTablet for tablet 7be0ff4181094a718bff0e5aeb2303aa (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:50.951866 20997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8e0e58ebb147ad8476403ae91181a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.952135 21071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be0ff4181094a718bff0e5aeb2303aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.953150 20993 tablet_service.cc:1511] Processing CreateTablet for tablet ec6097aed0fa4ebeba766cecb618efbc (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:50.954749 20993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6097aed0fa4ebeba766cecb618efbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.954461 20996 tablet_service.cc:1511] Processing CreateTablet for tablet 7be0ff4181094a718bff0e5aeb2303aa (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:50.955819 20996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be0ff4181094a718bff0e5aeb2303aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.968006 21069 tablet_service.cc:1511] Processing CreateTablet for tablet 9edbab0800f2412ca46056e5c8a64507 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:50.966260 20994 tablet_service.cc:1511] Processing CreateTablet for tablet 9edbab0800f2412ca46056e5c8a64507 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:50.984328 21068 tablet_service.cc:1511] Processing CreateTablet for tablet ec6097aed0fa4ebeba766cecb618efbc (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:51.002226 20994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edbab0800f2412ca46056e5c8a64507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:50.985512 21149 tablet_service.cc:1511] Processing CreateTablet for tablet 35e2ac1b006a407cbd7ef2e6caab8b27 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:50.970780 20995 tablet_service.cc:1511] Processing CreateTablet for tablet 9d29e373a9444ec1aa761ca17fab3511 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:51.002310 21067 tablet_service.cc:1511] Processing CreateTablet for tablet 9c720dbd360c4c19b7f480be041d556b (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:51.005600 20992 tablet_service.cc:1511] Processing CreateTablet for tablet 9c720dbd360c4c19b7f480be041d556b (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:51.005203 21070 tablet_service.cc:1511] Processing CreateTablet for tablet 9d29e373a9444ec1aa761ca17fab3511 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:51.005790 21069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edbab0800f2412ca46056e5c8a64507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.006969 20995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d29e373a9444ec1aa761ca17fab3511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.013463 20992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c720dbd360c4c19b7f480be041d556b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.023859 21148 tablet_service.cc:1511] Processing CreateTablet for tablet b7f8132647ef483dbf5ad98ebfc849d1 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:51.027074 21068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6097aed0fa4ebeba766cecb618efbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.006563 21150 tablet_service.cc:1511] Processing CreateTablet for tablet 13c4697f16524ea783ced75747da7b59 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:51.027717 21149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e2ac1b006a407cbd7ef2e6caab8b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.052676 21148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f8132647ef483dbf5ad98ebfc849d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.059638 21070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d29e373a9444ec1aa761ca17fab3511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.064623 21150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13c4697f16524ea783ced75747da7b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.092012 21067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c720dbd360c4c19b7f480be041d556b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.110682 21147 tablet_service.cc:1511] Processing CreateTablet for tablet ea8e0e58ebb147ad8476403ae91181a6 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:51.114630 21147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8e0e58ebb147ad8476403ae91181a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.122634 21145 tablet_service.cc:1511] Processing CreateTablet for tablet 9d29e373a9444ec1aa761ca17fab3511 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:51.124670 21145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d29e373a9444ec1aa761ca17fab3511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.121683 21146 tablet_service.cc:1511] Processing CreateTablet for tablet 7be0ff4181094a718bff0e5aeb2303aa (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 12:24:51.131790 20953 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:51.131886 21146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7be0ff4181094a718bff0e5aeb2303aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.139353 21203 tablet_bootstrap.cc:700] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: Time spent opening tablet: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:24:51.138854 21144 tablet_service.cc:1511] Processing CreateTablet for tablet 9edbab0800f2412ca46056e5c8a64507 (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:51.172559 21142 tablet_service.cc:1511] Processing CreateTablet for tablet ec6097aed0fa4ebeba766cecb618efbc (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:51.164299 21203 tablet_bootstrap.cc:654] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.188954 21141 tablet_service.cc:1511] Processing CreateTablet for tablet 9c720dbd360c4c19b7f480be041d556b (DEFAULT_TABLE table=test-workload [id=817e861dbbfd4ceab98a5cca41301224]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:51.187518 21144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9edbab0800f2412ca46056e5c8a64507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.192430 21142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6097aed0fa4ebeba766cecb618efbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.194180 21141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c720dbd360c4c19b7f480be041d556b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:51.195326 21204 tablet_bootstrap.cc:492] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:51.293028 21204 tablet_bootstrap.cc:654] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.297432 21203 tablet_bootstrap.cc:492] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:51.298012 21203 ts_tablet_manager.cc:1403] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.360s	user 0.028s	sys 0.007s
I20260709 12:24:51.305680 21203 raft_consensus.cc:359] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.306591 21203 raft_consensus.cc:385] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.306924 21203 raft_consensus.cc:740] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.309892 21203 consensus_queue.cc:260] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.335999 21203 ts_tablet_manager.cc:1434] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.003s
I20260709 12:24:51.336941 21035 heartbeater.cc:499] Master 127.20.98.126:33531 was elected leader, sending a full tablet report...
I20260709 12:24:51.337160 21203 tablet_bootstrap.cc:492] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.345484 21206 tablet_bootstrap.cc:492] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
W20260709 12:24:51.364949 21036 tablet.cc:2406] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:51.381767 21207 raft_consensus.cc:493] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.384039 21207 raft_consensus.cc:515] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.407284 21204 tablet_bootstrap.cc:492] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:51.407820 21204 ts_tablet_manager.cc:1403] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.265s	user 0.013s	sys 0.015s
I20260709 12:24:51.408097 21206 tablet_bootstrap.cc:654] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.417001 21207 leader_election.cc:290] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:51.427273 21204 raft_consensus.cc:359] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.428467 21204 raft_consensus.cc:385] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.428872 21204 raft_consensus.cc:740] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.429869 21204 consensus_queue.cc:260] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.429859 21203 tablet_bootstrap.cc:654] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.444458 21206 tablet_bootstrap.cc:492] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:51.448946 21206 ts_tablet_manager.cc:1403] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.130s	user 0.006s	sys 0.015s
I20260709 12:24:51.451133 21204 ts_tablet_manager.cc:1434] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.043s	user 0.011s	sys 0.010s
I20260709 12:24:51.452621 21110 heartbeater.cc:499] Master 127.20.98.126:33531 was elected leader, sending a full tablet report...
I20260709 12:24:51.453773 21204 tablet_bootstrap.cc:492] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:51.462040 21206 raft_consensus.cc:359] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.462869 21206 raft_consensus.cc:385] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.463208 21206 raft_consensus.cc:740] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.464138 21206 consensus_queue.cc:260] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.478123 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:51.478966 21206 ts_tablet_manager.cc:1434] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.005s
I20260709 12:24:51.480656 21185 heartbeater.cc:499] Master 127.20.98.126:33531 was elected leader, sending a full tablet report...
I20260709 12:24:51.480170 21204 tablet_bootstrap.cc:654] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.481380 21203 tablet_bootstrap.cc:492] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
W20260709 12:24:51.481192 20974 leader_election.cc:343] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.484251 21206 tablet_bootstrap.cc:492] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:51.482053 21203 ts_tablet_manager.cc:1403] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.145s	user 0.026s	sys 0.005s
I20260709 12:24:51.492444 21203 raft_consensus.cc:359] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.493691 21203 raft_consensus.cc:385] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.499665 21206 tablet_bootstrap.cc:654] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.499830 21204 tablet_bootstrap.cc:492] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:51.500291 21204 ts_tablet_manager.cc:1403] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.003s
I20260709 12:24:51.500880 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
W20260709 12:24:51.502840 20973 leader_election.cc:343] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.503304 20973 leader_election.cc:304] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:51.504127 21207 raft_consensus.cc:2749] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:51.497853 21203 raft_consensus.cc:740] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.503722 21204 raft_consensus.cc:359] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.506031 21204 raft_consensus.cc:385] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.506098 21217 raft_consensus.cc:493] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.506431 21204 raft_consensus.cc:740] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.506817 21217 raft_consensus.cc:515] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.505185 21203 consensus_queue.cc:260] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.513970 21203 ts_tablet_manager.cc:1434] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:24:51.511523 21204 consensus_queue.cc:260] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.527453 21204 ts_tablet_manager.cc:1434] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:24:51.528802 21204 tablet_bootstrap.cc:492] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:51.533654 21217 leader_election.cc:290] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:51.537497 21203 tablet_bootstrap.cc:492] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.538391 21206 tablet_bootstrap.cc:492] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:51.538918 21206 ts_tablet_manager.cc:1403] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.010s
I20260709 12:24:51.539059 21215 raft_consensus.cc:493] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.539616 21215 raft_consensus.cc:515] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.547598 21204 tablet_bootstrap.cc:654] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.551260 21206 raft_consensus.cc:359] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.551909 21215 leader_election.cc:290] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.558404 21206 raft_consensus.cc:385] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.558804 21206 raft_consensus.cc:740] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.559424 21203 tablet_bootstrap.cc:654] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.559680 21206 consensus_queue.cc:260] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.568464 21204 tablet_bootstrap.cc:492] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:51.569123 21204 ts_tablet_manager.cc:1403] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.014s
I20260709 12:24:51.572652 21203 tablet_bootstrap.cc:492] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:51.573472 21203 ts_tablet_manager.cc:1403] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.003s
I20260709 12:24:51.587561 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
W20260709 12:24:51.598039 21123 leader_election.cc:343] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.604422 21203 raft_consensus.cc:359] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.605355 21203 raft_consensus.cc:385] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.605691 21203 raft_consensus.cc:740] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.606544 21204 raft_consensus.cc:359] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.606549 21203 consensus_queue.cc:260] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.607573 21204 raft_consensus.cc:385] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.607982 21204 raft_consensus.cc:740] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.608812 21204 consensus_queue.cc:260] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.612845 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
W20260709 12:24:51.614656 21124 leader_election.cc:343] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.615157 21124 leader_election.cc:304] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a; no voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:51.616016 21217 raft_consensus.cc:2749] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:51.617882 21206 ts_tablet_manager.cc:1434] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.007s
I20260709 12:24:51.617964 21203 ts_tablet_manager.cc:1434] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.044s	user 0.026s	sys 0.008s
I20260709 12:24:51.620987 21206 tablet_bootstrap.cc:492] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:51.628015 21203 tablet_bootstrap.cc:492] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.629988 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:51.630131 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.627601 21204 ts_tablet_manager.cc:1434] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.058s	user 0.018s	sys 0.013s
I20260709 12:24:51.630735 21010 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 0.
I20260709 12:24:51.631735 21206 tablet_bootstrap.cc:654] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:51.631733 21049 leader_election.cc:343] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.634116 21204 tablet_bootstrap.cc:492] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:51.634030 21049 leader_election.cc:304] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a
I20260709 12:24:51.639956 21215 raft_consensus.cc:2804] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.640384 21215 raft_consensus.cc:493] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.640782 21215 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.642748 21206 tablet_bootstrap.cc:492] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:51.643119 21206 ts_tablet_manager.cc:1403] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 12:24:51.645447 21206 raft_consensus.cc:359] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.646245 21206 raft_consensus.cc:385] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.646538 21206 raft_consensus.cc:740] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.647289 21206 consensus_queue.cc:260] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.648823 21215 raft_consensus.cc:515] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.649963 21206 ts_tablet_manager.cc:1434] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:24:51.651307 21215 leader_election.cc:290] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.652338 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:51.652756 21206 tablet_bootstrap.cc:492] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:51.652347 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:51.654140 21010 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.655392 21203 tablet_bootstrap.cc:654] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:51.658273 21049 leader_election.cc:343] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.658594 21204 tablet_bootstrap.cc:654] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.658665 21206 tablet_bootstrap.cc:654] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.666007 21010 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 1.
I20260709 12:24:51.667721 21049 leader_election.cc:304] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a
I20260709 12:24:51.668789 21215 raft_consensus.cc:2804] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.668900 21203 tablet_bootstrap.cc:492] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:51.670531 21203 ts_tablet_manager.cc:1403] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.007s
I20260709 12:24:51.674994 21215 raft_consensus.cc:697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:51.676012 21215 consensus_queue.cc:237] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.678169 21203 raft_consensus.cc:359] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.678787 21203 raft_consensus.cc:385] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.679064 21203 raft_consensus.cc:740] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.679822 21203 consensus_queue.cc:260] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.684986 21204 tablet_bootstrap.cc:492] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:51.685503 21204 ts_tablet_manager.cc:1403] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.011s
I20260709 12:24:51.688386 21206 tablet_bootstrap.cc:492] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:51.688570 21204 raft_consensus.cc:359] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.688992 21206 ts_tablet_manager.cc:1403] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 12:24:51.689359 21204 raft_consensus.cc:385] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.689713 21204 raft_consensus.cc:740] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.688864 20905 catalog_manager.cc:5697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 0 to 1, leader changed from <none> to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 1 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.690550 21204 consensus_queue.cc:260] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.692910 21204 ts_tablet_manager.cc:1434] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:51.692593 21206 raft_consensus.cc:359] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.693497 21206 raft_consensus.cc:385] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.693846 21206 raft_consensus.cc:740] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.694432 21203 ts_tablet_manager.cc:1434] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:24:51.694661 21206 consensus_queue.cc:260] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.695502 21203 tablet_bootstrap.cc:492] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.697480 21206 ts_tablet_manager.cc:1434] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:24:51.698688 21206 tablet_bootstrap.cc:492] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:51.702432 21203 tablet_bootstrap.cc:654] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.705144 21204 tablet_bootstrap.cc:492] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:51.705093 21207 raft_consensus.cc:493] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.705682 21207 raft_consensus.cc:515] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.708069 21207 leader_election.cc:290] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.709357 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.710054 21160 raft_consensus.cc:2468] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 0.
I20260709 12:24:51.711623 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:51.712211 21206 tablet_bootstrap.cc:654] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.712989 21204 tablet_bootstrap.cc:654] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:51.713106 20974 leader_election.cc:343] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.714289 20973 leader_election.cc:304] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:51.715114 21207 raft_consensus.cc:2804] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.715490 21207 raft_consensus.cc:493] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.715853 21207 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.738595 21207 raft_consensus.cc:515] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.740815 21207 leader_election.cc:290] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 election: Requested vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.745994 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:51.746240 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:51.746743 21160 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:51.747864 20974 leader_election.cc:343] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.750581 21206 tablet_bootstrap.cc:492] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:51.751195 21206 ts_tablet_manager.cc:1403] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.017s
I20260709 12:24:51.752408 21203 tablet_bootstrap.cc:492] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:51.753209 21203 ts_tablet_manager.cc:1403] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.015s
I20260709 12:24:51.757325 21206 raft_consensus.cc:359] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.759769 21160 raft_consensus.cc:2468] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 1.
I20260709 12:24:51.761308 20973 leader_election.cc:304] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:51.762144 21207 raft_consensus.cc:2804] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.762712 21207 raft_consensus.cc:697] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:24:51.764007 21207 consensus_queue.cc:237] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.764098 21203 raft_consensus.cc:359] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.765033 21203 raft_consensus.cc:385] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.765410 21203 raft_consensus.cc:740] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.766242 21203 consensus_queue.cc:260] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.759338 21206 raft_consensus.cc:385] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.768603 21206 raft_consensus.cc:740] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.768857 21203 ts_tablet_manager.cc:1434] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:24:51.769456 21206 consensus_queue.cc:260] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.770080 21203 tablet_bootstrap.cc:492] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.762151 21204 tablet_bootstrap.cc:492] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:51.771833 21204 ts_tablet_manager.cc:1403] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.021s
I20260709 12:24:51.776542 21206 ts_tablet_manager.cc:1434] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 12:24:51.777660 21206 tablet_bootstrap.cc:492] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:51.777743 21203 tablet_bootstrap.cc:654] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.784297 21204 raft_consensus.cc:359] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.785094 21204 raft_consensus.cc:385] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.785418 21204 raft_consensus.cc:740] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.786193 21204 consensus_queue.cc:260] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.788653 21204 ts_tablet_manager.cc:1434] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:24:51.796900 21206 tablet_bootstrap.cc:654] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.799700 21204 tablet_bootstrap.cc:492] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:51.814750 21208 raft_consensus.cc:493] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.815294 21208 raft_consensus.cc:515] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.816741 21204 tablet_bootstrap.cc:654] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.819671 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6097aed0fa4ebeba766cecb618efbc" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.820436 21206 tablet_bootstrap.cc:492] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:51.821022 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6097aed0fa4ebeba766cecb618efbc" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:51.821041 21206 ts_tablet_manager.cc:1403] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
W20260709 12:24:51.822677 20974 leader_election.cc:343] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:51.823711 20973 leader_election.cc:343] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.824137 20973 leader_election.cc:304] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:51.824838 21207 raft_consensus.cc:2749] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:51.824868 21208 leader_election.cc:290] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.826898 20905 catalog_manager.cc:5697] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.829452 21206 raft_consensus.cc:359] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.830237 21206 raft_consensus.cc:385] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.830552 21206 raft_consensus.cc:740] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.831338 21206 consensus_queue.cc:260] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.836802 21206 ts_tablet_manager.cc:1434] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 12:24:51.839469 21206 tablet_bootstrap.cc:492] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:51.833608 21215 raft_consensus.cc:493] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.841104 21215 raft_consensus.cc:515] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.854938 21204 tablet_bootstrap.cc:492] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:51.855473 21204 ts_tablet_manager.cc:1403] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.002s
I20260709 12:24:51.855599 21215 leader_election.cc:290] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.856216 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:51.856580 21206 tablet_bootstrap.cc:654] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.857856 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.858649 21010 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 0.
I20260709 12:24:51.858800 21160 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 0.
I20260709 12:24:51.860034 21049 leader_election.cc:304] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:51.861779 21203 tablet_bootstrap.cc:492] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:51.862284 21203 ts_tablet_manager.cc:1403] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.044s
I20260709 12:24:51.862509 21215 raft_consensus.cc:2804] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.862910 21215 raft_consensus.cc:493] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.863325 21215 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.865190 21203 raft_consensus.cc:359] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.865921 21203 raft_consensus.cc:385] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.866214 21203 raft_consensus.cc:740] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.866937 21203 consensus_queue.cc:260] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.872786 21203 ts_tablet_manager.cc:1434] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:24:51.859344 21204 raft_consensus.cc:359] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.873697 21204 raft_consensus.cc:385] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.873868 21203 tablet_bootstrap.cc:492] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.874051 21204 raft_consensus.cc:740] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.874830 21204 consensus_queue.cc:260] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.877195 21204 ts_tablet_manager.cc:1434] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.002s
I20260709 12:24:51.886301 21203 tablet_bootstrap.cc:654] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.889030 21204 tablet_bootstrap.cc:492] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:51.888695 21215 raft_consensus.cc:515] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.890827 21215 leader_election.cc:290] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.893297 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:51.893318 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:51.894035 21010 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.894248 21160 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.907029 21010 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 1.
I20260709 12:24:51.908918 21049 leader_election.cc:304] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:51.909751 21215 raft_consensus.cc:2804] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.910264 21215 raft_consensus.cc:697] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:51.911166 21215 consensus_queue.cc:237] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.912789 21206 tablet_bootstrap.cc:492] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:51.912917 21217 raft_consensus.cc:493] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.912926 21203 tablet_bootstrap.cc:492] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:51.914034 21203 ts_tablet_manager.cc:1403] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.005s
I20260709 12:24:51.913476 21217 raft_consensus.cc:515] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.916764 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:51.917112 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:51.917430 21010 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 0.
I20260709 12:24:51.917802 21085 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 0.
I20260709 12:24:51.918598 21123 leader_election.cc:304] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:24:51.919740 21217 leader_election.cc:290] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:51.920308 21217 raft_consensus.cc:2804] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.920650 21208 raft_consensus.cc:493] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.920713 21217 raft_consensus.cc:493] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.921241 21208 raft_consensus.cc:515] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.921314 21217 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.922979 21160 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 1.
I20260709 12:24:51.926379 21208 leader_election.cc:290] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.926839 21204 tablet_bootstrap.cc:654] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.927802 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:51.913450 21206 ts_tablet_manager.cc:1403] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.030s
W20260709 12:24:51.929742 20974 leader_election.cc:343] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.931921 21206 raft_consensus.cc:359] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.932675 21206 raft_consensus.cc:385] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.932972 21206 raft_consensus.cc:740] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.931538 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.936059 21217 raft_consensus.cc:515] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:51.934712 21203 raft_consensus.cc:359] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.937649 21203 raft_consensus.cc:385] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.938022 21203 raft_consensus.cc:740] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.938820 21203 consensus_queue.cc:260] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.939668 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:51.943533 21085 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.945474 21203 ts_tablet_manager.cc:1434] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 12:24:51.946810 21203 tablet_bootstrap.cc:492] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.952548 20902 catalog_manager.cc:5697] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 0 to 1, leader changed from <none> to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 1 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.941095 21217 leader_election.cc:290] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:51.941028 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:51.954717 21215 raft_consensus.cc:493] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.954916 21010 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.955231 21215 raft_consensus.cc:515] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.957399 21215 leader_election.cc:290] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.959185 21159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.960049 21159 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 0.
I20260709 12:24:51.961884 21010 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 1.
I20260709 12:24:51.962687 21085 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 1.
I20260709 12:24:51.965394 21204 tablet_bootstrap.cc:492] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:51.953655 21203 tablet_bootstrap.cc:654] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.965512 21124 leader_election.cc:304] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:51.965955 21204 ts_tablet_manager.cc:1403] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.002s
I20260709 12:24:51.969460 21215 raft_consensus.cc:493] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.969965 21215 raft_consensus.cc:515] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.970428 21049 leader_election.cc:304] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:51.963213 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:51.971269 21203 tablet_bootstrap.cc:492] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:51.971325 21231 raft_consensus.cc:2804] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.971804 21203 ts_tablet_manager.cc:1403] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.004s
I20260709 12:24:51.971757 21231 raft_consensus.cc:493] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.972030 21215 leader_election.cc:290] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.972189 21231 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.940317 21206 consensus_queue.cc:260] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.973060 21160 raft_consensus.cc:2468] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 0.
I20260709 12:24:51.973270 21247 raft_consensus.cc:2804] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.975232 21206 ts_tablet_manager.cc:1434] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.002s
I20260709 12:24:51.976356 21206 tablet_bootstrap.cc:492] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:51.980052 20973 leader_election.cc:304] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:51.980666 21203 raft_consensus.cc:359] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.981230 21208 raft_consensus.cc:2804] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.981405 21203 raft_consensus.cc:385] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.982221 21203 raft_consensus.cc:740] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.981771 21208 raft_consensus.cc:493] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.984354 21203 consensus_queue.cc:260] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.985562 21208 raft_consensus.cc:3060] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.986845 21203 ts_tablet_manager.cc:1434] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:24:51.987819 21203 tablet_bootstrap.cc:492] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10: Bootstrap starting.
I20260709 12:24:51.989662 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:51.990537 21009 raft_consensus.cc:2468] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 0.
W20260709 12:24:51.991255 21049 leader_election.cc:343] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.992951 21215 raft_consensus.cc:493] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.993629 21215 raft_consensus.cc:515] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.995846 21215 leader_election.cc:290] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:51.996093 21203 tablet_bootstrap.cc:654] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.981061 21231 raft_consensus.cc:515] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:51.999361 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.999614 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:51.999590 21159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:51.998133 21204 raft_consensus.cc:359] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.004602 21204 raft_consensus.cc:385] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.005070 21204 raft_consensus.cc:740] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.005342 21159 raft_consensus.cc:2393] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a338a3bbf4ec48669eae0848b86f7a0e in current term 1: Already voted for candidate 775fb2fc412047558a105b0c400d7a10 in this term.
I20260709 12:24:51.998538 21049 leader_election.cc:304] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:52.011564 21215 raft_consensus.cc:2804] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.012034 21215 raft_consensus.cc:493] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.012424 21215 raft_consensus.cc:3060] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.014397 21231 leader_election.cc:290] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.010216 21204 consensus_queue.cc:260] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.049777 21247 raft_consensus.cc:697] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 LEADER]: Becoming Leader. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:24:52.019335 21208 raft_consensus.cc:515] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.053776 21247 consensus_queue.cc:237] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:52.054836 21204 ts_tablet_manager.cc:1434] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260709 12:24:52.057380 21204 tablet_bootstrap.cc:492] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:52.057400 21208 leader_election.cc:290] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 election: Requested vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.055850 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:52.022517 21159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
W20260709 12:24:52.038890 21049 leader_election.cc:343] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.058239 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:52.018985 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:52.058854 21160 raft_consensus.cc:3060] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:52.059007 20974 leader_election.cc:343] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.020882 21206 tablet_bootstrap.cc:654] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.060590 21049 leader_election.cc:304] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a338a3bbf4ec48669eae0848b86f7a0e; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10
I20260709 12:24:52.063462 21231 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.044991 21215 raft_consensus.cc:515] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.065997 21215 leader_election.cc:290] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
W20260709 12:24:52.072111 21049 leader_election.cc:343] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.075407 21160 raft_consensus.cc:2468] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 1.
I20260709 12:24:52.076704 20973 leader_election.cc:304] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:52.077052 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:52.077699 21208 raft_consensus.cc:2804] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.078233 21208 raft_consensus.cc:697] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:24:52.077867 21009 raft_consensus.cc:3060] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.079144 21208 consensus_queue.cc:237] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.058261 21159 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.082230 21247 raft_consensus.cc:493] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.082631 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:52.082747 21247 raft_consensus.cc:515] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.085577 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c720dbd360c4c19b7f480be041d556b" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:52.086311 21010 raft_consensus.cc:2468] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 0.
I20260709 12:24:52.084175 20903 catalog_manager.cc:5697] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67). New cstate: current_term: 1 leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.087750 21123 leader_election.cc:304] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:24:52.088946 21250 raft_consensus.cc:2804] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.089644 21250 raft_consensus.cc:493] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.090060 21250 raft_consensus.cc:3060] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.090894 21206 tablet_bootstrap.cc:492] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:52.091009 21231 raft_consensus.cc:2749] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.091615 21206 ts_tablet_manager.cc:1403] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.010s
I20260709 12:24:52.092329 21247 leader_election.cc:290] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:52.093576 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c720dbd360c4c19b7f480be041d556b" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:52.094481 21085 raft_consensus.cc:2468] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 0.
I20260709 12:24:52.095508 21159 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 1.
W20260709 12:24:52.097084 21049 leader_election.cc:343] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.108330 21250 raft_consensus.cc:515] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.111294 21204 tablet_bootstrap.cc:654] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.102531 21049 leader_election.cc:304] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 775fb2fc412047558a105b0c400d7a10
I20260709 12:24:52.118386 21250 leader_election.cc:290] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:52.104782 21206 raft_consensus.cc:359] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.119343 21206 raft_consensus.cc:385] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.119091 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c720dbd360c4c19b7f480be041d556b" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:52.119494 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c720dbd360c4c19b7f480be041d556b" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:52.119846 21010 raft_consensus.cc:3060] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.120177 21085 raft_consensus.cc:3060] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.120586 21215 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.116405 21009 raft_consensus.cc:2468] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 1.
I20260709 12:24:52.119676 21206 raft_consensus.cc:740] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.119141 21231 raft_consensus.cc:2804] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.123610 21206 consensus_queue.cc:260] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.125671 21206 ts_tablet_manager.cc:1434] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:24:52.127422 21049 leader_election.cc:304] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a
I20260709 12:24:52.129585 21206 tablet_bootstrap.cc:492] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a: Bootstrap starting.
I20260709 12:24:52.131585 21215 raft_consensus.cc:2804] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.132185 21215 raft_consensus.cc:697] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:52.132689 21159 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.133430 21215 consensus_queue.cc:237] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.127269 20903 catalog_manager.cc:5697] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.128525 21203 tablet_bootstrap.cc:492] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10: No bootstrap required, opened a new log
I20260709 12:24:52.136655 21203 ts_tablet_manager.cc:1403] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10: Time spent bootstrapping tablet: real 0.149s	user 0.030s	sys 0.029s
I20260709 12:24:52.142561 21231 raft_consensus.cc:697] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:52.143522 21231 consensus_queue.cc:237] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
W20260709 12:24:52.158290 20953 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:52.160007 21206 tablet_bootstrap.cc:654] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.164300 21010 raft_consensus.cc:2468] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 1.
I20260709 12:24:52.167268 21203 raft_consensus.cc:359] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.168237 21203 raft_consensus.cc:385] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.168911 21203 raft_consensus.cc:740] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.170074 21203 consensus_queue.cc:260] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.172830 21203 ts_tablet_manager.cc:1434] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.005s
I20260709 12:24:52.165366 21085 raft_consensus.cc:2468] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 1.
I20260709 12:24:52.179853 21124 leader_election.cc:304] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:52.181026 21250 raft_consensus.cc:2804] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.182946 21250 raft_consensus.cc:697] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 LEADER]: Becoming Leader. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:24:52.192880 21247 raft_consensus.cc:493] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.193696 21247 raft_consensus.cc:515] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.196586 21247 leader_election.cc:290] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:52.199080 21010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:52.207657 21256 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:24:52.186829 21250 consensus_queue.cc:237] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.209736 21208 consensus_queue.cc:1048] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:52.210254 21206 tablet_bootstrap.cc:492] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a: No bootstrap required, opened a new log
I20260709 12:24:52.210717 21206 ts_tablet_manager.cc:1403] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.004s
I20260709 12:24:52.206259 21084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:52.213362 21124 leader_election.cc:304] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a; no voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:52.213792 21206 raft_consensus.cc:359] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.214464 21206 raft_consensus.cc:385] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.214773 21206 raft_consensus.cc:740] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.215448 21206 consensus_queue.cc:260] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.216934 21247 raft_consensus.cc:2749] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:52.215251 20903 catalog_manager.cc:5697] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 0 to 1, leader changed from <none> to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 1 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.223337 21208 consensus_queue.cc:1048] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.217944 21206 ts_tablet_manager.cc:1434] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:24:52.222265 21204 tablet_bootstrap.cc:492] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:52.229878 21204 ts_tablet_manager.cc:1403] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.173s	user 0.025s	sys 0.029s
I20260709 12:24:52.233022 21204 raft_consensus.cc:359] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.233825 21204 raft_consensus.cc:385] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.234175 21204 raft_consensus.cc:740] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.238926 21204 consensus_queue.cc:260] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.248241 21204 ts_tablet_manager.cc:1434] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:24:52.249261 21204 tablet_bootstrap.cc:492] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e: Bootstrap starting.
I20260709 12:24:52.295146 20903 catalog_manager.cc:5697] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67). New cstate: current_term: 1 leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.310256 21204 tablet_bootstrap.cc:654] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.317595 20902 catalog_manager.cc:5697] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 0 to 1, leader changed from <none> to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 1 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.343708 21204 tablet_bootstrap.cc:492] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e: No bootstrap required, opened a new log
I20260709 12:24:52.344221 21204 ts_tablet_manager.cc:1403] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.024s
I20260709 12:24:52.346837 21204 raft_consensus.cc:359] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.347508 21204 raft_consensus.cc:385] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.347777 21204 raft_consensus.cc:740] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.348425 21204 consensus_queue.cc:260] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.350407 21204 ts_tablet_manager.cc:1434] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:24:52.374294 21256 consensus_queue.cc:1048] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.385566 21253 consensus_queue.cc:1048] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:52.419045 21253 raft_consensus.cc:493] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.419570 21253 raft_consensus.cc:515] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.421482 21253 leader_election.cc:290] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.422322 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6097aed0fa4ebeba766cecb618efbc" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:52.422554 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6097aed0fa4ebeba766cecb618efbc" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:52.423136 21160 raft_consensus.cc:2468] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 0.
I20260709 12:24:52.423079 21009 raft_consensus.cc:2468] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 0.
I20260709 12:24:52.424268 21049 leader_election.cc:304] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:52.425042 21253 raft_consensus.cc:2804] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.425410 21253 raft_consensus.cc:493] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.425695 21253 raft_consensus.cc:3060] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.430335 21253 raft_consensus.cc:515] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.431881 21253 leader_election.cc:290] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.433147 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6097aed0fa4ebeba766cecb618efbc" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:52.433188 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6097aed0fa4ebeba766cecb618efbc" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:52.433766 21009 raft_consensus.cc:3060] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.433908 21160 raft_consensus.cc:3060] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.438879 21009 raft_consensus.cc:2468] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 1.
I20260709 12:24:52.439987 21049 leader_election.cc:304] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:52.440683 21253 raft_consensus.cc:2804] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.441035 21160 raft_consensus.cc:2468] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 1.
I20260709 12:24:52.441143 21253 raft_consensus.cc:697] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:52.442080 21253 consensus_queue.cc:237] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.449959 20903 catalog_manager.cc:5697] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 0 to 1, leader changed from <none> to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 1 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.452765 21253 raft_consensus.cc:493] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.453305 21253 raft_consensus.cc:515] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.456442 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:52.457401 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:52.458182 21160 raft_consensus.cc:2393] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a338a3bbf4ec48669eae0848b86f7a0e in current term 1: Already voted for candidate 775fb2fc412047558a105b0c400d7a10 in this term.
I20260709 12:24:52.458822 21253 leader_election.cc:290] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.459362 21049 leader_election.cc:304] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a338a3bbf4ec48669eae0848b86f7a0e; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10
I20260709 12:24:52.460436 21253 raft_consensus.cc:3060] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.464958 21253 raft_consensus.cc:2749] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.480814 21250 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.488081 21269 consensus_queue.cc:1048] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:52.495240 21250 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.514719 21207 consensus_queue.cc:1048] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.531422 21250 raft_consensus.cc:493] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.532083 21250 raft_consensus.cc:515] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.534119 21250 leader_election.cc:290] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:52.536115 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "775fb2fc412047558a105b0c400d7a10" is_pre_election: true
I20260709 12:24:52.537279 21009 raft_consensus.cc:2393] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7241be4ebe9a40fcaf7cf29c89e4861a in current term 1: Already voted for candidate a338a3bbf4ec48669eae0848b86f7a0e in this term.
I20260709 12:24:52.537799 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:52.539294 21124 leader_election.cc:304] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a; no voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:52.540109 21250 raft_consensus.cc:3060] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.545954 21250 raft_consensus.cc:2749] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.549250 21253 consensus_queue.cc:1048] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.565496 21231 consensus_queue.cc:1048] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.596177 21160 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
mode: GRACEFUL
new_leader_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:60012
I20260709 12:24:52.597247 21160 raft_consensus.cc:606] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 LEADER]: Received request to transfer leadership to TS 775fb2fc412047558a105b0c400d7a10
I20260709 12:24:52.612442 21085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:59158
I20260709 12:24:52.613077 21085 raft_consensus.cc:606] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Received request to transfer leadership to TS 775fb2fc412047558a105b0c400d7a10
I20260709 12:24:52.622398 21085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:59158
I20260709 12:24:52.622952 21085 raft_consensus.cc:606] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Received request to transfer leadership to TS 775fb2fc412047558a105b0c400d7a10
I20260709 12:24:52.627472 21207 raft_consensus.cc:493] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.627997 21207 raft_consensus.cc:515] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.630136 21207 leader_election.cc:290] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.631289 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" is_pre_election: true
I20260709 12:24:52.631296 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" is_pre_election: true
I20260709 12:24:52.632354 21160 raft_consensus.cc:2393] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 775fb2fc412047558a105b0c400d7a10 in current term 1: Already voted for candidate a338a3bbf4ec48669eae0848b86f7a0e in this term.
I20260709 12:24:52.633467 20973 leader_election.cc:304] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10; no voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:52.634404 21207 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.641206 21207 raft_consensus.cc:2749] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.647346 21009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
mode: GRACEFUL
new_leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:37668
I20260709 12:24:52.647891 21009 raft_consensus.cc:606] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Received request to transfer leadership to TS a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:24:52.665602 21250 consensus_queue.cc:1048] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.681330 21247 consensus_queue.cc:1048] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.707870 21231 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.714553 21215 raft_consensus.cc:993] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:24:52.715044 21215 raft_consensus.cc:1081] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Signalling peer 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:24:52.717866 21009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:24:52.718572 21009 raft_consensus.cc:493] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:52.719027 21009 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.722328 21231 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.732299 21009 raft_consensus.cc:515] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.736153 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:52.736758 21085 raft_consensus.cc:3055] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.737017 21085 raft_consensus.cc:740] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:52.737097 21009 leader_election.cc:290] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Requested vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.737027 21160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:52.738538 21160 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.738641 21085 consensus_queue.cc:260] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.740229 21085 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.745623 21160 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:24:52.747468 20973 leader_election.cc:304] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:24:52.748236 21085 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:24:52.748476 21207 raft_consensus.cc:2804] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.749368 21207 raft_consensus.cc:697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:24:52.750214 21207 consensus_queue.cc:237] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.760867 20903 catalog_manager.cc:5697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 1 to 2, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.895742 21256 raft_consensus.cc:993] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:24:52.896286 21231 raft_consensus.cc:1081] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Signalling peer 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:24:52.898037 21009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:24:52.898633 21009 raft_consensus.cc:493] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:52.899008 21009 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.903640 21231 consensus_queue.cc:1048] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.906056 21009 raft_consensus.cc:515] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.908941 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:52.909544 21085 raft_consensus.cc:3055] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:52.909883 21085 raft_consensus.cc:740] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:52.910671 21085 consensus_queue.cc:260] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.911751 21085 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.918242 21009 leader_election.cc:290] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Requested vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:52.919977 21159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:52.920575 21159 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.922324 21085 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:24:52.923470 20974 leader_election.cc:304] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:52.923940 21231 consensus_queue.cc:1048] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.924885 21207 raft_consensus.cc:2804] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.925400 21207 raft_consensus.cc:697] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:24:52.926221 21207 consensus_queue.cc:237] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:52.928066 21159 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:24:52.934612 20905 catalog_manager.cc:5697] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 1 to 2, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.020602 21285 raft_consensus.cc:993] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: : Instructing follower 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:24:53.021122 21247 raft_consensus.cc:1081] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 LEADER]: Signalling peer 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:24:53.022744 21009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:37640
I20260709 12:24:53.023316 21009 raft_consensus.cc:493] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.023689 21009 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.030422 21009 raft_consensus.cc:515] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:53.032567 21009 leader_election.cc:290] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Requested vote from peers 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:53.033427 21159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:53.034076 21159 raft_consensus.cc:3055] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:53.034430 21159 raft_consensus.cc:740] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:24:53.035429 21084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:53.036249 21084 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.044060 21207 raft_consensus.cc:993] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10: : Instructing follower a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:24:53.044618 21207 raft_consensus.cc:1081] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Signalling peer a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:24:53.044723 21159 consensus_queue.cc:260] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:53.046629 21159 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.046553 21085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:59140
I20260709 12:24:53.047300 21085 raft_consensus.cc:493] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:53.047711 21085 raft_consensus.cc:3060] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.050638 21084 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:24:53.052095 20974 leader_election.cc:304] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:53.053450 21292 raft_consensus.cc:2804] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:53.053977 21292 raft_consensus.cc:697] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:24:53.055186 21159 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:24:53.054847 21292 consensus_queue.cc:237] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:53.056260 21085 raft_consensus.cc:515] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:53.058485 21085 leader_election.cc:290] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 2 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:24:53.060708 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:53.061074 21159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9edbab0800f2412ca46056e5c8a64507" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:24:53.061496 21009 raft_consensus.cc:3055] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:53.061900 21159 raft_consensus.cc:3060] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.061864 21009 raft_consensus.cc:740] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:24:53.062932 21009 consensus_queue.cc:260] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:53.063395 20905 catalog_manager.cc:5697] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 1 to 2, leader changed from 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67) to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.064122 21009 raft_consensus.cc:3060] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.068876 21159 raft_consensus.cc:2468] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 2.
I20260709 12:24:53.070261 21049 leader_election.cc:304] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:53.071192 21231 raft_consensus.cc:2804] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:53.071682 21231 raft_consensus.cc:697] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:53.072479 21231 consensus_queue.cc:237] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:53.073472 21009 raft_consensus.cc:2468] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 2.
I20260709 12:24:53.080183 20905 catalog_manager.cc:5697] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 1 to 2, leader changed from 775fb2fc412047558a105b0c400d7a10 (127.20.98.65) to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 2 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.140771 21159 raft_consensus.cc:1275] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.142148 21207 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.151319 21085 raft_consensus.cc:1275] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.153040 21292 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.433216 21159 raft_consensus.cc:1275] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.434628 21292 consensus_queue.cc:1048] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.443560 21085 raft_consensus.cc:1275] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.445371 21207 consensus_queue.cc:1048] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.464231 21085 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.465886 21207 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:53.471940 21159 raft_consensus.cc:1275] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.475162 21160 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.475449 21231 consensus_queue.cc:1048] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.476675 21208 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.489554 21009 raft_consensus.cc:1275] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:53.491035 21215 consensus_queue.cc:1048] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:55.684068 20873 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:24:55.684953 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:55.702140 21009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
mode: GRACEFUL
new_leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:38386
I20260709 12:24:55.702653 21009 raft_consensus.cc:606] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Received request to transfer leadership to TS 7241be4ebe9a40fcaf7cf29c89e4861a
I20260709 12:24:55.713671 21085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:24:55.714216 21085 raft_consensus.cc:606] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Received request to transfer leadership to TS 7241be4ebe9a40fcaf7cf29c89e4861a
I20260709 12:24:55.715361 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:55.715819 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:55.908985 21297 raft_consensus.cc:993] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: : Instructing follower 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:24:55.909497 21297 raft_consensus.cc:1081] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Signalling peer 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:24:55.911042 21158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:59986
I20260709 12:24:55.911573 21158 raft_consensus.cc:493] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.911933 21158 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.917654 21158 raft_consensus.cc:515] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:55.919322 21158 leader_election.cc:290] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 3 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:55.920368 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:55.920380 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:55.921033 21009 raft_consensus.cc:3055] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:55.921100 21085 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.921419 21009 raft_consensus.cc:740] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:24:55.922219 21009 consensus_queue.cc:260] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:55.923144 21009 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.925968 21085 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 3.
I20260709 12:24:55.927050 21124 leader_election.cc:304] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:24:55.927815 21247 raft_consensus.cc:2804] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:55.928231 21009 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 3.
I20260709 12:24:55.929100 21247 raft_consensus.cc:697] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 LEADER]: Becoming Leader. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:24:55.930042 21247 consensus_queue.cc:237] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:24:55.939515 20905 catalog_manager.cc:5697] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a reported cstate change: term changed from 2 to 3, leader changed from 775fb2fc412047558a105b0c400d7a10 (127.20.98.65) to 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67). New cstate: current_term: 3 leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.101717 21296 raft_consensus.cc:993] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:24:56.102157 21308 raft_consensus.cc:1081] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Signalling peer 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:24:56.103657 21158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511"
dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:24:56.104179 21158 raft_consensus.cc:493] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:56.104534 21158 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.109043 21158 raft_consensus.cc:515] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:56.110724 21158 leader_election.cc:290] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 2 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:24:56.111703 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:24:56.111940 21085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:24:56.112223 21009 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.112582 21085 raft_consensus.cc:3055] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:56.112879 21085 raft_consensus.cc:740] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:24:56.113658 21085 consensus_queue.cc:260] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:56.114594 21085 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.118747 21009 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 2.
I20260709 12:24:56.119784 21123 leader_election.cc:304] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:24:56.120625 21247 raft_consensus.cc:2804] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.120733 21085 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 2.
I20260709 12:24:56.121073 21247 raft_consensus.cc:697] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 LEADER]: Becoming Leader. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:24:56.121956 21247 consensus_queue.cc:237] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:24:56.128826 20905 catalog_manager.cc:5697] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a reported cstate change: term changed from 1 to 2, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67). New cstate: current_term: 2 leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.368415 21010 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.369841 21247 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.379622 21085 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.381444 21312 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.522670 21085 raft_consensus.cc:1275] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.524052 21312 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.532733 21010 raft_consensus.cc:1275] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.534309 21247 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.716856 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:56.721804 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:56.722214 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:57.723095 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.728081 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:57.728477 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:58.730000 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:58.737509 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:58.737874 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:59.739017 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:59.745857 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:59.746325 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.747252 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.752583 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:00.752948 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:01.753916 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.758967 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:01.759441 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:02.760712 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.767290 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:02.767685 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.329586 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.531843 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:04.667407 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:05.612236 21106 debug-util.cc:398] Leaking SignalData structure 0x7b080012d060 after lost signal to thread 20876
W20260709 12:25:05.613371 21106 debug-util.cc:398] Leaking SignalData structure 0x7b080012d740 after lost signal to thread 20940
W20260709 12:25:05.614248 21106 debug-util.cc:398] Leaking SignalData structure 0x7b08001db7e0 after lost signal to thread 21034
W20260709 12:25:05.614970 21106 debug-util.cc:398] Leaking SignalData structure 0x7b0800099380 after lost signal to thread 21109
W20260709 12:25:05.615657 21106 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1ca0 after lost signal to thread 21184
I20260709 12:25:06.276360 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:06.281731 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:06.282168 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:06.433017 20937 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 20876
W20260709 12:25:06.434131 20937 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 20940
W20260709 12:25:06.435278 20937 debug-util.cc:398] Leaking SignalData structure 0x7b08001c34c0 after lost signal to thread 21034
W20260709 12:25:06.436280 20937 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1b80 after lost signal to thread 21109
W20260709 12:25:06.437309 20937 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4d00 after lost signal to thread 21184
I20260709 12:25:07.321555 20873 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:25:07.327885 21158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
mode: GRACEFUL
new_leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:60012
I20260709 12:25:07.329291 21158 raft_consensus.cc:606] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 LEADER]: Received request to transfer leadership to TS a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:25:07.336961 21009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
mode: GRACEFUL
new_leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:37668
I20260709 12:25:07.337628 21009 raft_consensus.cc:606] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Received request to transfer leadership to TS a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:25:07.344333 21009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
mode: GRACEFUL
new_leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:37668
I20260709 12:25:07.344961 21009 raft_consensus.cc:606] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Received request to transfer leadership to TS a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:25:07.351756 21009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
mode: GRACEFUL
new_leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:37668
I20260709 12:25:07.352430 21009 raft_consensus.cc:606] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Received request to transfer leadership to TS a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:25:07.362860 21158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511"
dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
mode: GRACEFUL
new_leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:60012
I20260709 12:25:07.363631 21158 raft_consensus.cc:606] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 LEADER]: Received request to transfer leadership to TS a338a3bbf4ec48669eae0848b86f7a0e
I20260709 12:25:07.407958 21341 raft_consensus.cc:993] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10: : Instructing follower a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.408702 21339 raft_consensus.cc:1081] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Signalling peer a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.410774 21085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:59140
I20260709 12:25:07.411468 21085 raft_consensus.cc:493] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:07.411939 21085 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.421105 21085 raft_consensus.cc:515] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.427572 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:25:07.428361 21009 raft_consensus.cc:3055] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:07.428467 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:07.428722 21009 raft_consensus.cc:740] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:25:07.429208 21158 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.431231 21009 consensus_queue.cc:260] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.432583 21009 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.440613 21085 leader_election.cc:290] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 3 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:25:07.440070 21158 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 3.
I20260709 12:25:07.440948 21009 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 3.
I20260709 12:25:07.442488 21049 leader_election.cc:304] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:25:07.444155 21342 raft_consensus.cc:2804] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:07.444617 21342 raft_consensus.cc:697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:07.445573 21342 consensus_queue.cc:237] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.459385 20905 catalog_manager.cc:5697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 2 to 3, leader changed from 775fb2fc412047558a105b0c400d7a10 (127.20.98.65) to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 3 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.622363 21348 raft_consensus.cc:993] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a: : Instructing follower a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.623095 21340 raft_consensus.cc:1081] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 LEADER]: Signalling peer a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.624933 21085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:59156
I20260709 12:25:07.625532 21085 raft_consensus.cc:493] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:07.625902 21085 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.632933 21085 raft_consensus.cc:515] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.635006 21085 leader_election.cc:290] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 3 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:25:07.636685 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:07.636704 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:25:07.637493 21158 raft_consensus.cc:3055] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:07.637638 21009 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.637997 21158 raft_consensus.cc:740] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:25:07.639070 21158 consensus_queue.cc:260] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.640637 21158 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.644496 21009 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 3.
I20260709 12:25:07.645900 21049 leader_election.cc:304] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:25:07.646770 21342 raft_consensus.cc:2804] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:07.647250 21342 raft_consensus.cc:697] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:07.648177 21342 consensus_queue.cc:237] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.654112 21158 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 3.
I20260709 12:25:07.663017 20905 catalog_manager.cc:5697] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 2 to 3, leader changed from 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67) to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 3 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.762902 21341 raft_consensus.cc:993] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10: : Instructing follower a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.763461 21339 raft_consensus.cc:1081] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Signalling peer a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.765380 21085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:59140
I20260709 12:25:07.765965 21085 raft_consensus.cc:493] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:07.766327 21085 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.773422 21085 raft_consensus.cc:515] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.775408 21085 leader_election.cc:290] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 3 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:25:07.776916 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:07.777594 21158 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.781314 21341 raft_consensus.cc:993] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10: : Instructing follower a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.781980 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8e0e58ebb147ad8476403ae91181a6" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:25:07.782451 21339 raft_consensus.cc:1081] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Signalling peer a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.782617 21009 raft_consensus.cc:3055] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:07.783087 21009 raft_consensus.cc:740] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:25:07.784521 21083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:59140
I20260709 12:25:07.785494 21083 raft_consensus.cc:493] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:07.785898 21083 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:07.794464 21083 raft_consensus.cc:515] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.795958 21009 consensus_queue.cc:260] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.797636 21009 raft_consensus.cc:3060] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.799227 21158 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 3.
I20260709 12:25:07.800680 21049 leader_election.cc:304] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:25:07.800824 21083 leader_election.cc:290] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 2 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:25:07.802178 21342 raft_consensus.cc:2804] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:07.802670 21342 raft_consensus.cc:697] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:07.803577 21342 consensus_queue.cc:237] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.805701 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:07.805891 21008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:25:07.808444 21158 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:07.808495 21008 raft_consensus.cc:3055] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:07.809058 21008 raft_consensus.cc:740] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:25:07.809945 21008 consensus_queue.cc:260] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.811291 21008 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:07.817696 21009 raft_consensus.cc:2468] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 3.
I20260709 12:25:07.819624 21158 raft_consensus.cc:2468] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 2.
I20260709 12:25:07.820681 21049 leader_election.cc:304] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:25:07.821765 21332 raft_consensus.cc:2804] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:07.827167 21008 raft_consensus.cc:2468] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 2.
I20260709 12:25:07.829133 21332 raft_consensus.cc:697] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:07.830145 21332 consensus_queue.cc:237] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:07.829857 20905 catalog_manager.cc:5697] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 2 to 3, leader changed from 775fb2fc412047558a105b0c400d7a10 (127.20.98.65) to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 3 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.847325 20905 catalog_manager.cc:5697] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 1 to 2, leader changed from 775fb2fc412047558a105b0c400d7a10 (127.20.98.65) to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 2 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.875322 21348 raft_consensus.cc:993] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: : Instructing follower a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.875902 21340 raft_consensus.cc:1081] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 LEADER]: Signalling peer a338a3bbf4ec48669eae0848b86f7a0e to start an election
I20260709 12:25:07.877936 21083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
 from {username='slave'} at 127.0.0.1:59156
I20260709 12:25:07.878582 21083 raft_consensus.cc:493] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:07.878999 21083 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:07.886806 21083 raft_consensus.cc:515] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:25:07.889269 21083 leader_election.cc:290] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 4 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:25:07.890046 21008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:25:07.890692 21008 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:07.893496 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:07.893978 21158 raft_consensus.cc:3055] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:07.894294 21158 raft_consensus.cc:740] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:25:07.895150 21158 consensus_queue.cc:260] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:25:07.896402 21158 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:07.898236 21008 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 4.
I20260709 12:25:07.899536 21049 leader_election.cc:304] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:25:07.900435 21332 raft_consensus.cc:2804] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:07.901851 21332 raft_consensus.cc:697] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 LEADER]: Becoming Leader. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:07.903156 21158 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a338a3bbf4ec48669eae0848b86f7a0e in term 4.
I20260709 12:25:07.902859 21332 consensus_queue.cc:237] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:25:07.913100 20905 catalog_manager.cc:5697] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e reported cstate change: term changed from 3 to 4, leader changed from 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67) to a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66). New cstate: current_term: 4 leader_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.928109 21008 raft_consensus.cc:1275] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:07.929714 21332 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:07.951967 21158 raft_consensus.cc:1275] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:07.953589 21332 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:08.051800 21158 raft_consensus.cc:1275] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:08.053450 21352 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:08.068481 21008 raft_consensus.cc:1275] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:08.070636 21332 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:08.201894 21158 raft_consensus.cc:1275] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:08.203496 21342 consensus_queue.cc:1048] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:08.218501 21008 raft_consensus.cc:1275] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:08.221402 21332 consensus_queue.cc:1048] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:08.265985 21008 raft_consensus.cc:1275] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:08.267544 21332 consensus_queue.cc:1048] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:08.282543 21158 raft_consensus.cc:1275] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:08.284580 21342 consensus_queue.cc:1048] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:08.379339 21158 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:08.380756 21352 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:08.396487 21008 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Refusing update from remote peer a338a3bbf4ec48669eae0848b86f7a0e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:08.406471 21342 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:10.405318 20873 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:25:10.406169 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:10.414237 21083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:25:10.414974 21083 raft_consensus.cc:606] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 LEADER]: Received request to transfer leadership to TS 775fb2fc412047558a105b0c400d7a10
I20260709 12:25:10.417793 21083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:25:10.418315 21083 raft_consensus.cc:606] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Received request to transfer leadership to TS 7241be4ebe9a40fcaf7cf29c89e4861a
I20260709 12:25:10.420866 21083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:25:10.421423 21083 raft_consensus.cc:606] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Received request to transfer leadership to TS 775fb2fc412047558a105b0c400d7a10
I20260709 12:25:10.423784 21083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:25:10.424322 21083 raft_consensus.cc:606] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Received request to transfer leadership to TS 775fb2fc412047558a105b0c400d7a10
I20260709 12:25:10.426867 21083 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1"
dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
mode: GRACEFUL
new_leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:25:10.427402 21083 raft_consensus.cc:606] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 LEADER]: Received request to transfer leadership to TS 7241be4ebe9a40fcaf7cf29c89e4861a
I20260709 12:25:10.428486 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:10.428998 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:10.671000 21371 raft_consensus.cc:993] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:25:10.671614 21370 raft_consensus.cc:1081] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Signalling peer 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:25:10.673556 21158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27"
dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:25:10.674005 21158 raft_consensus.cc:493] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.674274 21158 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.679304 21158 raft_consensus.cc:515] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.681754 21158 leader_election.cc:290] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 4 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:25:10.682997 21083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:25:10.683090 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e2ac1b006a407cbd7ef2e6caab8b27" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:25:10.683872 21009 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.683851 21083 raft_consensus.cc:3055] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:10.684394 21083 raft_consensus.cc:740] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:10.685370 21083 consensus_queue.cc:260] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.686735 21083 raft_consensus.cc:3060] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.691323 21009 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 4.
I20260709 12:25:10.692766 21123 leader_election.cc:304] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:25:10.693671 21083 raft_consensus.cc:2468] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 4.
I20260709 12:25:10.693740 21340 raft_consensus.cc:2804] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:10.695392 21340 raft_consensus.cc:697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 LEADER]: Becoming Leader. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:25:10.696322 21340 consensus_queue.cc:237] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.704352 20903 catalog_manager.cc:5697] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a reported cstate change: term changed from 3 to 4, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67). New cstate: current_term: 4 leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.763038 21371 raft_consensus.cc:993] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:25:10.763484 21371 raft_consensus.cc:1081] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Signalling peer 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:25:10.764967 21009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:10.765467 21009 raft_consensus.cc:493] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.765733 21009 raft_consensus.cc:3060] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.769696 21009 raft_consensus.cc:515] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.771584 21009 leader_election.cc:290] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Requested vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:25:10.772691 21083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:25:10.772737 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7be0ff4181094a718bff0e5aeb2303aa" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:10.773445 21083 raft_consensus.cc:3055] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:10.773519 21158 raft_consensus.cc:3060] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.773782 21083 raft_consensus.cc:740] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:10.774629 21083 consensus_queue.cc:260] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.775580 21083 raft_consensus.cc:3060] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.777999 21158 raft_consensus.cc:2468] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:25:10.779470 20973 leader_election.cc:304] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:25:10.781162 21083 raft_consensus.cc:2468] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 2.
I20260709 12:25:10.781821 21378 raft_consensus.cc:2804] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:10.782069 21370 raft_consensus.cc:993] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:25:10.782574 21371 raft_consensus.cc:1081] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 LEADER]: Signalling peer 7241be4ebe9a40fcaf7cf29c89e4861a to start an election
I20260709 12:25:10.783427 21378 raft_consensus.cc:697] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:25:10.784162 21158 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1"
dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
 from {username='slave'} at 127.0.0.1:59998
I20260709 12:25:10.784243 21378 consensus_queue.cc:237] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.784727 21158 raft_consensus.cc:493] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.785203 21158 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.790529 21158 raft_consensus.cc:515] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.791883 20903 catalog_manager.cc:5697] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 1 to 2, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.792721 21158 leader_election.cc:290] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 3 election: Requested vote from peers 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:25:10.792989 21009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "775fb2fc412047558a105b0c400d7a10"
I20260709 12:25:10.793305 21083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f8132647ef483dbf5ad98ebfc849d1" candidate_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:25:10.793615 21009 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.793920 21083 raft_consensus.cc:3055] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:10.794232 21083 raft_consensus.cc:740] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:10.795002 21083 consensus_queue.cc:260] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.796211 21083 raft_consensus.cc:3060] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.799832 21009 raft_consensus.cc:2468] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 3.
I20260709 12:25:10.800916 21123 leader_election.cc:304] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:25:10.801781 21340 raft_consensus.cc:2804] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:10.802248 21340 raft_consensus.cc:697] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 LEADER]: Becoming Leader. State: Replica: 7241be4ebe9a40fcaf7cf29c89e4861a, State: Running, Role: LEADER
I20260709 12:25:10.802883 21083 raft_consensus.cc:2468] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7241be4ebe9a40fcaf7cf29c89e4861a in term 3.
I20260709 12:25:10.803095 21340 consensus_queue.cc:237] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.810420 20903 catalog_manager.cc:5697] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a reported cstate change: term changed from 2 to 3, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67). New cstate: current_term: 3 leader_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.898021 21370 raft_consensus.cc:993] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:25:10.898597 21371 raft_consensus.cc:1081] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 LEADER]: Signalling peer 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:25:10.900205 21009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13c4697f16524ea783ced75747da7b59"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:10.900723 21009 raft_consensus.cc:493] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.901026 21009 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:10.905019 21009 raft_consensus.cc:515] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:25:10.906612 21009 leader_election.cc:290] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 5 election: Requested vote from peers 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723), a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579)
I20260709 12:25:10.907707 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:10.907874 21083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13c4697f16524ea783ced75747da7b59" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:25:10.908331 21158 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:10.908546 21083 raft_consensus.cc:3055] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:10.908977 21083 raft_consensus.cc:740] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:10.909842 21083 consensus_queue.cc:260] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:25:10.910764 21371 raft_consensus.cc:993] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: : Instructing follower 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:25:10.910869 21083 raft_consensus.cc:3060] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:10.911299 21370 raft_consensus.cc:1081] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Signalling peer 775fb2fc412047558a105b0c400d7a10 to start an election
I20260709 12:25:10.913058 21009 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511"
dest_uuid: "775fb2fc412047558a105b0c400d7a10"
 from {username='slave'} at 127.0.0.1:37652
I20260709 12:25:10.913589 21009 raft_consensus.cc:493] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.913909 21009 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.914716 21158 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 5.
I20260709 12:25:10.915797 20973 leader_election.cc:304] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7241be4ebe9a40fcaf7cf29c89e4861a, 775fb2fc412047558a105b0c400d7a10; no voters: 
I20260709 12:25:10.916637 21378 raft_consensus.cc:2804] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:10.916978 21083 raft_consensus.cc:2468] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 5.
I20260709 12:25:10.917120 21378 raft_consensus.cc:697] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 5 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:25:10.918098 21378 consensus_queue.cc:237] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } }
I20260709 12:25:10.919603 21009 raft_consensus.cc:515] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.921329 21009 leader_election.cc:290] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 4 election: Requested vote from peers a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66:45579), 7241be4ebe9a40fcaf7cf29c89e4861a (127.20.98.67:45723)
I20260709 12:25:10.922196 21083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a338a3bbf4ec48669eae0848b86f7a0e"
I20260709 12:25:10.922739 21083 raft_consensus.cc:3055] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:10.923033 21083 raft_consensus.cc:740] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a338a3bbf4ec48669eae0848b86f7a0e, State: Running, Role: LEADER
I20260709 12:25:10.923807 21083 consensus_queue.cc:260] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.924878 21083 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.924772 21158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d29e373a9444ec1aa761ca17fab3511" candidate_uuid: "775fb2fc412047558a105b0c400d7a10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a"
I20260709 12:25:10.925429 21158 raft_consensus.cc:3060] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.926669 20903 catalog_manager.cc:5697] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 4 to 5, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.930729 21083 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 4.
I20260709 12:25:10.932225 20974 leader_election.cc:304] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 775fb2fc412047558a105b0c400d7a10, a338a3bbf4ec48669eae0848b86f7a0e; no voters: 
I20260709 12:25:10.932983 21378 raft_consensus.cc:2804] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:10.933492 21378 raft_consensus.cc:697] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 4 LEADER]: Becoming Leader. State: Replica: 775fb2fc412047558a105b0c400d7a10, State: Running, Role: LEADER
I20260709 12:25:10.934384 21158 raft_consensus.cc:2468] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 775fb2fc412047558a105b0c400d7a10 in term 4.
I20260709 12:25:10.934264 21378 consensus_queue.cc:237] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } }
I20260709 12:25:10.941747 20903 catalog_manager.cc:5697] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 reported cstate change: term changed from 3 to 4, leader changed from a338a3bbf4ec48669eae0848b86f7a0e (127.20.98.66) to 775fb2fc412047558a105b0c400d7a10 (127.20.98.65). New cstate: current_term: 4 leader_uuid: "775fb2fc412047558a105b0c400d7a10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.082149 21083 raft_consensus.cc:1275] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:11.083725 21340 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:11.096199 21009 raft_consensus.cc:1275] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:11.098001 21340 consensus_queue.cc:1048] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:11.195878 21009 raft_consensus.cc:1275] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.197264 21340 consensus_queue.cc:1048] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "775fb2fc412047558a105b0c400d7a10" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.208812 21083 raft_consensus.cc:1275] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Refusing update from remote peer 7241be4ebe9a40fcaf7cf29c89e4861a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.210373 21391 consensus_queue.cc:1048] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:11.292258 21083 raft_consensus.cc:1275] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.293704 21378 consensus_queue.cc:1048] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.305538 21158 raft_consensus.cc:1275] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.307466 21378 consensus_queue.cc:1048] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.380954 21158 raft_consensus.cc:1275] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:11.382153 21378 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:11.391881 21083 raft_consensus.cc:1275] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:11.393788 21378 consensus_queue.cc:1048] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:11.427929 21158 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 5 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:11.429193 21378 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7241be4ebe9a40fcaf7cf29c89e4861a" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:11.430328 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:11.437096 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:11.437604 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:11.440198 21083 raft_consensus.cc:1275] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 5 FOLLOWER]: Refusing update from remote peer 775fb2fc412047558a105b0c400d7a10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:11.441712 21378 consensus_queue.cc:1048] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a338a3bbf4ec48669eae0848b86f7a0e" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 45579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:12.438706 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:12.444537 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:12.444957 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:13.446056 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.451001 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:13.451426 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:14.452592 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:14.458516 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:14.458956 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:15.460302 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:15.468396 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:15.468890 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.469976 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.475293 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:16.475751 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:17.476795 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:17.483263 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:17.483709 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:18.620992 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.626375 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:18.626911 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:19.117331 20937 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4ca0 after lost signal to thread 20876
W20260709 12:25:19.118294 20937 debug-util.cc:398] Leaking SignalData structure 0x7b08001d6c20 after lost signal to thread 20940
W20260709 12:25:19.119246 20937 debug-util.cc:398] Leaking SignalData structure 0x7b0800062120 after lost signal to thread 21034
W20260709 12:25:19.120100 20937 debug-util.cc:398] Leaking SignalData structure 0x7b0800133a20 after lost signal to thread 21109
W20260709 12:25:19.120889 20937 debug-util.cc:398] Leaking SignalData structure 0x7b080014aca0 after lost signal to thread 21184
I20260709 12:25:19.628268 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.635161 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:19.635636 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:20.665653 20873 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:25:20.666323 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
I20260709 12:25:20.700358 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:20.701151 20873 tablet_replica.cc:333] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.702114 20873 raft_consensus.cc:2243] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.703198 20873 raft_consensus.cc:2272] T 9d29e373a9444ec1aa761ca17fab3511 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:20.706283 21123 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:20.706403 20873 tablet_replica.cc:333] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.707403 20873 raft_consensus.cc:2243] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.708050 20873 raft_consensus.cc:2272] T 9c720dbd360c4c19b7f480be041d556b P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:20.710027 21123 consensus_peers.cc:597] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a -> Peer 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497): Couldn't send request to peer 775fb2fc412047558a105b0c400d7a10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.710595 20873 tablet_replica.cc:333] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.711090 20873 raft_consensus.cc:2243] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.711814 20873 raft_consensus.cc:2272] T 7be0ff4181094a718bff0e5aeb2303aa P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.713675 20873 tablet_replica.cc:333] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.714133 20873 raft_consensus.cc:2243] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.714491 20873 raft_consensus.cc:2272] T 9edbab0800f2412ca46056e5c8a64507 P 775fb2fc412047558a105b0c400d7a10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.716104 20873 tablet_replica.cc:333] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.716573 20873 raft_consensus.cc:2243] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.716909 20873 raft_consensus.cc:2272] T ec6097aed0fa4ebeba766cecb618efbc P 775fb2fc412047558a105b0c400d7a10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.718683 20873 tablet_replica.cc:333] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.719141 20873 raft_consensus.cc:2243] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.719607 20873 raft_consensus.cc:2272] T ea8e0e58ebb147ad8476403ae91181a6 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.721750 20873 tablet_replica.cc:333] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.722419 20873 raft_consensus.cc:2243] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.722913 20873 raft_consensus.cc:2272] T b7f8132647ef483dbf5ad98ebfc849d1 P 775fb2fc412047558a105b0c400d7a10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.724903 20873 tablet_replica.cc:333] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.725411 20873 raft_consensus.cc:2243] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.725773 20873 raft_consensus.cc:2272] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 775fb2fc412047558a105b0c400d7a10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.727368 20873 tablet_replica.cc:333] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10: stopping tablet replica
I20260709 12:25:20.727759 20873 raft_consensus.cc:2243] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.728421 20873 raft_consensus.cc:2272] T 13c4697f16524ea783ced75747da7b59 P 775fb2fc412047558a105b0c400d7a10 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.825845 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
W20260709 12:25:20.827013 21049 consensus_peers.cc:597] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e -> Peer 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497): Couldn't send request to peer 775fb2fc412047558a105b0c400d7a10. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.846910 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
I20260709 12:25:20.881636 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:20.882287 20873 tablet_replica.cc:333] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.883217 20873 raft_consensus.cc:2243] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.884174 20873 raft_consensus.cc:2272] T ec6097aed0fa4ebeba766cecb618efbc P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.886672 20873 tablet_replica.cc:333] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.887269 20873 raft_consensus.cc:2243] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.888135 20873 raft_consensus.cc:2272] T 9edbab0800f2412ca46056e5c8a64507 P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.889916 20873 tablet_replica.cc:333] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.890419 20873 raft_consensus.cc:2243] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.890820 20873 raft_consensus.cc:2272] T 9c720dbd360c4c19b7f480be041d556b P a338a3bbf4ec48669eae0848b86f7a0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.892403 20873 tablet_replica.cc:333] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.892863 20873 raft_consensus.cc:2243] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.893308 20873 raft_consensus.cc:2272] T b7f8132647ef483dbf5ad98ebfc849d1 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.894841 20873 tablet_replica.cc:333] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.895277 20873 raft_consensus.cc:2243] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:20.896014 20873 raft_consensus.cc:2272] T ea8e0e58ebb147ad8476403ae91181a6 P a338a3bbf4ec48669eae0848b86f7a0e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.897704 20873 tablet_replica.cc:333] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.898154 20873 raft_consensus.cc:2243] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.898523 20873 raft_consensus.cc:2272] T 13c4697f16524ea783ced75747da7b59 P a338a3bbf4ec48669eae0848b86f7a0e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.900800 20873 tablet_replica.cc:333] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.901325 20873 raft_consensus.cc:2243] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.901710 20873 raft_consensus.cc:2272] T 9d29e373a9444ec1aa761ca17fab3511 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.903282 20873 tablet_replica.cc:333] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.903725 20873 raft_consensus.cc:2243] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.904076 20873 raft_consensus.cc:2272] T 7be0ff4181094a718bff0e5aeb2303aa P a338a3bbf4ec48669eae0848b86f7a0e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:20.905769 20873 tablet_replica.cc:333] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e: stopping tablet replica
I20260709 12:25:20.906181 20873 raft_consensus.cc:2243] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:20.906610 20873 raft_consensus.cc:2272] T 35e2ac1b006a407cbd7ef2e6caab8b27 P a338a3bbf4ec48669eae0848b86f7a0e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:20.946725 21123 consensus_peers.cc:597] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a -> Peer 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497): Couldn't send request to peer 775fb2fc412047558a105b0c400d7a10. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.957247 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
W20260709 12:25:20.974380 21123 consensus_peers.cc:597] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a -> Peer 775fb2fc412047558a105b0c400d7a10 (127.20.98.65:40497): Couldn't send request to peer 775fb2fc412047558a105b0c400d7a10. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:20.978549 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
I20260709 12:25:21.008592 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:21.009400 20873 tablet_replica.cc:333] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.010105 20873 raft_consensus.cc:2243] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.010653 20873 raft_consensus.cc:2272] T 7be0ff4181094a718bff0e5aeb2303aa P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.012488 20873 tablet_replica.cc:333] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.013007 20873 raft_consensus.cc:2243] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.013441 20873 raft_consensus.cc:2272] T ec6097aed0fa4ebeba766cecb618efbc P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.015121 20873 tablet_replica.cc:333] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.015626 20873 raft_consensus.cc:2243] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.016008 20873 raft_consensus.cc:2272] T 9edbab0800f2412ca46056e5c8a64507 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.017647 20873 tablet_replica.cc:333] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.018113 20873 raft_consensus.cc:2243] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.018564 20873 raft_consensus.cc:2272] T 13c4697f16524ea783ced75747da7b59 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.020162 20873 tablet_replica.cc:333] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.020632 20873 raft_consensus.cc:2243] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.021062 20873 raft_consensus.cc:2272] T 9d29e373a9444ec1aa761ca17fab3511 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.022748 20873 tablet_replica.cc:333] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.023218 20873 raft_consensus.cc:2243] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.023998 20873 raft_consensus.cc:2272] T 35e2ac1b006a407cbd7ef2e6caab8b27 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.025755 20873 tablet_replica.cc:333] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.026221 20873 raft_consensus.cc:2243] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.026938 20873 raft_consensus.cc:2272] T 9c720dbd360c4c19b7f480be041d556b P 7241be4ebe9a40fcaf7cf29c89e4861a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.028515 20873 tablet_replica.cc:333] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.029006 20873 raft_consensus.cc:2243] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.029807 20873 raft_consensus.cc:2272] T b7f8132647ef483dbf5ad98ebfc849d1 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.031513 20873 tablet_replica.cc:333] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a: stopping tablet replica
I20260709 12:25:21.031980 20873 raft_consensus.cc:2243] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:21.032388 20873 raft_consensus.cc:2272] T ea8e0e58ebb147ad8476403ae91181a6 P 7241be4ebe9a40fcaf7cf29c89e4861a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.061525 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
I20260709 12:25:21.079962 20873 master.cc:562] Master@127.20.98.126:33531 shutting down...
I20260709 12:25:21.224155 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:21.224808 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:21.225160 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P 934ff3b6e5be4bc8b5f4fd8d22ecaf0d: stopping tablet replica
I20260709 12:25:21.266527 20873 master.cc:584] Master@127.20.98.126:33531 shutdown complete.
7241be4ebe9a40fcaf7cf29c89e4861a  1
775fb2fc412047558a105b0c400d7a10  4
a338a3bbf4ec48669eae0848b86f7a0e  4
7241be4ebe9a40fcaf7cf29c89e4861a  3
775fb2fc412047558a105b0c400d7a10  3
a338a3bbf4ec48669eae0848b86f7a0e  3
7241be4ebe9a40fcaf7cf29c89e4861a  1
775fb2fc412047558a105b0c400d7a10  0
a338a3bbf4ec48669eae0848b86f7a0e  8
7241be4ebe9a40fcaf7cf29c89e4861a  3
775fb2fc412047558a105b0c400d7a10  3
a338a3bbf4ec48669eae0848b86f7a0e  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32730 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:25:21.315038 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:44931
I20260709 12:25:21.316265 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:21.322445 21414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.322649 21415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.322959 21417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:21.324095 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:21.325146 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:21.325457 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:21.325635 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599921325618 us; error 0 us; skew 500 ppm
I20260709 12:25:21.326200 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:21.335191 20873 webserver.cc:533] Webserver started at http://127.20.98.126:46259/ using document root <none> and password file <none>
I20260709 12:25:21.335748 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:21.335945 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:21.336239 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:21.337474 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "a18182af9439490483ff2c99c1c83e07"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.342113 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:21.346045 21422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.346966 20873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:25:21.347297 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "a18182af9439490483ff2c99c1c83e07"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.347579 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:21.369753 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:21.371065 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:21.411634 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:44931
I20260709 12:25:21.411755 21475 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:44931 every 8 connection(s)
I20260709 12:25:21.415818 21476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.426038 21476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07: Bootstrap starting.
I20260709 12:25:21.431190 21476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:21.435751 21476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07: No bootstrap required, opened a new log
I20260709 12:25:21.438177 21476 raft_consensus.cc:359] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a18182af9439490483ff2c99c1c83e07" member_type: VOTER }
I20260709 12:25:21.438697 21476 raft_consensus.cc:385] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:21.438898 21476 raft_consensus.cc:740] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a18182af9439490483ff2c99c1c83e07, State: Initialized, Role: FOLLOWER
I20260709 12:25:21.439445 21476 consensus_queue.cc:260] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a18182af9439490483ff2c99c1c83e07" member_type: VOTER }
I20260709 12:25:21.439893 21476 raft_consensus.cc:399] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:21.440094 21476 raft_consensus.cc:493] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:21.440310 21476 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:21.444546 21476 raft_consensus.cc:515] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a18182af9439490483ff2c99c1c83e07" member_type: VOTER }
I20260709 12:25:21.445083 21476 leader_election.cc:304] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a18182af9439490483ff2c99c1c83e07; no voters: 
I20260709 12:25:21.446319 21476 leader_election.cc:290] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:21.446756 21479 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:21.448189 21479 raft_consensus.cc:697] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 1 LEADER]: Becoming Leader. State: Replica: a18182af9439490483ff2c99c1c83e07, State: Running, Role: LEADER
I20260709 12:25:21.449028 21479 consensus_queue.cc:237] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a18182af9439490483ff2c99c1c83e07" member_type: VOTER }
I20260709 12:25:21.449695 21476 sys_catalog.cc:565] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:21.455389 21481 sys_catalog.cc:455] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a18182af9439490483ff2c99c1c83e07. Latest consensus state: current_term: 1 leader_uuid: "a18182af9439490483ff2c99c1c83e07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a18182af9439490483ff2c99c1c83e07" member_type: VOTER } }
I20260709 12:25:21.456336 21481 sys_catalog.cc:458] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:21.456871 21480 sys_catalog.cc:455] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a18182af9439490483ff2c99c1c83e07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a18182af9439490483ff2c99c1c83e07" member_type: VOTER } }
I20260709 12:25:21.457579 21480 sys_catalog.cc:458] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:21.459533 21487 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:21.467473 21487 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:21.474898 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:21.480268 21487 catalog_manager.cc:1383] Generated new cluster ID: 3cc2d73b39c34a7fbc79635d60224a63
I20260709 12:25:21.480602 21487 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:21.503157 21487 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:21.504558 21487 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:21.518704 21487 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07: Generated new TSK 0
I20260709 12:25:21.519544 21487 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:21.541618 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:21.549690 21497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.550626 21498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.552799 21500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:21.553741 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:21.555182 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:21.555536 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:21.555780 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599921555763 us; error 0 us; skew 500 ppm
I20260709 12:25:21.556612 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:21.560127 20873 webserver.cc:533] Webserver started at http://127.20.98.65:33347/ using document root <none> and password file <none>
I20260709 12:25:21.560702 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:21.560900 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:21.561244 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:21.562412 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "946821541b724b5fb50b7b6039800cb1"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.567446 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:25:21.571115 21505 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.571841 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:21.572161 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "946821541b724b5fb50b7b6039800cb1"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.572439 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:21.599694 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:21.601011 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:21.602689 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:21.604998 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:21.605232 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.605517 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:21.605690 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.647764 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:42959
I20260709 12:25:21.647882 21568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:42959 every 8 connection(s)
I20260709 12:25:21.652901 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:21.661070 21573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.663013 21574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.668566 21576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:21.669039 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:21.669188 21569 heartbeater.cc:344] Connected to a master server at 127.20.98.126:44931
I20260709 12:25:21.669757 21569 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:21.670526 21569 heartbeater.cc:507] Master 127.20.98.126:44931 requested a full tablet report, sending...
I20260709 12:25:21.670970 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:21.671200 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:21.671380 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599921671361 us; error 0 us; skew 500 ppm
I20260709 12:25:21.672041 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:21.673264 21440 ts_manager.cc:194] Registered new tserver with Master: 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959)
I20260709 12:25:21.674932 20873 webserver.cc:533] Webserver started at http://127.20.98.66:40689/ using document root <none> and password file <none>
I20260709 12:25:21.675458 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:21.675691 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:21.675966 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:21.675961 21440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54544
I20260709 12:25:21.677537 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "57726d42a95e411abf81fb000cc72e1c"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.682170 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:25:21.685600 21581 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.686375 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:21.686750 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "57726d42a95e411abf81fb000cc72e1c"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.687070 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:21.697683 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:21.698957 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:21.700474 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:21.702775 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:21.703011 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.703269 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:21.703454 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.744586 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:35381
I20260709 12:25:21.744688 21643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:35381 every 8 connection(s)
I20260709 12:25:21.749682 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:21.757772 21647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.760087 21648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:21.761137 21650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:21.762305 21644 heartbeater.cc:344] Connected to a master server at 127.20.98.126:44931
I20260709 12:25:21.762674 21644 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:21.763132 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:21.763499 21644 heartbeater.cc:507] Master 127.20.98.126:44931 requested a full tablet report, sending...
I20260709 12:25:21.764083 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:21.764317 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:21.764537 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599921764519 us; error 0 us; skew 500 ppm
I20260709 12:25:21.765342 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:21.765758 21440 ts_manager.cc:194] Registered new tserver with Master: 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:21.767488 21440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54556
I20260709 12:25:21.768025 20873 webserver.cc:533] Webserver started at http://127.20.98.67:38987/ using document root <none> and password file <none>
I20260709 12:25:21.768680 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:21.768921 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:21.769266 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:21.770462 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.775185 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:21.778646 21655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.779446 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:21.779762 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
format_stamp: "Formatted at 2026-07-09 12:25:21 on dist-test-slave-g3x6"
I20260709 12:25:21.780066 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:21.806669 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:21.807928 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:21.809561 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:21.811833 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:21.812062 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.812314 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:21.812497 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:21.856117 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:38407
I20260709 12:25:21.856233 21717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:38407 every 8 connection(s)
I20260709 12:25:21.870743 21718 heartbeater.cc:344] Connected to a master server at 127.20.98.126:44931
I20260709 12:25:21.871106 21718 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:21.871800 21718 heartbeater.cc:507] Master 127.20.98.126:44931 requested a full tablet report, sending...
I20260709 12:25:21.873860 21440 ts_manager.cc:194] Registered new tserver with Master: f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:21.874287 20873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014824792s
I20260709 12:25:21.875465 21440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54566
I20260709 12:25:21.901939 21440 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54580:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:21.904917 21440 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:21.979712 21531 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb06bc922eb490a903c9be604af732b (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:21.980376 21533 tablet_service.cc:1511] Processing CreateTablet for tablet e968a947e2cf41af99df9ddbf05656e7 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:21.980572 21532 tablet_service.cc:1511] Processing CreateTablet for tablet 43af3035fd4d4ea590c5eafce26d3aae (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:21.982559 21530 tablet_service.cc:1511] Processing CreateTablet for tablet 95505d9ffe054622a0534881bb9e02b5 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:21.985426 21531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb06bc922eb490a903c9be604af732b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.987108 21533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968a947e2cf41af99df9ddbf05656e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.989102 21529 tablet_service.cc:1511] Processing CreateTablet for tablet 537444430681420995e2cfd33a9f47c4 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:21.989756 21532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43af3035fd4d4ea590c5eafce26d3aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.990559 21529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537444430681420995e2cfd33a9f47c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.993989 21530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95505d9ffe054622a0534881bb9e02b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.994516 21528 tablet_service.cc:1511] Processing CreateTablet for tablet edeaf462ee794edeb4a47453b5e25852 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:21.995893 21528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edeaf462ee794edeb4a47453b5e25852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:21.999681 21527 tablet_service.cc:1511] Processing CreateTablet for tablet a62e41a6129f48d595e2d38a4684196e (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:22.004446 21526 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8d82df2c1d4904aa2467bc6d4aaddd (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:22.006111 21527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62e41a6129f48d595e2d38a4684196e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.009884 21526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8d82df2c1d4904aa2467bc6d4aaddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.015401 21525 tablet_service.cc:1511] Processing CreateTablet for tablet aa7a2566c41348e3b4a8fd13c4a0b40b (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:22.017114 21525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7a2566c41348e3b4a8fd13c4a0b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.046363 21527 tablet_service.cc:1511] Processing CreateTablet for tablet d2eba75ad05d42c99514b1432155e5ff (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:22.047839 21527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2eba75ad05d42c99514b1432155e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.050892 21733 tablet_bootstrap.cc:492] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.055312 21606 tablet_service.cc:1511] Processing CreateTablet for tablet 95505d9ffe054622a0534881bb9e02b5 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:22.057222 21609 tablet_service.cc:1511] Processing CreateTablet for tablet e968a947e2cf41af99df9ddbf05656e7 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:22.057886 21733 tablet_bootstrap.cc:654] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.058459 21605 tablet_service.cc:1511] Processing CreateTablet for tablet 537444430681420995e2cfd33a9f47c4 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:22.059557 21683 tablet_service.cc:1511] Processing CreateTablet for tablet e968a947e2cf41af99df9ddbf05656e7 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:22.060925 21683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968a947e2cf41af99df9ddbf05656e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.060824 21604 tablet_service.cc:1511] Processing CreateTablet for tablet edeaf462ee794edeb4a47453b5e25852 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:22.063184 21603 tablet_service.cc:1511] Processing CreateTablet for tablet a62e41a6129f48d595e2d38a4684196e (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:22.065657 21602 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8d82df2c1d4904aa2467bc6d4aaddd (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:22.066411 21607 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb06bc922eb490a903c9be604af732b (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:22.068825 21682 tablet_service.cc:1511] Processing CreateTablet for tablet 43af3035fd4d4ea590c5eafce26d3aae (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:22.068717 21600 tablet_service.cc:1511] Processing CreateTablet for tablet d2eba75ad05d42c99514b1432155e5ff (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:22.056969 21606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95505d9ffe054622a0534881bb9e02b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.064543 21608 tablet_service.cc:1511] Processing CreateTablet for tablet 43af3035fd4d4ea590c5eafce26d3aae (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:22.072330 21603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62e41a6129f48d595e2d38a4684196e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.073025 21605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537444430681420995e2cfd33a9f47c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.074313 21681 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb06bc922eb490a903c9be604af732b (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:22.077509 21601 tablet_service.cc:1511] Processing CreateTablet for tablet aa7a2566c41348e3b4a8fd13c4a0b40b (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:22.079516 21601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7a2566c41348e3b4a8fd13c4a0b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.080835 21675 tablet_service.cc:1511] Processing CreateTablet for tablet aa7a2566c41348e3b4a8fd13c4a0b40b (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:22.086881 21677 tablet_service.cc:1511] Processing CreateTablet for tablet a62e41a6129f48d595e2d38a4684196e (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:22.087235 21676 tablet_service.cc:1511] Processing CreateTablet for tablet 2a8d82df2c1d4904aa2467bc6d4aaddd (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:22.082543 21679 tablet_service.cc:1511] Processing CreateTablet for tablet 537444430681420995e2cfd33a9f47c4 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:22.090488 21674 tablet_service.cc:1511] Processing CreateTablet for tablet d2eba75ad05d42c99514b1432155e5ff (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:22.083799 21678 tablet_service.cc:1511] Processing CreateTablet for tablet edeaf462ee794edeb4a47453b5e25852 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:22.081133 21680 tablet_service.cc:1511] Processing CreateTablet for tablet 95505d9ffe054622a0534881bb9e02b5 (DEFAULT_TABLE table=test-workload [id=7b6bf07a614246a98074188d2aeba585]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:22.101751 21682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43af3035fd4d4ea590c5eafce26d3aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.102663 21675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa7a2566c41348e3b4a8fd13c4a0b40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.103549 21679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537444430681420995e2cfd33a9f47c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.105638 21680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95505d9ffe054622a0534881bb9e02b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.081525 21607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb06bc922eb490a903c9be604af732b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.113740 21608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43af3035fd4d4ea590c5eafce26d3aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.113852 21676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8d82df2c1d4904aa2467bc6d4aaddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.117728 21604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edeaf462ee794edeb4a47453b5e25852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.121690 21678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edeaf462ee794edeb4a47453b5e25852. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.125245 21674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2eba75ad05d42c99514b1432155e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.121711 21600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2eba75ad05d42c99514b1432155e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.129700 21681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb06bc922eb490a903c9be604af732b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.137547 21677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62e41a6129f48d595e2d38a4684196e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.141067 21733 tablet_bootstrap.cc:492] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.141626 21609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968a947e2cf41af99df9ddbf05656e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.141659 21733 ts_tablet_manager.cc:1403] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.091s	user 0.041s	sys 0.040s
I20260709 12:25:22.144968 21733 raft_consensus.cc:359] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.145581 21602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a8d82df2c1d4904aa2467bc6d4aaddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:22.145826 21733 raft_consensus.cc:385] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.146209 21733 raft_consensus.cc:740] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.147130 21733 consensus_queue.cc:260] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.241027 21735 tablet_bootstrap.cc:492] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.248018 21735 tablet_bootstrap.cc:654] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.252988 21569 heartbeater.cc:499] Master 127.20.98.126:44931 was elected leader, sending a full tablet report...
I20260709 12:25:22.254172 21737 tablet_bootstrap.cc:492] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.255661 21733 ts_tablet_manager.cc:1434] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.113s	user 0.033s	sys 0.060s
I20260709 12:25:22.258019 21733 tablet_bootstrap.cc:492] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.261544 21735 tablet_bootstrap.cc:492] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.262094 21735 ts_tablet_manager.cc:1403] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 12:25:22.265702 21737 tablet_bootstrap.cc:654] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.265333 21735 raft_consensus.cc:359] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.266153 21735 raft_consensus.cc:385] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.266476 21735 raft_consensus.cc:740] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.267287 21735 consensus_queue.cc:260] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.270957 21733 tablet_bootstrap.cc:654] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.278240 21737 tablet_bootstrap.cc:492] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.278817 21737 ts_tablet_manager.cc:1403] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 12:25:22.278924 21735 ts_tablet_manager.cc:1434] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.009s
I20260709 12:25:22.279191 21644 heartbeater.cc:499] Master 127.20.98.126:44931 was elected leader, sending a full tablet report...
I20260709 12:25:22.279950 21735 tablet_bootstrap.cc:492] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.287256 21735 tablet_bootstrap.cc:654] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.287210 21737 raft_consensus.cc:359] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.288103 21733 tablet_bootstrap.cc:492] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.288125 21737 raft_consensus.cc:385] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.288745 21737 raft_consensus.cc:740] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.288960 21733 ts_tablet_manager.cc:1403] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.001s
I20260709 12:25:22.290174 21737 consensus_queue.cc:260] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.292694 21733 raft_consensus.cc:359] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.293915 21733 raft_consensus.cc:385] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.294373 21733 raft_consensus.cc:740] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.295539 21733 consensus_queue.cc:260] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.297016 21736 raft_consensus.cc:493] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.297760 21736 raft_consensus.cc:515] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.308249 21736 leader_election.cc:290] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.334877 21718 heartbeater.cc:499] Master 127.20.98.126:44931 was elected leader, sending a full tablet report...
I20260709 12:25:22.335479 21735 tablet_bootstrap.cc:492] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.336040 21735 ts_tablet_manager.cc:1403] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.036s
I20260709 12:25:22.339135 21735 raft_consensus.cc:359] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.339912 21735 raft_consensus.cc:385] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.340260 21735 raft_consensus.cc:740] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.341159 21735 consensus_queue.cc:260] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.343439 21735 ts_tablet_manager.cc:1434] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:22.344435 21735 tablet_bootstrap.cc:492] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.350754 21737 ts_tablet_manager.cc:1434] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.072s	user 0.018s	sys 0.028s
I20260709 12:25:22.351119 21735 tablet_bootstrap.cc:654] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.353853 21737 tablet_bootstrap.cc:492] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
W20260709 12:25:22.360473 21719 tablet.cc:2406] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:22.363493 21735 tablet_bootstrap.cc:492] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.363998 21733 ts_tablet_manager.cc:1434] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.075s	user 0.034s	sys 0.038s
I20260709 12:25:22.364049 21735 ts_tablet_manager.cc:1403] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:25:22.367468 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:22.368324 21619 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 0.
I20260709 12:25:22.369221 21733 tablet_bootstrap.cc:492] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.369976 21508 leader_election.cc:304] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:22.371053 21744 raft_consensus.cc:2804] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.371498 21744 raft_consensus.cc:493] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.371642 21737 tablet_bootstrap.cc:654] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.371887 21744 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.372061 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
W20260709 12:25:22.373926 21508 leader_election.cc:343] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.376106 21735 raft_consensus.cc:359] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.376870 21735 raft_consensus.cc:385] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.377193 21735 raft_consensus.cc:740] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.378041 21735 consensus_queue.cc:260] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.378791 21733 tablet_bootstrap.cc:654] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.387405 21735 ts_tablet_manager.cc:1434] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 12:25:22.388661 21737 tablet_bootstrap.cc:492] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.389238 21737 ts_tablet_manager.cc:1403] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.008s
I20260709 12:25:22.390268 21733 tablet_bootstrap.cc:492] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.390828 21733 ts_tablet_manager.cc:1403] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:25:22.391196 21735 tablet_bootstrap.cc:492] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.392369 21737 raft_consensus.cc:359] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.393380 21737 raft_consensus.cc:385] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.393708 21737 raft_consensus.cc:740] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.394802 21737 consensus_queue.cc:260] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.397064 21737 ts_tablet_manager.cc:1434] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:25:22.396793 21744 raft_consensus.cc:515] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.398104 21737 tablet_bootstrap.cc:492] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.399868 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:22.400516 21619 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.400993 21735 tablet_bootstrap.cc:654] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.396585 21733 raft_consensus.cc:359] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.405368 21733 raft_consensus.cc:385] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.405854 21733 raft_consensus.cc:740] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.406876 21733 consensus_queue.cc:260] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.410133 21733 ts_tablet_manager.cc:1434] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:25:22.411193 21733 tablet_bootstrap.cc:492] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.412317 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.412989 21693 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.414006 21735 tablet_bootstrap.cc:492] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.417392 21735 ts_tablet_manager.cc:1403] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.012s
I20260709 12:25:22.419162 21733 tablet_bootstrap.cc:654] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.419457 21693 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 1.
I20260709 12:25:22.420768 21508 leader_election.cc:304] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:22.421694 21736 raft_consensus.cc:2804] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.421834 21737 tablet_bootstrap.cc:654] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.421130 21735 raft_consensus.cc:359] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.422734 21735 raft_consensus.cc:385] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.422935 21736 raft_consensus.cc:697] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:22.423183 21735 raft_consensus.cc:740] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.423760 21736 consensus_queue.cc:237] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.424674 21735 consensus_queue.cc:260] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.428056 21744 leader_election.cc:290] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.410316 21619 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 1.
I20260709 12:25:22.430023 21737 tablet_bootstrap.cc:492] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.430718 21737 ts_tablet_manager.cc:1403] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.000s
I20260709 12:25:22.434819 21737 raft_consensus.cc:359] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.437956 21735 ts_tablet_manager.cc:1434] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:25:22.438712 21737 raft_consensus.cc:385] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.439186 21737 raft_consensus.cc:740] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.440081 21737 consensus_queue.cc:260] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.444563 21733 tablet_bootstrap.cc:492] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.445115 21733 ts_tablet_manager.cc:1403] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.008s
I20260709 12:25:22.444900 21440 catalog_manager.cc:5697] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.447158 21737 ts_tablet_manager.cc:1434] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:22.448356 21737 tablet_bootstrap.cc:492] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.448240 21733 raft_consensus.cc:359] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.449153 21733 raft_consensus.cc:385] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.449532 21733 raft_consensus.cc:740] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.450414 21733 consensus_queue.cc:260] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.453054 21733 ts_tablet_manager.cc:1434] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:22.454360 21735 tablet_bootstrap.cc:492] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.456118 21737 tablet_bootstrap.cc:654] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.456801 21733 tablet_bootstrap.cc:492] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.462049 21737 tablet_bootstrap.cc:492] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.462546 21737 ts_tablet_manager.cc:1403] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 12:25:22.463899 21733 tablet_bootstrap.cc:654] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.464349 21735 tablet_bootstrap.cc:654] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.465667 21737 raft_consensus.cc:359] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.466500 21737 raft_consensus.cc:385] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.466804 21737 raft_consensus.cc:740] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
W20260709 12:25:22.466904 21489 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:22.467756 21737 consensus_queue.cc:260] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.470896 21735 tablet_bootstrap.cc:492] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.471434 21735 ts_tablet_manager.cc:1403] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 12:25:22.473831 21737 ts_tablet_manager.cc:1434] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:25:22.474910 21737 tablet_bootstrap.cc:492] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.474905 21735 raft_consensus.cc:359] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.475927 21735 raft_consensus.cc:385] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.476344 21735 raft_consensus.cc:740] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.477195 21735 consensus_queue.cc:260] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.478209 21733 tablet_bootstrap.cc:492] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.478849 21733 ts_tablet_manager.cc:1403] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 12:25:22.479916 21735 ts_tablet_manager.cc:1434] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:22.481069 21735 tablet_bootstrap.cc:492] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.482016 21733 raft_consensus.cc:359] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.482492 21737 tablet_bootstrap.cc:654] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.482774 21733 raft_consensus.cc:385] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.483129 21733 raft_consensus.cc:740] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.489912 21733 consensus_queue.cc:260] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.492762 21740 raft_consensus.cc:493] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.493332 21740 raft_consensus.cc:515] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.495160 21735 tablet_bootstrap.cc:654] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.495468 21737 tablet_bootstrap.cc:492] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.495199 21733 ts_tablet_manager.cc:1434] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:25:22.495980 21737 ts_tablet_manager.cc:1403] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 12:25:22.496753 21733 tablet_bootstrap.cc:492] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.499348 21737 raft_consensus.cc:359] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.500100 21737 raft_consensus.cc:385] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.500401 21737 raft_consensus.cc:740] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.501755 21740 leader_election.cc:290] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.502281 21740 raft_consensus.cc:493] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.502741 21740 raft_consensus.cc:515] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.504017 21733 tablet_bootstrap.cc:654] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.504858 21740 leader_election.cc:290] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.507835 21737 consensus_queue.cc:260] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.515172 21736 raft_consensus.cc:493] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.525924 21736 raft_consensus.cc:515] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.528131 21736 leader_election.cc:290] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.530727 21737 ts_tablet_manager.cc:1434] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:25:22.531958 21737 tablet_bootstrap.cc:492] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.523352 21735 tablet_bootstrap.cc:492] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.536434 21735 ts_tablet_manager.cc:1403] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.021s
I20260709 12:25:22.542181 21737 tablet_bootstrap.cc:654] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.542399 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
W20260709 12:25:22.546458 21508 leader_election.cc:343] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.544101 21735 raft_consensus.cc:359] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.549321 21735 raft_consensus.cc:385] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.549794 21735 raft_consensus.cc:740] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.552398 21740 raft_consensus.cc:493] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.553646 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:22.553062 21740 raft_consensus.cc:515] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.550761 21735 consensus_queue.cc:260] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.557062 21740 leader_election.cc:290] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.557934 21735 ts_tablet_manager.cc:1434] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:25:22.559463 21735 tablet_bootstrap.cc:492] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
W20260709 12:25:22.560618 21508 leader_election.cc:343] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.561126 21508 leader_election.cc:304] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1; no voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:22.562424 21736 raft_consensus.cc:2749] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:22.564644 21737 tablet_bootstrap.cc:492] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.565441 21737 ts_tablet_manager.cc:1403] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.000s
I20260709 12:25:22.566504 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:22.567492 21736 raft_consensus.cc:493] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.568133 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:22.568006 21736 raft_consensus.cc:515] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.568717 21542 raft_consensus.cc:2468] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.570197 21736 leader_election.cc:290] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.570008 21541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:22.571899 21693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.571919 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.572678 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:22.572767 21693 raft_consensus.cc:2468] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.572827 21691 raft_consensus.cc:2468] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.574260 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.575721 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.575568 21737 raft_consensus.cc:359] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.576391 21737 raft_consensus.cc:385] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.576431 21690 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 0.
I20260709 12:25:22.576822 21737 raft_consensus.cc:740] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.578024 21584 leader_election.cc:304] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
W20260709 12:25:22.578828 21582 leader_election.cc:343] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.579656 21584 leader_election.cc:304] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:22.579969 21582 leader_election.cc:304] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:22.580598 21763 raft_consensus.cc:2804] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.578930 21740 raft_consensus.cc:2804] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.581082 21763 raft_consensus.cc:493] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.581238 21740 raft_consensus.cc:493] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.581535 21763 raft_consensus.cc:3060] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.581761 21740 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:22.586076 21584 leader_election.cc:343] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.587038 21508 leader_election.cc:304] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:22.587915 21736 raft_consensus.cc:2804] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.588327 21736 raft_consensus.cc:493] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.588690 21736 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.580688 21733 tablet_bootstrap.cc:492] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.589365 21763 raft_consensus.cc:515] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
W20260709 12:25:22.592080 21582 leader_election.cc:343] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:22.590618 21508 leader_election.cc:343] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.593981 21733 ts_tablet_manager.cc:1403] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.097s	user 0.035s	sys 0.035s
I20260709 12:25:22.594623 21763 leader_election.cc:290] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.577358 21735 tablet_bootstrap.cc:654] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.595389 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.596014 21690 raft_consensus.cc:3060] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.591917 21766 raft_consensus.cc:2804] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.597046 21766 raft_consensus.cc:493] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.596480 21736 raft_consensus.cc:515] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.597451 21766 raft_consensus.cc:3060] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.598883 21733 raft_consensus.cc:359] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.599689 21733 raft_consensus.cc:385] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.600023 21733 raft_consensus.cc:740] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.600383 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:22.600848 21733 consensus_queue.cc:260] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
W20260709 12:25:22.602756 21508 leader_election.cc:343] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.603415 21733 ts_tablet_manager.cc:1434] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:25:22.604545 21733 tablet_bootstrap.cc:492] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.593725 21737 consensus_queue.cc:260] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.606622 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.607422 21692 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.611753 21733 tablet_bootstrap.cc:654] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.612044 21541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:22.614554 21737 ts_tablet_manager.cc:1434] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.002s
I20260709 12:25:22.617105 21740 raft_consensus.cc:515] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.618803 21737 tablet_bootstrap.cc:492] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.622573 21690 raft_consensus.cc:2468] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
W20260709 12:25:22.623055 21582 leader_election.cc:343] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.623682 21740 leader_election.cc:290] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.624385 21541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:22.625921 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.626543 21690 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.630278 21735 tablet_bootstrap.cc:492] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.630848 21735 ts_tablet_manager.cc:1403] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.011s
W20260709 12:25:22.634007 21582 leader_election.cc:343] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.614948 21736 leader_election.cc:290] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.634205 21735 raft_consensus.cc:359] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.635068 21735 raft_consensus.cc:385] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.635967 21735 raft_consensus.cc:740] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.636906 21735 consensus_queue.cc:260] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.638186 21584 leader_election.cc:304] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:22.639137 21740 raft_consensus.cc:2804] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.639662 21740 raft_consensus.cc:697] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:22.642614 21740 consensus_queue.cc:237] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.646713 21692 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 1.
I20260709 12:25:22.646216 21766 raft_consensus.cc:515] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.649740 21690 raft_consensus.cc:2468] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:22.649000 21508 leader_election.cc:304] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 57726d42a95e411abf81fb000cc72e1c
I20260709 12:25:22.651166 21736 raft_consensus.cc:2804] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.651026 21584 leader_election.cc:304] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:22.651707 21736 raft_consensus.cc:697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:22.649220 21737 tablet_bootstrap.cc:654] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.653208 21541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:22.653842 21541 raft_consensus.cc:3060] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.655097 21733 tablet_bootstrap.cc:492] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.655611 21733 ts_tablet_manager.cc:1403] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.019s
I20260709 12:25:22.651964 21763 raft_consensus.cc:2804] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.657274 21763 raft_consensus.cc:697] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:22.654978 21736 consensus_queue.cc:237] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.658113 21763 consensus_queue.cc:237] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.663220 21541 raft_consensus.cc:2468] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:22.664319 21735 ts_tablet_manager.cc:1434] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:25:22.662807 21740 raft_consensus.cc:493] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.664692 21582 leader_election.cc:304] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:22.667030 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.667613 21740 raft_consensus.cc:515] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
W20260709 12:25:22.668556 21584 leader_election.cc:343] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.669481 21763 raft_consensus.cc:2804] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.669891 21763 raft_consensus.cc:697] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:22.670482 21763 consensus_queue.cc:237] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.665442 21735 tablet_bootstrap.cc:492] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.671770 21740 leader_election.cc:290] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.672458 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.673123 21692 raft_consensus.cc:2468] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.666007 21766 leader_election.cc:290] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.665128 21440 catalog_manager.cc:5697] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 1 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.674372 21584 leader_election.cc:304] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:22.675531 21740 raft_consensus.cc:2804] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.676012 21740 raft_consensus.cc:493] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.676455 21740 raft_consensus.cc:3060] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.666671 21733 raft_consensus.cc:359] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.677374 21733 raft_consensus.cc:385] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.677845 21733 raft_consensus.cc:740] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.679169 21733 consensus_queue.cc:260] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.682753 21744 raft_consensus.cc:493] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.683234 21744 raft_consensus.cc:515] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.685407 21744 leader_election.cc:290] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.686123 21733 ts_tablet_manager.cc:1434] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:25:22.687202 21733 tablet_bootstrap.cc:492] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.687798 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
W20260709 12:25:22.689697 21508 leader_election.cc:343] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.691326 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
W20260709 12:25:22.693527 21508 leader_election.cc:343] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.694183 21508 leader_election.cc:304] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1; no voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:22.695770 21744 raft_consensus.cc:2749] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:22.697434 21737 tablet_bootstrap.cc:492] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.697930 21737 ts_tablet_manager.cc:1403] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.007s
I20260709 12:25:22.700835 21735 tablet_bootstrap.cc:654] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.701782 21737 raft_consensus.cc:359] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.702558 21737 raft_consensus.cc:385] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.702859 21737 raft_consensus.cc:740] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.704317 21737 consensus_queue.cc:260] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.706738 21737 ts_tablet_manager.cc:1434] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:22.707370 21440 catalog_manager.cc:5697] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 1 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.711175 21763 raft_consensus.cc:493] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.711637 21763 raft_consensus.cc:515] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.712114 21740 raft_consensus.cc:515] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.713961 21763 leader_election.cc:290] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.709205 21440 catalog_manager.cc:5697] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 1 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.715247 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7a2566c41348e3b4a8fd13c4a0b40b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.708513 21737 tablet_bootstrap.cc:492] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
W20260709 12:25:22.716540 21582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:42959, user_credentials={real_user=slave}} blocked reactor thread for 51924.9us
I20260709 12:25:22.716462 21692 raft_consensus.cc:2468] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.716450 21438 catalog_manager.cc:5697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.718641 21541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:22.719331 21541 raft_consensus.cc:2468] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.720484 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7a2566c41348e3b4a8fd13c4a0b40b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:22.723083 21584 leader_election.cc:304] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
W20260709 12:25:22.724042 21582 leader_election.cc:343] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.725533 21737 tablet_bootstrap.cc:654] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.725533 21772 raft_consensus.cc:2804] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.726181 21772 raft_consensus.cc:493] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.726573 21772 raft_consensus.cc:3060] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.729715 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:22.730753 21740 leader_election.cc:290] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.730902 21542 raft_consensus.cc:3060] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.734704 21733 tablet_bootstrap.cc:654] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.736989 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.737668 21692 raft_consensus.cc:3060] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.742439 21542 raft_consensus.cc:2468] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:22.750025 21582 leader_election.cc:304] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:22.751295 21740 raft_consensus.cc:2804] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.752409 21740 raft_consensus.cc:697] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:22.753609 21740 consensus_queue.cc:237] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.758006 21735 tablet_bootstrap.cc:492] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.758551 21735 ts_tablet_manager.cc:1403] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.000s
I20260709 12:25:22.762573 21735 raft_consensus.cc:359] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.763607 21735 raft_consensus.cc:385] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.764051 21735 raft_consensus.cc:740] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.766218 21735 consensus_queue.cc:260] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.767930 21735 ts_tablet_manager.cc:1434] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:22.769182 21735 tablet_bootstrap.cc:492] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
I20260709 12:25:22.775281 21735 tablet_bootstrap.cc:654] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.784122 21733 tablet_bootstrap.cc:492] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.784855 21733 ts_tablet_manager.cc:1403] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.014s
I20260709 12:25:22.782823 21692 raft_consensus.cc:2468] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:22.788127 21733 raft_consensus.cc:359] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.788699 21735 tablet_bootstrap.cc:492] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.789001 21733 raft_consensus.cc:385] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.789247 21735 ts_tablet_manager.cc:1403] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:25:22.789320 21733 raft_consensus.cc:740] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.789764 21772 raft_consensus.cc:515] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.792011 21735 raft_consensus.cc:359] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.792557 21737 tablet_bootstrap.cc:492] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.792734 21735 raft_consensus.cc:385] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.793187 21735 raft_consensus.cc:740] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.793309 21737 ts_tablet_manager.cc:1403] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.085s	user 0.024s	sys 0.030s
I20260709 12:25:22.793416 21772 leader_election.cc:290] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.793078 21439 catalog_manager.cc:5697] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 1 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.793334 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7a2566c41348e3b4a8fd13c4a0b40b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.793977 21735 consensus_queue.cc:260] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.794559 21692 raft_consensus.cc:3060] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.796164 21735 ts_tablet_manager.cc:1434] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:22.796752 21737 raft_consensus.cc:359] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.797501 21737 raft_consensus.cc:385] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.797406 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7a2566c41348e3b4a8fd13c4a0b40b" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:22.797828 21735 tablet_bootstrap.cc:492] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c: Bootstrap starting.
W20260709 12:25:22.799062 21582 leader_election.cc:343] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:22.799719 21737 raft_consensus.cc:740] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.799784 21733 consensus_queue.cc:260] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.800640 21737 consensus_queue.cc:260] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.802707 21737 ts_tablet_manager.cc:1434] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:22.803895 21735 tablet_bootstrap.cc:654] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.806466 21737 tablet_bootstrap.cc:492] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.806872 21692 raft_consensus.cc:2468] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:22.808068 21584 leader_election.cc:304] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:22.808964 21740 raft_consensus.cc:2804] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.809720 21740 raft_consensus.cc:697] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:22.810678 21740 consensus_queue.cc:237] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.813280 21737 tablet_bootstrap.cc:654] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.818257 21733 ts_tablet_manager.cc:1434] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:25:22.825199 21737 tablet_bootstrap.cc:492] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.825778 21737 ts_tablet_manager.cc:1403] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 12:25:22.827894 21737 raft_consensus.cc:359] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.828567 21737 raft_consensus.cc:385] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.828810 21737 raft_consensus.cc:740] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.829459 21737 consensus_queue.cc:260] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.829042 21439 catalog_manager.cc:5697] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 1 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.831158 21737 ts_tablet_manager.cc:1434] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:22.832147 21737 tablet_bootstrap.cc:492] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26: Bootstrap starting.
I20260709 12:25:22.832916 21733 tablet_bootstrap.cc:492] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.836908 21737 tablet_bootstrap.cc:654] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.842618 21735 tablet_bootstrap.cc:492] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c: No bootstrap required, opened a new log
I20260709 12:25:22.843358 21735 ts_tablet_manager.cc:1403] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.021s
I20260709 12:25:22.845463 21737 tablet_bootstrap.cc:492] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26: No bootstrap required, opened a new log
I20260709 12:25:22.846050 21737 ts_tablet_manager.cc:1403] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:25:22.846006 21735 raft_consensus.cc:359] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.846828 21735 raft_consensus.cc:385] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.847142 21735 raft_consensus.cc:740] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.847872 21735 consensus_queue.cc:260] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.849352 21733 tablet_bootstrap.cc:654] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.848941 21737 raft_consensus.cc:359] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.849759 21737 raft_consensus.cc:385] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.850047 21735 ts_tablet_manager.cc:1434] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:22.850121 21737 raft_consensus.cc:740] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.850991 21737 consensus_queue.cc:260] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.852735 21737 ts_tablet_manager.cc:1434] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:22.860579 21733 tablet_bootstrap.cc:492] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.861034 21733 ts_tablet_manager.cc:1403] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.004s
I20260709 12:25:22.863668 21733 raft_consensus.cc:359] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.864353 21733 raft_consensus.cc:385] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.864615 21733 raft_consensus.cc:740] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.866077 21733 consensus_queue.cc:260] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.867707 21736 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:22.868191 21733 ts_tablet_manager.cc:1434] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:25:22.869105 21733 tablet_bootstrap.cc:492] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1: Bootstrap starting.
I20260709 12:25:22.874655 21733 tablet_bootstrap.cc:654] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:22.890897 21733 tablet_bootstrap.cc:492] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1: No bootstrap required, opened a new log
I20260709 12:25:22.891477 21733 ts_tablet_manager.cc:1403] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:25:22.892166 21736 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:22.894683 21733 raft_consensus.cc:359] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.895604 21733 raft_consensus.cc:385] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:22.895889 21733 raft_consensus.cc:740] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.896587 21733 consensus_queue.cc:260] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.898722 21733 ts_tablet_manager.cc:1434] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:22.903916 21740 raft_consensus.cc:493] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.904434 21740 raft_consensus.cc:515] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.906612 21740 leader_election.cc:290] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.907299 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:22.907332 21736 raft_consensus.cc:493] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.908001 21542 raft_consensus.cc:2468] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.908231 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.908313 21736 raft_consensus.cc:515] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.909202 21692 raft_consensus.cc:2468] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:22.909284 21582 leader_election.cc:304] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:22.913112 21740 raft_consensus.cc:2804] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:22.913511 21740 raft_consensus.cc:493] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.910542 21736 leader_election.cc:290] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.913846 21740 raft_consensus.cc:3060] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.911603 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7a2566c41348e3b4a8fd13c4a0b40b" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:22.911926 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa7a2566c41348e3b4a8fd13c4a0b40b" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:22.915126 21690 raft_consensus.cc:2393] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 946821541b724b5fb50b7b6039800cb1 in current term 1: Already voted for candidate 57726d42a95e411abf81fb000cc72e1c in this term.
I20260709 12:25:22.916574 21508 leader_election.cc:304] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1; no voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:22.917685 21736 raft_consensus.cc:3060] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.920595 21740 raft_consensus.cc:515] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.922802 21740 leader_election.cc:290] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:22.923631 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:22.923954 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:22.924271 21542 raft_consensus.cc:3060] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.924360 21736 raft_consensus.cc:2749] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:22.924575 21690 raft_consensus.cc:3060] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:22.929263 21542 raft_consensus.cc:2468] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:22.929409 21690 raft_consensus.cc:2468] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:22.930435 21582 leader_election.cc:304] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:22.931131 21740 raft_consensus.cc:2804] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:22.931615 21740 raft_consensus.cc:697] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:22.932329 21740 consensus_queue.cc:237] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:22.939476 21440 catalog_manager.cc:5697] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 1 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.020006 21740 raft_consensus.cc:493] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.020663 21740 raft_consensus.cc:515] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.022737 21740 leader_election.cc:290] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.023523 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:23.023931 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:23.024691 21690 raft_consensus.cc:2393] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57726d42a95e411abf81fb000cc72e1c in current term 1: Already voted for candidate 946821541b724b5fb50b7b6039800cb1 in this term.
I20260709 12:25:23.025651 21584 leader_election.cc:304] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c; no voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:23.026404 21740 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.026566 21743 raft_consensus.cc:493] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.027050 21743 raft_consensus.cc:515] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.029812 21743 leader_election.cc:290] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:23.034037 21740 raft_consensus.cc:2749] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:23.041016 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:23.041795 21542 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 0.
I20260709 12:25:23.042866 21656 leader_election.cc:304] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.043006 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:23.043624 21619 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 0.
I20260709 12:25:23.043658 21743 raft_consensus.cc:2804] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:23.044145 21743 raft_consensus.cc:493] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.044546 21743 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.049824 21743 raft_consensus.cc:515] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.051473 21743 leader_election.cc:290] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:23.052513 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:23.052621 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:23.053125 21542 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.053130 21619 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.055939 21736 raft_consensus.cc:493] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.056576 21736 raft_consensus.cc:515] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.058540 21619 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 1.
I20260709 12:25:23.059438 21736 leader_election.cc:290] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.059954 21658 leader_election.cc:304] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.060170 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:23.060495 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:23.060854 21542 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 1.
I20260709 12:25:23.060997 21690 raft_consensus.cc:2393] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 946821541b724b5fb50b7b6039800cb1 in current term 1: Already voted for candidate 57726d42a95e411abf81fb000cc72e1c in this term.
I20260709 12:25:23.060967 21743 raft_consensus.cc:2804] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:23.062700 21743 raft_consensus.cc:697] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 LEADER]: Becoming Leader. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:23.062536 21508 leader_election.cc:304] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1; no voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:23.063483 21736 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.063602 21743 consensus_queue.cc:237] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.069339 21736 raft_consensus.cc:2749] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:23.071791 21440 catalog_manager.cc:5697] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 reported cstate change: term changed from 0 to 1, leader changed from <none> to f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.075760 21740 consensus_queue.cc:1048] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.083366 21736 raft_consensus.cc:493] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.083880 21736 raft_consensus.cc:515] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.086715 21736 leader_election.cc:290] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.087459 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:23.088312 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:23.089103 21692 raft_consensus.cc:2393] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 946821541b724b5fb50b7b6039800cb1 in current term 1: Already voted for candidate 57726d42a95e411abf81fb000cc72e1c in this term.
I20260709 12:25:23.090261 21740 consensus_queue.cc:1048] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.090642 21508 leader_election.cc:304] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1; no voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:23.091758 21736 raft_consensus.cc:3060] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.099381 21736 raft_consensus.cc:2749] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:23.106961 21743 raft_consensus.cc:493] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.107522 21743 raft_consensus.cc:515] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.109421 21743 leader_election.cc:290] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:23.110121 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:23.110564 21619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57726d42a95e411abf81fb000cc72e1c" is_pre_election: true
I20260709 12:25:23.110837 21542 raft_consensus.cc:2393] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f860d5e131ce49a29f9fc3f9b6259f26 in current term 1: Already voted for candidate 57726d42a95e411abf81fb000cc72e1c in this term.
I20260709 12:25:23.111956 21658 leader_election.cc:304] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f860d5e131ce49a29f9fc3f9b6259f26; no voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:23.112675 21743 raft_consensus.cc:3060] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.117331 21743 raft_consensus.cc:2749] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:23.122224 21740 raft_consensus.cc:493] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.122802 21740 raft_consensus.cc:515] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.125053 21740 leader_election.cc:290] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.126410 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1" is_pre_election: true
I20260709 12:25:23.126411 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" is_pre_election: true
I20260709 12:25:23.127270 21692 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:23.127261 21542 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 0.
I20260709 12:25:23.128515 21582 leader_election.cc:304] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:23.129694 21766 raft_consensus.cc:2804] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:23.130154 21766 raft_consensus.cc:493] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.130508 21766 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.131844 21740 consensus_queue.cc:1048] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.137270 21766 raft_consensus.cc:515] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.140652 21766 leader_election.cc:290] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.142716 21690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:23.143476 21690 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.143889 21766 consensus_queue.cc:1048] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.144193 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:23.144737 21542 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:23.152689 21690 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:23.154230 21584 leader_election.cc:304] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.155272 21766 raft_consensus.cc:2804] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:23.155857 21766 raft_consensus.cc:697] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:23.156976 21766 consensus_queue.cc:237] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.159622 21542 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 1.
I20260709 12:25:23.166742 21439 catalog_manager.cc:5697] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 1 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.185590 21766 consensus_queue.cc:1048] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.196962 21740 consensus_queue.cc:1048] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.200255 21740 consensus_queue.cc:1048] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.202804 21740 consensus_queue.cc:1048] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.205067 21736 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.222180 21772 consensus_queue.cc:1048] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.232957 21740 consensus_queue.cc:1048] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:23.233310 21751 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:23.338274 21772 consensus_queue.cc:1048] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.353554 21740 consensus_queue.cc:1048] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:23.403678 21691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:46974
I20260709 12:25:23.404290 21691 raft_consensus.cc:606] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:23.416801 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:40534
I20260709 12:25:23.417385 21618 raft_consensus.cc:606] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:23.422566 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:40534
I20260709 12:25:23.423110 21618 raft_consensus.cc:606] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:23.430399 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "537444430681420995e2cfd33a9f47c4"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:40534
I20260709 12:25:23.430979 21618 raft_consensus.cc:606] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:23.445350 21743 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.451121 21542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
mode: GRACEFUL
new_leader_uuid: "57726d42a95e411abf81fb000cc72e1c"
 from {username='slave'} at 127.0.0.1:58018
I20260709 12:25:23.451798 21542 raft_consensus.cc:606] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Received request to transfer leadership to TS 57726d42a95e411abf81fb000cc72e1c
I20260709 12:25:23.453766 21743 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:23.468360 21619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
mode: GRACEFUL
new_leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:40534
I20260709 12:25:23.469055 21619 raft_consensus.cc:606] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Received request to transfer leadership to TS f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:23.474534 21815 raft_consensus.cc:993] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.475692 21795 raft_consensus.cc:1081] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.477989 21542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58016
I20260709 12:25:23.484148 21542 raft_consensus.cc:493] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.484777 21542 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.496269 21542 raft_consensus.cc:515] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.503029 21542 leader_election.cc:290] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.503173 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:23.503852 21618 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.504232 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:23.504806 21691 raft_consensus.cc:3055] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.505128 21691 raft_consensus.cc:740] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:23.505967 21691 consensus_queue.cc:260] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.506999 21691 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.509469 21618 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.510592 21508 leader_election.cc:304] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:23.511312 21744 raft_consensus.cc:2804] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.511821 21744 raft_consensus.cc:697] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:23.512890 21691 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.512715 21744 consensus_queue.cc:237] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.519438 21440 catalog_manager.cc:5697] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 1 to 2, leader changed from f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.673013 21766 raft_consensus.cc:993] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c: : Instructing follower f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:23.673544 21766 raft_consensus.cc:1081] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Signalling peer f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:23.676191 21691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:46962
I20260709 12:25:23.676868 21691 raft_consensus.cc:493] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.677322 21691 raft_consensus.cc:3060] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.677382 21818 consensus_queue.cc:1048] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:23.681607 21818 consensus_queue.cc:1048] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:23.686970 21691 raft_consensus.cc:515] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.690583 21541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:23.691231 21541 raft_consensus.cc:3060] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.691373 21691 leader_election.cc:290] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 2 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:23.691720 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eba75ad05d42c99514b1432155e5ff" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:23.692355 21618 raft_consensus.cc:3055] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.692679 21618 raft_consensus.cc:740] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:23.698697 21541 raft_consensus.cc:2468] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 2.
I20260709 12:25:23.700579 21656 leader_election.cc:304] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.700700 21618 consensus_queue.cc:260] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.701661 21815 raft_consensus.cc:2804] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.701995 21618 raft_consensus.cc:3060] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.702178 21815 raft_consensus.cc:697] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 LEADER]: Becoming Leader. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:23.703099 21815 consensus_queue.cc:237] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.705317 21772 raft_consensus.cc:993] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.705801 21772 raft_consensus.cc:1081] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.708461 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "537444430681420995e2cfd33a9f47c4"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58010
I20260709 12:25:23.709045 21543 raft_consensus.cc:493] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.709457 21543 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.709586 21618 raft_consensus.cc:2468] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 2.
I20260709 12:25:23.715212 21542 raft_consensus.cc:1240] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Rejecting Update request from peer 57726d42a95e411abf81fb000cc72e1c for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:23.716683 21543 raft_consensus.cc:515] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.719764 21543 leader_election.cc:290] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.720839 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:23.719579 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:23.721517 21691 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.721596 21618 raft_consensus.cc:3055] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.720852 21440 catalog_manager.cc:5697] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 reported cstate change: term changed from 1 to 2, leader changed from 57726d42a95e411abf81fb000cc72e1c (127.20.98.66) to f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.721990 21618 raft_consensus.cc:740] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:23.722802 21618 consensus_queue.cc:260] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.724020 21618 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.728088 21691 raft_consensus.cc:2468] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.729518 21508 leader_election.cc:304] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.730387 21744 raft_consensus.cc:2804] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.730873 21744 raft_consensus.cc:697] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:23.731138 21618 raft_consensus.cc:2468] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.731613 21744 consensus_queue.cc:237] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.732730 21751 raft_consensus.cc:993] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: : Instructing follower 57726d42a95e411abf81fb000cc72e1c to start an election
I20260709 12:25:23.733156 21736 raft_consensus.cc:1081] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Signalling peer 57726d42a95e411abf81fb000cc72e1c to start an election
I20260709 12:25:23.735567 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
 from {username='slave'} at 127.0.0.1:40516
I20260709 12:25:23.736140 21618 raft_consensus.cc:493] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.736524 21618 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.738771 21440 catalog_manager.cc:5697] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 1 to 2, leader changed from 57726d42a95e411abf81fb000cc72e1c (127.20.98.66) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.741413 21618 raft_consensus.cc:515] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.743957 21618 leader_election.cc:290] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 2 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.743954 21543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:23.744270 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:23.744628 21543 raft_consensus.cc:3055] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.744892 21692 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.745012 21543 raft_consensus.cc:740] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:23.745939 21543 consensus_queue.cc:260] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.747189 21543 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.751530 21692 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 2.
I20260709 12:25:23.752512 21584 leader_election.cc:304] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.753334 21763 raft_consensus.cc:2804] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.753522 21543 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 2.
I20260709 12:25:23.753767 21763 raft_consensus.cc:697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:23.754627 21763 consensus_queue.cc:237] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.760689 21440 catalog_manager.cc:5697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 1 to 2, leader changed from 946821541b724b5fb50b7b6039800cb1 (127.20.98.65) to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 2 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.779067 21740 raft_consensus.cc:993] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.779542 21763 raft_consensus.cc:1081] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.781019 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58010
I20260709 12:25:23.781563 21543 raft_consensus.cc:493] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.781862 21543 raft_consensus.cc:3060] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.786636 21543 raft_consensus.cc:515] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.788357 21543 leader_election.cc:290] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.789271 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:23.789390 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb06bc922eb490a903c9be604af732b" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:23.790001 21692 raft_consensus.cc:3060] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.789983 21618 raft_consensus.cc:3055] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.790565 21618 raft_consensus.cc:740] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:23.791391 21618 consensus_queue.cc:260] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.792661 21618 raft_consensus.cc:3060] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.797235 21692 raft_consensus.cc:2468] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.798442 21508 leader_election.cc:304] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.799213 21744 raft_consensus.cc:2804] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.799736 21744 raft_consensus.cc:697] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:23.799810 21618 raft_consensus.cc:2468] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.800251 21763 raft_consensus.cc:993] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.800709 21763 raft_consensus.cc:1081] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:23.800668 21744 consensus_queue.cc:237] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.802507 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58010
I20260709 12:25:23.803129 21543 raft_consensus.cc:493] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.803516 21543 raft_consensus.cc:3060] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.809206 21543 raft_consensus.cc:515] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.808837 21440 catalog_manager.cc:5697] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 1 to 2, leader changed from 57726d42a95e411abf81fb000cc72e1c (127.20.98.66) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.811234 21543 leader_election.cc:290] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:23.812088 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:23.812260 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43af3035fd4d4ea590c5eafce26d3aae" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:23.812932 21618 raft_consensus.cc:3055] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.812958 21692 raft_consensus.cc:3060] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.813490 21618 raft_consensus.cc:740] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:23.814455 21618 consensus_queue.cc:260] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.815692 21618 raft_consensus.cc:3060] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.819424 21692 raft_consensus.cc:2468] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.820427 21508 leader_election.cc:304] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:23.821158 21744 raft_consensus.cc:2804] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.821620 21744 raft_consensus.cc:697] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:23.821766 21618 raft_consensus.cc:2468] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:23.822414 21744 consensus_queue.cc:237] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:23.828523 21440 catalog_manager.cc:5697] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 1 to 2, leader changed from 57726d42a95e411abf81fb000cc72e1c (127.20.98.66) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:23.952586 21692 raft_consensus.cc:1275] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.953933 21736 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:23.961470 21618 raft_consensus.cc:1275] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.963126 21744 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.114224 21618 raft_consensus.cc:1275] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.115711 21815 consensus_queue.cc:1048] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.123309 21543 raft_consensus.cc:1275] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.125988 21817 consensus_queue.cc:1048] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.198551 21618 raft_consensus.cc:1275] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.199945 21744 consensus_queue.cc:1048] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.207537 21692 raft_consensus.cc:1275] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.212116 21736 consensus_queue.cc:1048] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.220036 21691 raft_consensus.cc:1275] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.221272 21736 consensus_queue.cc:1048] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.230317 21618 raft_consensus.cc:1275] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.232137 21751 consensus_queue.cc:1048] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.280766 21618 raft_consensus.cc:1275] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.282109 21751 consensus_queue.cc:1048] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.291342 21691 raft_consensus.cc:1275] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.293036 21744 consensus_queue.cc:1048] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.294505 21543 raft_consensus.cc:1275] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Refusing update from remote peer 57726d42a95e411abf81fb000cc72e1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.296779 21818 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.308126 21691 raft_consensus.cc:1275] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Refusing update from remote peer 57726d42a95e411abf81fb000cc72e1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.309752 21763 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.503983 20873 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:25:26.504813 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.526949 21542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
mode: GRACEFUL
new_leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:33466
I20260709 12:25:26.527522 21542 raft_consensus.cc:606] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Received request to transfer leadership to TS f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:26.530094 21542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
mode: GRACEFUL
new_leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:33466
I20260709 12:25:26.530593 21542 raft_consensus.cc:606] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Received request to transfer leadership to TS f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:26.531666 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:26.532207 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:26.686543 21736 raft_consensus.cc:993] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: : Instructing follower f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:26.687001 21833 raft_consensus.cc:1081] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Signalling peer f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:26.688621 21692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:46952
I20260709 12:25:26.689219 21692 raft_consensus.cc:493] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.689556 21692 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.694504 21692 raft_consensus.cc:515] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:26.696339 21692 leader_election.cc:290] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 2 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:26.697206 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:26.697521 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:26.697839 21542 raft_consensus.cc:3055] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:26.698189 21618 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.698212 21542 raft_consensus.cc:740] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:26.699208 21542 consensus_queue.cc:260] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:26.700181 21542 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.704386 21618 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 2.
I20260709 12:25:26.705884 21658 leader_election.cc:304] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:26.706343 21542 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 2.
I20260709 12:25:26.706650 21829 raft_consensus.cc:2804] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:26.708302 21829 raft_consensus.cc:697] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 LEADER]: Becoming Leader. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:26.709138 21829 consensus_queue.cc:237] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:26.716439 21439 catalog_manager.cc:5697] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 reported cstate change: term changed from 1 to 2, leader changed from 946821541b724b5fb50b7b6039800cb1 (127.20.98.65) to f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.939837 21736 raft_consensus.cc:993] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1: : Instructing follower f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:26.940312 21833 raft_consensus.cc:1081] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Signalling peer f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:26.941730 21692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:46952
I20260709 12:25:26.942245 21692 raft_consensus.cc:493] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.942577 21692 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.947546 21692 raft_consensus.cc:515] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:26.949275 21692 leader_election.cc:290] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 3 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:26.950273 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:26.950404 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:26.950886 21542 raft_consensus.cc:3055] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:26.951064 21618 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.951293 21542 raft_consensus.cc:740] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:26.952142 21542 consensus_queue.cc:260] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:26.953094 21542 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.956140 21618 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 3.
I20260709 12:25:26.957279 21658 leader_election.cc:304] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:26.958091 21829 raft_consensus.cc:2804] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:26.958209 21542 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 3.
I20260709 12:25:26.958567 21829 raft_consensus.cc:697] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 LEADER]: Becoming Leader. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:26.959561 21829 consensus_queue.cc:237] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:26.970670 21439 catalog_manager.cc:5697] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 reported cstate change: term changed from 2 to 3, leader changed from 946821541b724b5fb50b7b6039800cb1 (127.20.98.65) to f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.178015 21618 raft_consensus.cc:1275] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.179632 21829 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.189201 21542 raft_consensus.cc:1275] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:27.193286 21834 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:27.420632 21542 raft_consensus.cc:1275] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.422299 21843 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:27.431648 21618 raft_consensus.cc:1275] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.433346 21829 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:27.533459 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:27.539660 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:27.540155 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:28.541318 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:28.547013 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:28.547459 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:29.548676 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:29.557060 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:29.557588 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:30.558723 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:30.564671 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:30.565187 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:31.566316 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:31.574120 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:31.574725 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:32.575747 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.581048 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:32.581445 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:33.582558 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.587917 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:33.588276 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.589474 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.594774 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:34.595242 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:35.596192 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.601625 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:35.602066 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:36.632340 20873 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:25:36.638926 21692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:46974
I20260709 12:25:36.639828 21692 raft_consensus.cc:606] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:36.650342 21692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:46974
I20260709 12:25:36.650794 21692 raft_consensus.cc:606] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:36.658154 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:40534
I20260709 12:25:36.658703 21618 raft_consensus.cc:606] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:36.663561 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:40534
I20260709 12:25:36.664110 21618 raft_consensus.cc:606] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:36.668995 21618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
mode: GRACEFUL
new_leader_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:40534
I20260709 12:25:36.669592 21618 raft_consensus.cc:606] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 LEADER]: Received request to transfer leadership to TS 946821541b724b5fb50b7b6039800cb1
I20260709 12:25:36.795879 21860 raft_consensus.cc:993] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:36.796427 21864 raft_consensus.cc:1081] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:36.798171 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58016
I20260709 12:25:36.798766 21543 raft_consensus.cc:493] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:36.799188 21543 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.805105 21543 raft_consensus.cc:515] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:36.807204 21543 leader_election.cc:290] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 3 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:36.808207 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:36.808736 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:36.809110 21618 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.809332 21692 raft_consensus.cc:3055] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:36.809662 21692 raft_consensus.cc:740] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:36.810701 21692 consensus_queue.cc:260] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:36.812162 21692 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.817067 21618 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 3.
I20260709 12:25:36.818594 21508 leader_election.cc:304] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:36.819459 21861 raft_consensus.cc:2804] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:36.819551 21692 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 3.
I20260709 12:25:36.820803 21861 raft_consensus.cc:697] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:36.821852 21861 consensus_queue.cc:237] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:36.829700 21439 catalog_manager.cc:5697] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 2 to 3, leader changed from f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:36.854012 21850 raft_consensus.cc:993] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:36.854560 21871 raft_consensus.cc:1081] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:36.856216 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58010
I20260709 12:25:36.856905 21543 raft_consensus.cc:493] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:36.857371 21543 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.863771 21543 raft_consensus.cc:515] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:36.865514 21543 leader_election.cc:290] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 3 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:36.866400 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:36.866670 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:36.867015 21618 raft_consensus.cc:3055] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:36.867208 21692 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.867394 21618 raft_consensus.cc:740] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:36.868288 21618 consensus_queue.cc:260] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:36.869400 21618 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:36.872629 21692 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 3.
I20260709 12:25:36.873858 21508 leader_election.cc:304] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:36.874429 21618 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 3.
I20260709 12:25:36.874527 21861 raft_consensus.cc:2804] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:36.875178 21861 raft_consensus.cc:697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:36.876096 21861 consensus_queue.cc:237] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:36.883446 21439 catalog_manager.cc:5697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 2 to 3, leader changed from 57726d42a95e411abf81fb000cc72e1c (127.20.98.66) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:36.986047 21860 raft_consensus.cc:993] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:36.986586 21864 raft_consensus.cc:1081] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:36.988293 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58016
I20260709 12:25:36.988988 21543 raft_consensus.cc:493] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:36.989362 21543 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:36.994360 21543 raft_consensus.cc:515] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:36.996105 21543 leader_election.cc:290] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 4 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:36.996884 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:36.997354 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968a947e2cf41af99df9ddbf05656e7" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:36.997514 21618 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:36.997897 21692 raft_consensus.cc:3055] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:36.998171 21692 raft_consensus.cc:740] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:36.998952 21692 consensus_queue.cc:260] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.000059 21692 raft_consensus.cc:3060] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:37.002966 21850 raft_consensus.cc:993] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:37.003463 21871 raft_consensus.cc:1081] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:37.003568 21618 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 4.
I20260709 12:25:37.004974 21508 leader_election.cc:304] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:37.005661 21861 raft_consensus.cc:2804] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:37.006039 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58010
I20260709 12:25:37.006181 21861 raft_consensus.cc:697] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 4 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:37.006600 21543 raft_consensus.cc:493] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.006927 21692 raft_consensus.cc:2468] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 4.
I20260709 12:25:37.007006 21543 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.007241 21861 consensus_queue.cc:237] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.012096 21543 raft_consensus.cc:515] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.014016 21543 leader_election.cc:290] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:37.014489 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:37.015043 21618 raft_consensus.cc:3055] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.015295 21618 raft_consensus.cc:740] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:37.015951 21618 consensus_queue.cc:260] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.015849 21439 catalog_manager.cc:5697] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 3 to 4, leader changed from f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 4 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.017138 21618 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.019158 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:37.019626 21692 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.023720 21618 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:37.025504 21692 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:37.027184 21508 leader_election.cc:304] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, 946821541b724b5fb50b7b6039800cb1; no voters: 
I20260709 12:25:37.029860 21861 raft_consensus.cc:2804] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.030661 21861 raft_consensus.cc:697] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:37.031620 21861 consensus_queue.cc:237] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.039578 21439 catalog_manager.cc:5697] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 1 to 2, leader changed from 57726d42a95e411abf81fb000cc72e1c (127.20.98.66) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.179932 21850 raft_consensus.cc:993] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c: : Instructing follower 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:37.180393 21871 raft_consensus.cc:1081] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Signalling peer 946821541b724b5fb50b7b6039800cb1 to start an election
I20260709 12:25:37.182088 21543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
 from {username='slave'} at 127.0.0.1:58010
I20260709 12:25:37.182595 21543 raft_consensus.cc:493] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.182917 21543 raft_consensus.cc:3060] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.187376 21543 raft_consensus.cc:515] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.189088 21543 leader_election.cc:290] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Requested vote from peers 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:37.189965 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:37.190120 21692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62e41a6129f48d595e2d38a4684196e" candidate_uuid: "946821541b724b5fb50b7b6039800cb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:37.190649 21618 raft_consensus.cc:3055] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.190724 21692 raft_consensus.cc:3060] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.190976 21618 raft_consensus.cc:740] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:37.191725 21618 consensus_queue.cc:260] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.192664 21618 raft_consensus.cc:3060] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.195511 21692 raft_consensus.cc:2468] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:37.196462 21508 leader_election.cc:304] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946821541b724b5fb50b7b6039800cb1, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:37.197147 21861 raft_consensus.cc:2804] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.197702 21861 raft_consensus.cc:697] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Leader. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:37.198056 21618 raft_consensus.cc:2468] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 946821541b724b5fb50b7b6039800cb1 in term 2.
I20260709 12:25:37.198735 21861 consensus_queue.cc:237] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:37.206956 21439 catalog_manager.cc:5697] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 reported cstate change: term changed from 1 to 2, leader changed from 57726d42a95e411abf81fb000cc72e1c (127.20.98.66) to 946821541b724b5fb50b7b6039800cb1 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "946821541b724b5fb50b7b6039800cb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.349624 21618 raft_consensus.cc:1275] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:37.350868 21861 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:37.362243 21692 raft_consensus.cc:1275] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:37.365450 21865 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:37.392985 21692 raft_consensus.cc:1275] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:37.394409 21861 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:37.405701 21618 raft_consensus.cc:1275] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:37.406960 21861 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:37.468999 21618 raft_consensus.cc:1275] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:37.470139 21861 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:37.479569 21691 raft_consensus.cc:1275] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:37.480782 21861 consensus_queue.cc:1048] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:37.590638 21618 raft_consensus.cc:1275] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.591818 21861 consensus_queue.cc:1048] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:37.602422 21691 raft_consensus.cc:1275] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.604135 21878 consensus_queue.cc:1048] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:37.682171 21691 raft_consensus.cc:1275] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.683641 21878 consensus_queue.cc:1048] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:37.692502 21618 raft_consensus.cc:1275] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Refusing update from remote peer 946821541b724b5fb50b7b6039800cb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:37.694190 21865 consensus_queue.cc:1048] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.708568 20873 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:25:39.709652 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.720468 21543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
mode: GRACEFUL
new_leader_uuid: "57726d42a95e411abf81fb000cc72e1c"
 from {username='slave'} at 127.0.0.1:33466
I20260709 12:25:39.721072 21543 raft_consensus.cc:606] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Received request to transfer leadership to TS 57726d42a95e411abf81fb000cc72e1c
I20260709 12:25:39.723944 21543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "537444430681420995e2cfd33a9f47c4"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
mode: GRACEFUL
new_leader_uuid: "57726d42a95e411abf81fb000cc72e1c"
 from {username='slave'} at 127.0.0.1:33466
I20260709 12:25:39.724398 21543 raft_consensus.cc:606] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Received request to transfer leadership to TS 57726d42a95e411abf81fb000cc72e1c
I20260709 12:25:39.726876 21543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
mode: GRACEFUL
new_leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:33466
I20260709 12:25:39.727557 21543 raft_consensus.cc:606] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Received request to transfer leadership to TS f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:39.730401 21542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852"
dest_uuid: "946821541b724b5fb50b7b6039800cb1"
mode: GRACEFUL
new_leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:33466
I20260709 12:25:39.730794 21542 raft_consensus.cc:606] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Received request to transfer leadership to TS f860d5e131ce49a29f9fc3f9b6259f26
I20260709 12:25:39.731696 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:39.732183 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:39.903854 21890 raft_consensus.cc:993] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: : Instructing follower f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:39.904361 21890 raft_consensus.cc:1081] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Signalling peer f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:39.905990 21691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:46952
I20260709 12:25:39.906540 21691 raft_consensus.cc:493] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.906876 21691 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.912729 21691 raft_consensus.cc:515] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:39.915390 21691 leader_election.cc:290] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 4 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:39.916496 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:39.916324 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95505d9ffe054622a0534881bb9e02b5" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:39.917218 21618 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.917311 21542 raft_consensus.cc:3055] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:39.917702 21542 raft_consensus.cc:740] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:39.918464 21542 consensus_queue.cc:260] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:39.919588 21542 raft_consensus.cc:3060] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.923899 21618 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 4.
I20260709 12:25:39.925115 21658 leader_election.cc:304] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:39.926044 21892 raft_consensus.cc:2804] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:39.926235 21542 raft_consensus.cc:2468] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 4.
I20260709 12:25:39.927177 21892 raft_consensus.cc:697] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 LEADER]: Becoming Leader. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:39.928452 21892 consensus_queue.cc:237] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:39.935720 21890 raft_consensus.cc:993] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: : Instructing follower 57726d42a95e411abf81fb000cc72e1c to start an election
I20260709 12:25:39.936293 21896 raft_consensus.cc:1081] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Signalling peer 57726d42a95e411abf81fb000cc72e1c to start an election
I20260709 12:25:39.936401 21440 catalog_manager.cc:5697] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 reported cstate change: term changed from 3 to 4, leader changed from 946821541b724b5fb50b7b6039800cb1 (127.20.98.65) to f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.938195 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
 from {username='slave'} at 127.0.0.1:40516
I20260709 12:25:39.938666 21618 raft_consensus.cc:493] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.938954 21618 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.944248 21618 raft_consensus.cc:515] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:39.947018 21618 leader_election.cc:290] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 4 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:39.947986 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:39.948105 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a8d82df2c1d4904aa2467bc6d4aaddd" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:39.948697 21691 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.948666 21542 raft_consensus.cc:3055] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:39.949218 21542 raft_consensus.cc:740] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:39.950093 21542 consensus_queue.cc:260] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:39.951395 21542 raft_consensus.cc:3060] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.954389 21691 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 4.
I20260709 12:25:39.955533 21584 leader_election.cc:304] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:39.956348 21871 raft_consensus.cc:2804] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:39.956423 21542 raft_consensus.cc:2468] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 4.
I20260709 12:25:39.957743 21871 raft_consensus.cc:697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 4 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:39.958729 21871 consensus_queue.cc:237] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:39.965381 21440 catalog_manager.cc:5697] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 3 to 4, leader changed from 946821541b724b5fb50b7b6039800cb1 (127.20.98.65) to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 4 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.003259 21890 raft_consensus.cc:993] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1: : Instructing follower 57726d42a95e411abf81fb000cc72e1c to start an election
I20260709 12:25:40.003750 21896 raft_consensus.cc:1081] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Signalling peer 57726d42a95e411abf81fb000cc72e1c to start an election
I20260709 12:25:40.005414 21618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "537444430681420995e2cfd33a9f47c4"
dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
 from {username='slave'} at 127.0.0.1:40516
I20260709 12:25:40.005846 21618 raft_consensus.cc:493] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.006070 21618 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.010599 21618 raft_consensus.cc:515] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:40.012076 21618 leader_election.cc:290] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 3 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67:38407)
I20260709 12:25:40.013032 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:40.013024 21691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "537444430681420995e2cfd33a9f47c4" candidate_uuid: "57726d42a95e411abf81fb000cc72e1c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
I20260709 12:25:40.013836 21542 raft_consensus.cc:3055] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:40.013875 21691 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.014117 21542 raft_consensus.cc:740] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:40.014878 21542 consensus_queue.cc:260] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:40.015707 21542 raft_consensus.cc:3060] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.018395 21691 raft_consensus.cc:2468] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 3.
I20260709 12:25:40.019310 21584 leader_election.cc:304] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:40.019896 21542 raft_consensus.cc:2468] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57726d42a95e411abf81fb000cc72e1c in term 3.
I20260709 12:25:40.019953 21871 raft_consensus.cc:2804] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:40.020503 21871 raft_consensus.cc:697] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 3 LEADER]: Becoming Leader. State: Replica: 57726d42a95e411abf81fb000cc72e1c, State: Running, Role: LEADER
I20260709 12:25:40.021454 21871 consensus_queue.cc:237] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:40.027729 21440 catalog_manager.cc:5697] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c reported cstate change: term changed from 2 to 3, leader changed from 946821541b724b5fb50b7b6039800cb1 (127.20.98.65) to 57726d42a95e411abf81fb000cc72e1c (127.20.98.66). New cstate: current_term: 3 leader_uuid: "57726d42a95e411abf81fb000cc72e1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.088049 21890 raft_consensus.cc:993] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1: : Instructing follower f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:40.088630 21896 raft_consensus.cc:1081] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Signalling peer f860d5e131ce49a29f9fc3f9b6259f26 to start an election
I20260709 12:25:40.090195 21691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852"
dest_uuid: "f860d5e131ce49a29f9fc3f9b6259f26"
 from {username='slave'} at 127.0.0.1:46952
I20260709 12:25:40.090598 21691 raft_consensus.cc:493] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.090843 21691 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.095427 21691 raft_consensus.cc:515] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:40.096871 21691 leader_election.cc:290] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 3 election: Requested vote from peers 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959), 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381)
I20260709 12:25:40.097796 21542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "946821541b724b5fb50b7b6039800cb1"
I20260709 12:25:40.097958 21618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edeaf462ee794edeb4a47453b5e25852" candidate_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "57726d42a95e411abf81fb000cc72e1c"
I20260709 12:25:40.098313 21542 raft_consensus.cc:3055] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:40.098521 21618 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.098661 21542 raft_consensus.cc:740] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 946821541b724b5fb50b7b6039800cb1, State: Running, Role: LEADER
I20260709 12:25:40.099427 21542 consensus_queue.cc:260] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:40.100301 21542 raft_consensus.cc:3060] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:40.103400 21618 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 3.
I20260709 12:25:40.104346 21658 leader_election.cc:304] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57726d42a95e411abf81fb000cc72e1c, f860d5e131ce49a29f9fc3f9b6259f26; no voters: 
I20260709 12:25:40.105257 21542 raft_consensus.cc:2468] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f860d5e131ce49a29f9fc3f9b6259f26 in term 3.
I20260709 12:25:40.105279 21892 raft_consensus.cc:2804] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:40.106021 21892 raft_consensus.cc:697] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 LEADER]: Becoming Leader. State: Replica: f860d5e131ce49a29f9fc3f9b6259f26, State: Running, Role: LEADER
I20260709 12:25:40.106889 21892 consensus_queue.cc:237] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } }
I20260709 12:25:40.114261 21440 catalog_manager.cc:5697] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 reported cstate change: term changed from 2 to 3, leader changed from 946821541b724b5fb50b7b6039800cb1 (127.20.98.65) to f860d5e131ce49a29f9fc3f9b6259f26 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.309811 21542 raft_consensus.cc:1275] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:40.311179 21892 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:40.321503 21618 raft_consensus.cc:1275] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:40.322927 21897 consensus_queue.cc:1048] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:40.443143 21542 raft_consensus.cc:1275] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Refusing update from remote peer 57726d42a95e411abf81fb000cc72e1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:40.444512 21871 consensus_queue.cc:1048] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:40.453992 21691 raft_consensus.cc:1275] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Refusing update from remote peer 57726d42a95e411abf81fb000cc72e1c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:40.458067 21871 consensus_queue.cc:1048] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:40.459306 21542 raft_consensus.cc:1275] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Refusing update from remote peer 57726d42a95e411abf81fb000cc72e1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:40.460881 21871 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:40.477555 21691 raft_consensus.cc:1275] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Refusing update from remote peer 57726d42a95e411abf81fb000cc72e1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:40.479489 21914 consensus_queue.cc:1048] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f860d5e131ce49a29f9fc3f9b6259f26" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 38407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:40.628306 21542 raft_consensus.cc:1275] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:40.629743 21892 consensus_queue.cc:1048] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "946821541b724b5fb50b7b6039800cb1" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:40.638868 21618 raft_consensus.cc:1275] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Refusing update from remote peer f860d5e131ce49a29f9fc3f9b6259f26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:40.641290 21919 consensus_queue.cc:1048] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57726d42a95e411abf81fb000cc72e1c" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 35381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:40.733377 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.739008 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:40.739566 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:41.740512 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.745918 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:41.746383 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:42.747298 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.753448 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.753824 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:43.754684 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.760195 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:43.760596 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.761806 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.767956 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:44.768455 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:45.769522 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.775817 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.776321 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.877032 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:46.887027 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:46.887880 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:47.837540 21564 debug-util.cc:398] Leaking SignalData structure 0x7b08001f32c0 after lost signal to thread 20876
W20260709 12:25:47.838476 21564 debug-util.cc:398] Leaking SignalData structure 0x7b080018cba0 after lost signal to thread 21475
W20260709 12:25:47.839413 21564 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5a20 after lost signal to thread 21568
W20260709 12:25:47.840221 21564 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4100 after lost signal to thread 21643
W20260709 12:25:47.841001 21564 debug-util.cc:398] Leaking SignalData structure 0x7b08001416c0 after lost signal to thread 21717
I20260709 12:25:47.888948 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:47.894858 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:47.895398 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:48.896703 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:48.902815 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:48.903340 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.939134 20873 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:25:49.939734 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
W20260709 12:25:49.980465 21582 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:25:49.990398 21582 consensus_peers.cc:597] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c -> Peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Couldn't send request to peer 946821541b724b5fb50b7b6039800cb1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.008920 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:50.010159 20873 tablet_replica.cc:333] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.011092 20873 raft_consensus.cc:2243] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.011864 20873 raft_consensus.cc:2272] T d2eba75ad05d42c99514b1432155e5ff P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.014459 20873 tablet_replica.cc:333] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.015049 20873 raft_consensus.cc:2243] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.015550 20873 raft_consensus.cc:2272] T 537444430681420995e2cfd33a9f47c4 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.017836 20873 tablet_replica.cc:333] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.018409 20873 raft_consensus.cc:2243] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.019448 20873 raft_consensus.cc:2272] T 43af3035fd4d4ea590c5eafce26d3aae P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.021485 20873 tablet_replica.cc:333] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.022019 20873 raft_consensus.cc:2243] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.022869 20873 raft_consensus.cc:2272] T a62e41a6129f48d595e2d38a4684196e P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.024858 20873 tablet_replica.cc:333] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.025458 20873 raft_consensus.cc:2243] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.025934 20873 raft_consensus.cc:2272] T 95505d9ffe054622a0534881bb9e02b5 P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.027987 20873 tablet_replica.cc:333] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.028584 20873 raft_consensus.cc:2243] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.029078 20873 raft_consensus.cc:2272] T edeaf462ee794edeb4a47453b5e25852 P 946821541b724b5fb50b7b6039800cb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.031407 20873 tablet_replica.cc:333] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.031991 20873 raft_consensus.cc:2243] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.032864 20873 raft_consensus.cc:2272] T e968a947e2cf41af99df9ddbf05656e7 P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.034924 20873 tablet_replica.cc:333] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.035503 20873 raft_consensus.cc:2243] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.035995 20873 raft_consensus.cc:2272] T aa7a2566c41348e3b4a8fd13c4a0b40b P 946821541b724b5fb50b7b6039800cb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.038107 20873 tablet_replica.cc:333] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.038590 20873 raft_consensus.cc:2243] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.039137 20873 raft_consensus.cc:2272] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 946821541b724b5fb50b7b6039800cb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.041452 20873 tablet_replica.cc:333] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1: stopping tablet replica
I20260709 12:25:50.041937 20873 raft_consensus.cc:2243] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.042768 20873 raft_consensus.cc:2272] T 9cb06bc922eb490a903c9be604af732b P 946821541b724b5fb50b7b6039800cb1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:50.048020 21582 consensus_peers.cc:597] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c -> Peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Couldn't send request to peer 946821541b724b5fb50b7b6039800cb1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:50.099785 21582 consensus_peers.cc:597] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c -> Peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Couldn't send request to peer 946821541b724b5fb50b7b6039800cb1. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:42959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:50.222316 21656 consensus_peers.cc:597] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 -> Peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Couldn't send request to peer 946821541b724b5fb50b7b6039800cb1. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:42959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.266582 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
I20260709 12:25:50.291008 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
W20260709 12:25:50.312424 21656 consensus_peers.cc:597] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 -> Peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Couldn't send request to peer 946821541b724b5fb50b7b6039800cb1. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:42959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.321374 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:50.322319 20873 tablet_replica.cc:333] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.323041 20873 raft_consensus.cc:2243] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.323619 20873 raft_consensus.cc:2272] T e968a947e2cf41af99df9ddbf05656e7 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.325842 20873 tablet_replica.cc:333] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.326435 20873 raft_consensus.cc:2243] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.326942 20873 raft_consensus.cc:2272] T edeaf462ee794edeb4a47453b5e25852 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.328922 20873 tablet_replica.cc:333] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.329533 20873 raft_consensus.cc:2243] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.330058 20873 raft_consensus.cc:2272] T 43af3035fd4d4ea590c5eafce26d3aae P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.332094 20873 tablet_replica.cc:333] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.332718 20873 raft_consensus.cc:2243] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.333686 20873 raft_consensus.cc:2272] T 2a8d82df2c1d4904aa2467bc6d4aaddd P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.335580 20873 tablet_replica.cc:333] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.336140 20873 raft_consensus.cc:2243] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.336997 20873 raft_consensus.cc:2272] T aa7a2566c41348e3b4a8fd13c4a0b40b P 57726d42a95e411abf81fb000cc72e1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.339159 20873 tablet_replica.cc:333] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.339741 20873 raft_consensus.cc:2243] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.340212 20873 raft_consensus.cc:2272] T 9cb06bc922eb490a903c9be604af732b P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.342553 20873 tablet_replica.cc:333] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.343070 20873 raft_consensus.cc:2243] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.343511 20873 raft_consensus.cc:2272] T d2eba75ad05d42c99514b1432155e5ff P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.345366 20873 tablet_replica.cc:333] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.345863 20873 raft_consensus.cc:2243] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.346303 20873 raft_consensus.cc:2272] T 95505d9ffe054622a0534881bb9e02b5 P 57726d42a95e411abf81fb000cc72e1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.348124 20873 tablet_replica.cc:333] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.348628 20873 raft_consensus.cc:2243] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.349105 20873 raft_consensus.cc:2272] T a62e41a6129f48d595e2d38a4684196e P 57726d42a95e411abf81fb000cc72e1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.351125 20873 tablet_replica.cc:333] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c: stopping tablet replica
I20260709 12:25:50.351621 20873 raft_consensus.cc:2243] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.352402 20873 raft_consensus.cc:2272] T 537444430681420995e2cfd33a9f47c4 P 57726d42a95e411abf81fb000cc72e1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.384442 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
I20260709 12:25:50.407840 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
W20260709 12:25:50.410463 21656 consensus_peers.cc:597] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 -> Peer 946821541b724b5fb50b7b6039800cb1 (127.20.98.65:42959): Couldn't send request to peer 946821541b724b5fb50b7b6039800cb1. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:42959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.432909 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:50.433842 20873 tablet_replica.cc:333] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.434687 20873 raft_consensus.cc:2243] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:25:50.434739 21658 consensus_peers.cc:597] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 -> Peer 57726d42a95e411abf81fb000cc72e1c (127.20.98.66:35381): Couldn't send request to peer 57726d42a95e411abf81fb000cc72e1c. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:35381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.435866 20873 raft_consensus.cc:2272] T edeaf462ee794edeb4a47453b5e25852 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.437925 20873 tablet_replica.cc:333] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.438422 20873 raft_consensus.cc:2243] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.438814 20873 raft_consensus.cc:2272] T e968a947e2cf41af99df9ddbf05656e7 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.440543 20873 tablet_replica.cc:333] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.441053 20873 raft_consensus.cc:2243] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.441546 20873 raft_consensus.cc:2272] T 537444430681420995e2cfd33a9f47c4 P f860d5e131ce49a29f9fc3f9b6259f26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.443490 20873 tablet_replica.cc:333] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.443919 20873 raft_consensus.cc:2243] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.444278 20873 raft_consensus.cc:2272] T 43af3035fd4d4ea590c5eafce26d3aae P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.446017 20873 tablet_replica.cc:333] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.446476 20873 raft_consensus.cc:2243] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.446846 20873 raft_consensus.cc:2272] T a62e41a6129f48d595e2d38a4684196e P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.448403 20873 tablet_replica.cc:333] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.448935 20873 raft_consensus.cc:2243] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.449863 20873 raft_consensus.cc:2272] T 95505d9ffe054622a0534881bb9e02b5 P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.451725 20873 tablet_replica.cc:333] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.452203 20873 raft_consensus.cc:2243] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.452942 20873 raft_consensus.cc:2272] T d2eba75ad05d42c99514b1432155e5ff P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.454746 20873 tablet_replica.cc:333] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.455312 20873 raft_consensus.cc:2243] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.455832 20873 raft_consensus.cc:2272] T 9cb06bc922eb490a903c9be604af732b P f860d5e131ce49a29f9fc3f9b6259f26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.457600 20873 tablet_replica.cc:333] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.458065 20873 raft_consensus.cc:2243] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.458461 20873 raft_consensus.cc:2272] T aa7a2566c41348e3b4a8fd13c4a0b40b P f860d5e131ce49a29f9fc3f9b6259f26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.460053 20873 tablet_replica.cc:333] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26: stopping tablet replica
I20260709 12:25:50.460551 20873 raft_consensus.cc:2243] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:50.461007 20873 raft_consensus.cc:2272] T 2a8d82df2c1d4904aa2467bc6d4aaddd P f860d5e131ce49a29f9fc3f9b6259f26 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.490389 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
I20260709 12:25:50.510854 20873 master.cc:562] Master@127.20.98.126:44931 shutting down...
I20260709 12:25:50.535250 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:50.535857 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:50.536207 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P a18182af9439490483ff2c99c1c83e07: stopping tablet replica
I20260709 12:25:50.555284 20873 master.cc:584] Master@127.20.98.126:44931 shutdown complete.
57726d42a95e411abf81fb000cc72e1c  4
946821541b724b5fb50b7b6039800cb1  5
f860d5e131ce49a29f9fc3f9b6259f26  1
57726d42a95e411abf81fb000cc72e1c  4
946821541b724b5fb50b7b6039800cb1  3
f860d5e131ce49a29f9fc3f9b6259f26  3
57726d42a95e411abf81fb000cc72e1c  1
946821541b724b5fb50b7b6039800cb1  8
f860d5e131ce49a29f9fc3f9b6259f26  1
57726d42a95e411abf81fb000cc72e1c  3
946821541b724b5fb50b7b6039800cb1  4
f860d5e131ce49a29f9fc3f9b6259f26  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29286 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:25:50.600936 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:34211
I20260709 12:25:50.602141 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:50.608548 21942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:50.608774 21945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:50.608680 21943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:50.610365 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:50.611421 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:50.611604 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:50.611717 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599950611706 us; error 0 us; skew 500 ppm
I20260709 12:25:50.612179 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:50.614935 20873 webserver.cc:533] Webserver started at http://127.20.98.126:40031/ using document root <none> and password file <none>
I20260709 12:25:50.615381 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:50.615554 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:50.615782 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:50.616940 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "59c532bc70954b39ab679e8a70103dee"
format_stamp: "Formatted at 2026-07-09 12:25:50 on dist-test-slave-g3x6"
I20260709 12:25:50.621544 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:25:50.624924 21950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:50.625909 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:50.626230 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "59c532bc70954b39ab679e8a70103dee"
format_stamp: "Formatted at 2026-07-09 12:25:50 on dist-test-slave-g3x6"
I20260709 12:25:50.626600 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:50.649976 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:50.651381 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:50.693326 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:34211
I20260709 12:25:50.693504 22002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:34211 every 8 connection(s)
I20260709 12:25:50.697768 22003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:50.708581 22003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Bootstrap starting.
I20260709 12:25:50.713901 22003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:50.718503 22003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: No bootstrap required, opened a new log
I20260709 12:25:50.720729 22003 raft_consensus.cc:359] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c532bc70954b39ab679e8a70103dee" member_type: VOTER }
I20260709 12:25:50.721220 22003 raft_consensus.cc:385] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:50.721472 22003 raft_consensus.cc:740] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c532bc70954b39ab679e8a70103dee, State: Initialized, Role: FOLLOWER
I20260709 12:25:50.722071 22003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c532bc70954b39ab679e8a70103dee" member_type: VOTER }
I20260709 12:25:50.722556 22003 raft_consensus.cc:399] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:50.722782 22003 raft_consensus.cc:493] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:50.723066 22003 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:50.727494 22003 raft_consensus.cc:515] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c532bc70954b39ab679e8a70103dee" member_type: VOTER }
I20260709 12:25:50.728072 22003 leader_election.cc:304] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c532bc70954b39ab679e8a70103dee; no voters: 
I20260709 12:25:50.729570 22003 leader_election.cc:290] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:50.729921 22006 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:50.731426 22006 raft_consensus.cc:697] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 1 LEADER]: Becoming Leader. State: Replica: 59c532bc70954b39ab679e8a70103dee, State: Running, Role: LEADER
I20260709 12:25:50.732172 22006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c532bc70954b39ab679e8a70103dee" member_type: VOTER }
I20260709 12:25:50.732584 22003 sys_catalog.cc:565] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:50.738474 22008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c532bc70954b39ab679e8a70103dee. Latest consensus state: current_term: 1 leader_uuid: "59c532bc70954b39ab679e8a70103dee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c532bc70954b39ab679e8a70103dee" member_type: VOTER } }
I20260709 12:25:50.738497 22007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59c532bc70954b39ab679e8a70103dee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c532bc70954b39ab679e8a70103dee" member_type: VOTER } }
I20260709 12:25:50.739231 22008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:50.739742 22007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:50.741518 22015 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:50.747253 22015 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:50.751025 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:50.757143 22015 catalog_manager.cc:1383] Generated new cluster ID: b4c0f5c0765e48aab5826c258821c55b
I20260709 12:25:50.757490 22015 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:50.782173 22015 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:50.783509 22015 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:50.796603 22015 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Generated new TSK 0
I20260709 12:25:50.797266 22015 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:50.818442 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:50.824846 22025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:50.826363 22026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:50.828708 22028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:50.829926 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:50.831130 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:50.831387 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:50.831532 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599950831520 us; error 0 us; skew 500 ppm
I20260709 12:25:50.832084 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:50.834749 20873 webserver.cc:533] Webserver started at http://127.20.98.65:44233/ using document root <none> and password file <none>
I20260709 12:25:50.835219 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:50.835376 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:50.835590 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:50.836643 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "c9a50b2f586448c49281a6618c40a1f7"
format_stamp: "Formatted at 2026-07-09 12:25:50 on dist-test-slave-g3x6"
I20260709 12:25:50.841351 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:50.845098 22033 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:50.846026 20873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:50.846361 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "c9a50b2f586448c49281a6618c40a1f7"
format_stamp: "Formatted at 2026-07-09 12:25:50 on dist-test-slave-g3x6"
I20260709 12:25:50.846678 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:50.871833 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:50.873232 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:50.874791 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:50.877130 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:50.877374 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:50.877615 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:50.877806 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:50.919548 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:40323
I20260709 12:25:50.919646 22095 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:40323 every 8 connection(s)
I20260709 12:25:50.924734 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:50.931521 22100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:50.932431 22101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:50.935808 22103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:50.937366 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:50.938536 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:50.938771 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:50.938963 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599950938945 us; error 0 us; skew 500 ppm
I20260709 12:25:50.939664 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:50.940837 22096 heartbeater.cc:344] Connected to a master server at 127.20.98.126:34211
I20260709 12:25:50.941295 22096 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:50.942080 22096 heartbeater.cc:507] Master 127.20.98.126:34211 requested a full tablet report, sending...
I20260709 12:25:50.942560 20873 webserver.cc:533] Webserver started at http://127.20.98.66:36265/ using document root <none> and password file <none>
I20260709 12:25:50.943209 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:50.943492 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:50.943775 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:50.944509 21967 ts_manager.cc:194] Registered new tserver with Master: c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:25:50.945411 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "85f0d4cf04de40aa9e25849fb2380466"
format_stamp: "Formatted at 2026-07-09 12:25:50 on dist-test-slave-g3x6"
I20260709 12:25:50.947027 21967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48096
I20260709 12:25:50.950857 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:50.954361 22108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:50.955155 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:50.955471 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "85f0d4cf04de40aa9e25849fb2380466"
format_stamp: "Formatted at 2026-07-09 12:25:50 on dist-test-slave-g3x6"
I20260709 12:25:50.955776 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:50.964903 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:50.966207 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:50.967695 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:50.969972 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:50.970224 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:50.970492 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:50.970650 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:51.011682 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:42771
I20260709 12:25:51.011808 22170 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:42771 every 8 connection(s)
I20260709 12:25:51.016601 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:51.024063 22174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:51.025346 22175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:51.029214 22177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:51.029735 20873 server_base.cc:1061] running on GCE node
I20260709 12:25:51.030758 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:51.030815 22171 heartbeater.cc:344] Connected to a master server at 127.20.98.126:34211
W20260709 12:25:51.031101 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:51.031240 22171 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:51.031322 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599951031302 us; error 0 us; skew 500 ppm
I20260709 12:25:51.032141 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:51.032188 22171 heartbeater.cc:507] Master 127.20.98.126:34211 requested a full tablet report, sending...
I20260709 12:25:51.034795 21967 ts_manager.cc:194] Registered new tserver with Master: 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:51.035260 20873 webserver.cc:533] Webserver started at http://127.20.98.67:45089/ using document root <none> and password file <none>
I20260709 12:25:51.035889 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:51.036132 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:51.036459 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:51.036682 21967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48106
I20260709 12:25:51.038094 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "be238c1de63840f9bb041e2f9ba58d2b"
format_stamp: "Formatted at 2026-07-09 12:25:51 on dist-test-slave-g3x6"
I20260709 12:25:51.042636 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:25:51.046419 22182 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:51.047293 20873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:51.047570 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "be238c1de63840f9bb041e2f9ba58d2b"
format_stamp: "Formatted at 2026-07-09 12:25:51 on dist-test-slave-g3x6"
I20260709 12:25:51.047892 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:51.063854 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:51.065050 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:51.066612 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:51.068871 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:51.069051 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:51.069423 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:51.069592 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:51.109649 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:39245
I20260709 12:25:51.109731 22244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:39245 every 8 connection(s)
I20260709 12:25:51.123369 22245 heartbeater.cc:344] Connected to a master server at 127.20.98.126:34211
I20260709 12:25:51.123791 22245 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:51.124565 22245 heartbeater.cc:507] Master 127.20.98.126:34211 requested a full tablet report, sending...
I20260709 12:25:51.126478 21967 ts_manager.cc:194] Registered new tserver with Master: be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:51.127331 20873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014515954s
I20260709 12:25:51.128103 21967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48108
I20260709 12:25:51.154999 21967 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48116:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:51.161243 21967 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:51.366132 22136 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f575e2f52433abc7aeff041ddb880 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:51.367139 22135 tablet_service.cc:1511] Processing CreateTablet for tablet f8bfdf52fab442f6ab7ed33f99c33cf5 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:51.367725 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f575e2f52433abc7aeff041ddb880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.368567 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bfdf52fab442f6ab7ed33f99c33cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.369716 22210 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f575e2f52433abc7aeff041ddb880 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:51.372221 22209 tablet_service.cc:1511] Processing CreateTablet for tablet f8bfdf52fab442f6ab7ed33f99c33cf5 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:51.374931 22134 tablet_service.cc:1511] Processing CreateTablet for tablet 2610abde2b26405b8b88ae11fb975d64 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:51.376319 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2610abde2b26405b8b88ae11fb975d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.378347 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 2610abde2b26405b8b88ae11fb975d64 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:51.382836 22060 tablet_service.cc:1511] Processing CreateTablet for tablet f8bfdf52fab442f6ab7ed33f99c33cf5 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:51.383299 22133 tablet_service.cc:1511] Processing CreateTablet for tablet 51286e1e6cac4310b4960b85e10b91cd (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:51.384227 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bfdf52fab442f6ab7ed33f99c33cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.384665 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51286e1e6cac4310b4960b85e10b91cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.386376 22206 tablet_service.cc:1511] Processing CreateTablet for tablet f77cd08fd9014998aebc07bff003d1a8 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:51.386821 22059 tablet_service.cc:1511] Processing CreateTablet for tablet 2610abde2b26405b8b88ae11fb975d64 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:51.388774 22132 tablet_service.cc:1511] Processing CreateTablet for tablet f77cd08fd9014998aebc07bff003d1a8 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:51.390182 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77cd08fd9014998aebc07bff003d1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.389971 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 51286e1e6cac4310b4960b85e10b91cd (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:51.393191 22057 tablet_service.cc:1511] Processing CreateTablet for tablet f77cd08fd9014998aebc07bff003d1a8 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:51.394201 22205 tablet_service.cc:1511] Processing CreateTablet for tablet 285ef7a597884d3a8a0ad5e993a8eb93 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:51.380647 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 51286e1e6cac4310b4960b85e10b91cd (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:51.396215 22056 tablet_service.cc:1511] Processing CreateTablet for tablet 285ef7a597884d3a8a0ad5e993a8eb93 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:51.398469 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 821557b36d67456997b35682a066dbc9 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:51.399740 22131 tablet_service.cc:1511] Processing CreateTablet for tablet 285ef7a597884d3a8a0ad5e993a8eb93 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:51.402164 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f575e2f52433abc7aeff041ddb880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.401885 22061 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f575e2f52433abc7aeff041ddb880 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:51.403867 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bfdf52fab442f6ab7ed33f99c33cf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.405686 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77cd08fd9014998aebc07bff003d1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.406531 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 285ef7a597884d3a8a0ad5e993a8eb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.407029 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2610abde2b26405b8b88ae11fb975d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.408192 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821557b36d67456997b35682a066dbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.408620 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51286e1e6cac4310b4960b85e10b91cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.409716 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 285ef7a597884d3a8a0ad5e993a8eb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.409821 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51286e1e6cac4310b4960b85e10b91cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.411419 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2610abde2b26405b8b88ae11fb975d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.411800 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 285ef7a597884d3a8a0ad5e993a8eb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.412971 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f575e2f52433abc7aeff041ddb880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.414539 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77cd08fd9014998aebc07bff003d1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.435185 22204 tablet_service.cc:1511] Processing CreateTablet for tablet 821557b36d67456997b35682a066dbc9 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:51.436743 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821557b36d67456997b35682a066dbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.446899 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 821557b36d67456997b35682a066dbc9 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:51.448326 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821557b36d67456997b35682a066dbc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.452685 22054 tablet_service.cc:1511] Processing CreateTablet for tablet f7b7dc5b82134cd492412751a2d63d9f (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:51.454674 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b7dc5b82134cd492412751a2d63d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.456658 22203 tablet_service.cc:1511] Processing CreateTablet for tablet f7b7dc5b82134cd492412751a2d63d9f (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:51.458226 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b7dc5b82134cd492412751a2d63d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.468739 22053 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5dc4546d94416ab0e98aa60a0074b9 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:51.470749 22053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5dc4546d94416ab0e98aa60a0074b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.474740 22202 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5dc4546d94416ab0e98aa60a0074b9 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:51.476238 22202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5dc4546d94416ab0e98aa60a0074b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.495585 22052 tablet_service.cc:1511] Processing CreateTablet for tablet 8800ea1c1a5648149433c4b68674d692 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:51.497200 22052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8800ea1c1a5648149433c4b68674d692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.499039 22129 tablet_service.cc:1511] Processing CreateTablet for tablet f7b7dc5b82134cd492412751a2d63d9f (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:51.500717 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b7dc5b82134cd492412751a2d63d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.505666 22128 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5dc4546d94416ab0e98aa60a0074b9 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:51.507257 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5dc4546d94416ab0e98aa60a0074b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.540446 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 8800ea1c1a5648149433c4b68674d692 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:51.552217 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8800ea1c1a5648149433c4b68674d692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.566591 22261 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:51.566990 22057 tablet_service.cc:1511] Processing CreateTablet for tablet a029fe9d29df4ca38adc92d96e055bbd (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:51.568346 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a029fe9d29df4ca38adc92d96e055bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.579154 22261 tablet_bootstrap.cc:654] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.582253 22130 tablet_service.cc:1511] Processing CreateTablet for tablet a029fe9d29df4ca38adc92d96e055bbd (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:51.586140 22208 tablet_service.cc:1511] Processing CreateTablet for tablet a029fe9d29df4ca38adc92d96e055bbd (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:51.587740 22053 tablet_service.cc:1511] Processing CreateTablet for tablet c609d086e32e4033b7376f770a2790a6 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:51.589268 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a029fe9d29df4ca38adc92d96e055bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.589251 22135 tablet_service.cc:1511] Processing CreateTablet for tablet c609d086e32e4033b7376f770a2790a6 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:51.590061 22053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c609d086e32e4033b7376f770a2790a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.590598 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c609d086e32e4033b7376f770a2790a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.589272 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a029fe9d29df4ca38adc92d96e055bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.599503 22207 tablet_service.cc:1511] Processing CreateTablet for tablet 8800ea1c1a5648149433c4b68674d692 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:51.600988 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8800ea1c1a5648149433c4b68674d692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.605872 22262 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:51.614534 22056 tablet_service.cc:1511] Processing CreateTablet for tablet a81d7a413cca41acba7ba36bb13ce654 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:51.616854 22260 tablet_bootstrap.cc:492] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:51.625345 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81d7a413cca41acba7ba36bb13ce654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.625108 22129 tablet_service.cc:1511] Processing CreateTablet for tablet a81d7a413cca41acba7ba36bb13ce654 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:51.629204 22262 tablet_bootstrap.cc:654] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.630695 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81d7a413cca41acba7ba36bb13ce654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.635702 22209 tablet_service.cc:1511] Processing CreateTablet for tablet a81d7a413cca41acba7ba36bb13ce654 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:51.619072 22203 tablet_service.cc:1511] Processing CreateTablet for tablet c609d086e32e4033b7376f770a2790a6 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:51.637053 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81d7a413cca41acba7ba36bb13ce654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.648525 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c609d086e32e4033b7376f770a2790a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.648278 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 2100de7ab7b84cf39a4370858e9b6927 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:51.649636 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2100de7ab7b84cf39a4370858e9b6927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.652374 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 2100de7ab7b84cf39a4370858e9b6927 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:51.653687 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2100de7ab7b84cf39a4370858e9b6927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.654664 22260 tablet_bootstrap.cc:654] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.659578 22128 tablet_service.cc:1511] Processing CreateTablet for tablet e3caebc0658346798308160a170ffc71 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:51.660851 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3caebc0658346798308160a170ffc71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.666144 22053 tablet_service.cc:1511] Processing CreateTablet for tablet 2100de7ab7b84cf39a4370858e9b6927 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:51.666219 22057 tablet_service.cc:1511] Processing CreateTablet for tablet e3caebc0658346798308160a170ffc71 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:51.672446 22053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2100de7ab7b84cf39a4370858e9b6927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.674497 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3caebc0658346798308160a170ffc71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.682569 22207 tablet_service.cc:1511] Processing CreateTablet for tablet e3caebc0658346798308160a170ffc71 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:51.683698 22260 tablet_bootstrap.cc:492] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:51.684237 22260 ts_tablet_manager.cc:1403] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.005s
I20260709 12:25:51.689698 22261 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:51.690237 22261 ts_tablet_manager.cc:1403] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.124s	user 0.005s	sys 0.015s
I20260709 12:25:51.687863 22052 tablet_service.cc:1511] Processing CreateTablet for tablet 2b5c193cc2e540dbbc926df1219ef72b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:51.690935 22260 raft_consensus.cc:359] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.691941 22260 raft_consensus.cc:385] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.692176 22052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c193cc2e540dbbc926df1219ef72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.692276 22260 raft_consensus.cc:740] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.693837 22261 raft_consensus.cc:359] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.694625 22261 raft_consensus.cc:385] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.694928 22261 raft_consensus.cc:740] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.695741 22261 consensus_queue.cc:260] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.684239 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3caebc0658346798308160a170ffc71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.699744 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 2b5c193cc2e540dbbc926df1219ef72b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:51.701123 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c193cc2e540dbbc926df1219ef72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.704723 22260 consensus_queue.cc:260] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.708505 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 2b5c193cc2e540dbbc926df1219ef72b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:51.709970 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c193cc2e540dbbc926df1219ef72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.716341 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 28acb7e5630c4b1da2fa7d2abca24a62 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:51.721338 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28acb7e5630c4b1da2fa7d2abca24a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.720602 22131 tablet_service.cc:1511] Processing CreateTablet for tablet 28acb7e5630c4b1da2fa7d2abca24a62 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:51.725248 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28acb7e5630c4b1da2fa7d2abca24a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.740190 22171 heartbeater.cc:499] Master 127.20.98.126:34211 was elected leader, sending a full tablet report...
I20260709 12:25:51.741868 22060 tablet_service.cc:1511] Processing CreateTablet for tablet d57c1d6eaa044fe58248b797147f51d0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:51.743254 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57c1d6eaa044fe58248b797147f51d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:51.746515 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:51.746980 22130 tablet_service.cc:1511] Processing CreateTablet for tablet d57c1d6eaa044fe58248b797147f51d0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:51.748323 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57c1d6eaa044fe58248b797147f51d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.748780 22260 ts_tablet_manager.cc:1434] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.009s
I20260709 12:25:51.763145 22262 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:51.762900 22260 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:51.764843 22262 ts_tablet_manager.cc:1403] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.159s	user 0.009s	sys 0.009s
I20260709 12:25:51.768970 22206 tablet_service.cc:1511] Processing CreateTablet for tablet d57c1d6eaa044fe58248b797147f51d0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:51.770305 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57c1d6eaa044fe58248b797147f51d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.780784 22245 heartbeater.cc:499] Master 127.20.98.126:34211 was elected leader, sending a full tablet report...
I20260709 12:25:51.783815 22261 ts_tablet_manager.cc:1434] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.015s
I20260709 12:25:51.785001 22261 tablet_bootstrap.cc:492] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:51.770269 22262 raft_consensus.cc:359] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.787010 22262 raft_consensus.cc:385] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:51.792291 22262 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:51.793306 22262 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.796859 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 28acb7e5630c4b1da2fa7d2abca24a62 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:51.797832 22267 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.798252 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28acb7e5630c4b1da2fa7d2abca24a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.798337 22267 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.806962 22266 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.807483 22267 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:51.807642 22266 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:51.808216 22129 tablet_service.cc:1511] Processing CreateTablet for tablet c66fbf1879e84a19b490058938a4bc34 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:51.815682 22266 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:51.816309 22207 tablet_service.cc:1511] Processing CreateTablet for tablet c66fbf1879e84a19b490058938a4bc34 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:51.824064 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66fbf1879e84a19b490058938a4bc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.838673 22262 ts_tablet_manager.cc:1434] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.073s	user 0.014s	sys 0.015s
I20260709 12:25:51.839025 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 99368f219dd84b6994a569b62a8579d0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:51.839545 22096 heartbeater.cc:499] Master 127.20.98.126:34211 was elected leader, sending a full tablet report...
I20260709 12:25:51.839875 22262 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:51.842098 22128 tablet_service.cc:1511] Processing CreateTablet for tablet 99368f219dd84b6994a569b62a8579d0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:51.843099 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66fbf1879e84a19b490058938a4bc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.843502 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99368f219dd84b6994a569b62a8579d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.847028 22056 tablet_service.cc:1511] Processing CreateTablet for tablet c66fbf1879e84a19b490058938a4bc34 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:51.848863 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66fbf1879e84a19b490058938a4bc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.849821 22260 tablet_bootstrap.cc:654] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.864037 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99368f219dd84b6994a569b62a8579d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.882050 22203 tablet_service.cc:1511] Processing CreateTablet for tablet 99368f219dd84b6994a569b62a8579d0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:51.882350 22130 tablet_service.cc:1511] Processing CreateTablet for tablet ec2973e4920541d9ba2cb2c911dbab09 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:51.883383 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99368f219dd84b6994a569b62a8579d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.886906 22135 tablet_service.cc:1511] Processing CreateTablet for tablet 2bed3f011bde43719e0a7ce10da0401a (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:51.883479 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2973e4920541d9ba2cb2c911dbab09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.888926 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 299ade5c6c9e48928f5602c43824af92 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:51.890246 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299ade5c6c9e48928f5602c43824af92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.890168 22052 tablet_service.cc:1511] Processing CreateTablet for tablet 299ade5c6c9e48928f5602c43824af92 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:51.891539 22052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299ade5c6c9e48928f5602c43824af92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.894491 22057 tablet_service.cc:1511] Processing CreateTablet for tablet 2bed3f011bde43719e0a7ce10da0401a (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:51.895867 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bed3f011bde43719e0a7ce10da0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.897531 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bed3f011bde43719e0a7ce10da0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.899758 22262 tablet_bootstrap.cc:654] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.902573 22061 tablet_service.cc:1511] Processing CreateTablet for tablet 2012f4a3900141a5b86022143147dd81 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:51.923936 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2012f4a3900141a5b86022143147dd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.924885 22053 tablet_service.cc:1511] Processing CreateTablet for tablet ec2973e4920541d9ba2cb2c911dbab09 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:51.925253 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 45d56621ac1d470dac3f492c5c1b5256 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:51.905831 22136 tablet_service.cc:1511] Processing CreateTablet for tablet 2012f4a3900141a5b86022143147dd81 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:51.926749 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2012f4a3900141a5b86022143147dd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.929723 22127 tablet_service.cc:1511] Processing CreateTablet for tablet 45d56621ac1d470dac3f492c5c1b5256 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:51.931113 22127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d56621ac1d470dac3f492c5c1b5256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.908458 22058 tablet_service.cc:1511] Processing CreateTablet for tablet c387a77990f741e2ae187b3f92c6d472 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:51.933509 22054 tablet_service.cc:1511] Processing CreateTablet for tablet 3b958cd7e995415696872e37e9c3062b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:51.934859 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d56621ac1d470dac3f492c5c1b5256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.935611 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b958cd7e995415696872e37e9c3062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.936267 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c387a77990f741e2ae187b3f92c6d472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.945546 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 40fdb108e6f14522a9ef82da47fc0b74 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:51.946928 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fdb108e6f14522a9ef82da47fc0b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.961527 22053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2973e4920541d9ba2cb2c911dbab09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.962392 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:25:51.964429 22185 leader_election.cc:343] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:51.966761 22131 tablet_service.cc:1511] Processing CreateTablet for tablet 3b958cd7e995415696872e37e9c3062b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:51.968147 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b958cd7e995415696872e37e9c3062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.910867 22261 tablet_bootstrap.cc:654] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:51.910594 22134 tablet_service.cc:1511] Processing CreateTablet for tablet c387a77990f741e2ae187b3f92c6d472 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:51.969494 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c387a77990f741e2ae187b3f92c6d472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.915746 22059 tablet_service.cc:1511] Processing CreateTablet for tablet cd094bd2058d4b6d9810ece12a93d849 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:51.973943 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd094bd2058d4b6d9810ece12a93d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.986531 22128 tablet_service.cc:1511] Processing CreateTablet for tablet 40fdb108e6f14522a9ef82da47fc0b74 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:51.988032 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fdb108e6f14522a9ef82da47fc0b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.917970 22260 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:51.919407 22133 tablet_service.cc:1511] Processing CreateTablet for tablet cd094bd2058d4b6d9810ece12a93d849 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:51.994146 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd094bd2058d4b6d9810ece12a93d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.992445 22055 tablet_service.cc:1511] Processing CreateTablet for tablet ed9f4c2d15b547e18ff1bfcfd082ae32 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:51.997617 22260 ts_tablet_manager.cc:1403] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.236s	user 0.009s	sys 0.006s
I20260709 12:25:51.998051 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9f4c2d15b547e18ff1bfcfd082ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.003326 22260 raft_consensus.cc:359] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.009330 22260 raft_consensus.cc:385] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.009792 22260 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.010597 22260 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.013674 22135 tablet_service.cc:1511] Processing CreateTablet for tablet ed9f4c2d15b547e18ff1bfcfd082ae32 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:52.076941 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9f4c2d15b547e18ff1bfcfd082ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.079175 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:52.079658 22131 tablet_service.cc:1511] Processing CreateTablet for tablet d935d1f5ca454cf6b73d0e33d7a7f51a (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:52.026419 22053 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4304a0cf75473e8fd1d5791213f0a3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:52.081024 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d935d1f5ca454cf6b73d0e33d7a7f51a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:52.080967 22184 leader_election.cc:343] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.081535 22184 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:52.081940 22053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4304a0cf75473e8fd1d5791213f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.082726 22266 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.041354 22262 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:52.084240 22262 ts_tablet_manager.cc:1403] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.245s	user 0.005s	sys 0.008s
I20260709 12:25:52.043509 22059 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3d458721d04ad184247f1a1926d3fa (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:52.049718 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:52.085961 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3d458721d04ad184247f1a1926d3fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:52.086606 22111 leader_election.cc:343] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.051617 22054 tablet_service.cc:1511] Processing CreateTablet for tablet 31f3273ca74242e9b116e3e87078ccef (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:52.087873 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f3273ca74242e9b116e3e87078ccef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.053735 22208 tablet_service.cc:1511] Processing CreateTablet for tablet ec2973e4920541d9ba2cb2c911dbab09 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:52.054180 22057 tablet_service.cc:1511] Processing CreateTablet for tablet bf83ee90e33b4083aebda67b32ca1149 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:52.055891 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 2bed3f011bde43719e0a7ce10da0401a (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:52.091558 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf83ee90e33b4083aebda67b32ca1149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.056044 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 299ade5c6c9e48928f5602c43824af92 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:52.091452 22262 raft_consensus.cc:359] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.059439 22210 tablet_service.cc:1511] Processing CreateTablet for tablet 2012f4a3900141a5b86022143147dd81 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:52.091492 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2973e4920541d9ba2cb2c911dbab09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.093279 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2012f4a3900141a5b86022143147dd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.097517 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bed3f011bde43719e0a7ce10da0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.099165 22131 tablet_service.cc:1511] Processing CreateTablet for tablet bf83ee90e33b4083aebda67b32ca1149 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:52.100497 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf83ee90e33b4083aebda67b32ca1149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.101500 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299ade5c6c9e48928f5602c43824af92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.059782 22205 tablet_service.cc:1511] Processing CreateTablet for tablet cd094bd2058d4b6d9810ece12a93d849 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:52.059438 22202 tablet_service.cc:1511] Processing CreateTablet for tablet c387a77990f741e2ae187b3f92c6d472 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:52.060433 22052 tablet_service.cc:1511] Processing CreateTablet for tablet d935d1f5ca454cf6b73d0e33d7a7f51a (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:52.106163 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd094bd2058d4b6d9810ece12a93d849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.106262 22052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d935d1f5ca454cf6b73d0e33d7a7f51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.109719 22202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c387a77990f741e2ae187b3f92c6d472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.113639 22260 ts_tablet_manager.cc:1434] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.116s	user 0.004s	sys 0.002s
I20260709 12:25:52.062088 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3e126e4f1f4d82991ffddf4599b103 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:52.117987 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3e126e4f1f4d82991ffddf4599b103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.062341 22204 tablet_service.cc:1511] Processing CreateTablet for tablet 45d56621ac1d470dac3f492c5c1b5256 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:52.121994 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d56621ac1d470dac3f492c5c1b5256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.124155 22057 tablet_service.cc:1511] Processing CreateTablet for tablet f2b9f971fd394d129cd62de001799b21 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:52.064450 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 62526c368b43448e83c05dfd4e5aeaf3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:52.129276 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b9f971fd394d129cd62de001799b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.129997 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62526c368b43448e83c05dfd4e5aeaf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.133633 22267 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.134161 22267 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.136310 22261 tablet_bootstrap.cc:492] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:52.069566 22058 tablet_service.cc:1511] Processing CreateTablet for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:52.144380 22261 ts_tablet_manager.cc:1403] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.360s	user 0.009s	sys 0.003s
I20260709 12:25:52.144824 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.147876 22261 raft_consensus.cc:359] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.025946 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4304a0cf75473e8fd1d5791213f0a3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:52.148829 22261 raft_consensus.cc:385] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.149348 22261 raft_consensus.cc:740] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.149597 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4304a0cf75473e8fd1d5791213f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.150324 22261 consensus_queue.cc:260] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.152539 22056 tablet_service.cc:1511] Processing CreateTablet for tablet 33d4294bcbec49ad88c8ce7c879b596d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:52.153858 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d4294bcbec49ad88c8ce7c879b596d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.092346 22262 raft_consensus.cc:385] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.157330 22262 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.158300 22262 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.063894 22201 tablet_service.cc:1511] Processing CreateTablet for tablet 3b958cd7e995415696872e37e9c3062b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:52.136250 22267 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.068315 22203 tablet_service.cc:1511] Processing CreateTablet for tablet d935d1f5ca454cf6b73d0e33d7a7f51a (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:52.138041 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:52.159809 22071 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:52.160074 22201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b958cd7e995415696872e37e9c3062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.162349 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:52.163245 22267 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.163645 22267 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.163987 22267 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.165917 22261 ts_tablet_manager.cc:1434] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:25:52.169926 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d935d1f5ca454cf6b73d0e33d7a7f51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.170202 22262 ts_tablet_manager.cc:1434] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.002s
I20260709 12:25:52.180740 22262 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:52.156836 22128 tablet_service.cc:1511] Processing CreateTablet for tablet 31f3273ca74242e9b116e3e87078ccef (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:52.183568 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f3273ca74242e9b116e3e87078ccef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.180740 22261 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:52.186447 22260 tablet_bootstrap.cc:492] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:52.172823 22267 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.210347 22057 tablet_service.cc:1511] Processing CreateTablet for tablet 97b8db04a690435f8c84aba1b0f5ec2b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:52.217236 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b8db04a690435f8c84aba1b0f5ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.218325 22262 tablet_bootstrap.cc:654] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.219937 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 40fdb108e6f14522a9ef82da47fc0b74 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:52.225090 22210 tablet_service.cc:1511] Processing CreateTablet for tablet ed9f4c2d15b547e18ff1bfcfd082ae32 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:52.233239 22261 tablet_bootstrap.cc:654] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.235280 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4304a0cf75473e8fd1d5791213f0a3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:52.237860 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 62526c368b43448e83c05dfd4e5aeaf3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:52.239193 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62526c368b43448e83c05dfd4e5aeaf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.239146 22206 tablet_service.cc:1511] Processing CreateTablet for tablet bf83ee90e33b4083aebda67b32ca1149 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:52.244234 22133 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3e126e4f1f4d82991ffddf4599b103 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:52.245867 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3e126e4f1f4d82991ffddf4599b103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.246312 22268 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.246786 22268 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.249121 22205 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3d458721d04ad184247f1a1926d3fa (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:52.230463 22054 tablet_service.cc:1511] Processing CreateTablet for tablet 42a9ba8203ae4024af5885277061c1a3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:52.254096 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a9ba8203ae4024af5885277061c1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.253909 22134 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3d458721d04ad184247f1a1926d3fa (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:52.255271 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3d458721d04ad184247f1a1926d3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.259164 22267 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.261559 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fdb108e6f14522a9ef82da47fc0b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.265527 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf83ee90e33b4083aebda67b32ca1149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.266759 22268 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.270421 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9f4c2d15b547e18ff1bfcfd082ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.270635 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 34d1a2cd4888492fad01161b84e51d77 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:52.271929 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d1a2cd4888492fad01161b84e51d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.274231 22204 tablet_service.cc:1511] Processing CreateTablet for tablet 31f3273ca74242e9b116e3e87078ccef (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:52.275494 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f3273ca74242e9b116e3e87078ccef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.277482 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4304a0cf75473e8fd1d5791213f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.281515 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:52.282238 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:52.283321 22111 leader_election.cc:343] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.283578 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:52.283792 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:25:52.285032 22111 leader_election.cc:343] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:52.285939 22111 leader_election.cc:343] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.281505 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3d458721d04ad184247f1a1926d3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.301635 22267 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.304272 22202 tablet_service.cc:1511] Processing CreateTablet for tablet 62526c368b43448e83c05dfd4e5aeaf3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:52.310014 22053 tablet_service.cc:1511] Processing CreateTablet for tablet f84b376f41e049819a74ea69b90cd298 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:52.311395 22053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84b376f41e049819a74ea69b90cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.313550 22202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62526c368b43448e83c05dfd4e5aeaf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.313966 22260 tablet_bootstrap.cc:654] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.314260 22127 tablet_service.cc:1511] Processing CreateTablet for tablet 33d4294bcbec49ad88c8ce7c879b596d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:52.315608 22127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d4294bcbec49ad88c8ce7c879b596d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.316172 22061 tablet_service.cc:1511] Processing CreateTablet for tablet b43429b68f624c25ae86dad7e60ceb15 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:52.268642 22136 tablet_service.cc:1511] Processing CreateTablet for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:52.317497 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43429b68f624c25ae86dad7e60ceb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.317920 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.303586 22130 tablet_service.cc:1511] Processing CreateTablet for tablet f2b9f971fd394d129cd62de001799b21 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:52.356873 22060 tablet_service.cc:1511] Processing CreateTablet for tablet 68525dff5d9a48b9906b79db6bffb969 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:52.358862 22060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68525dff5d9a48b9906b79db6bffb969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.372653 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b9f971fd394d129cd62de001799b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.379705 22128 tablet_service.cc:1511] Processing CreateTablet for tablet 42a9ba8203ae4024af5885277061c1a3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:25:52.382027 22246 tablet.cc:2406] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:52.383811 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a9ba8203ae4024af5885277061c1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.386603 22210 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3e126e4f1f4d82991ffddf4599b103 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:52.388427 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3e126e4f1f4d82991ffddf4599b103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.391865 22132 tablet_service.cc:1511] Processing CreateTablet for tablet 34d1a2cd4888492fad01161b84e51d77 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:52.400094 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:52.400776 22071 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.400971 22201 tablet_service.cc:1511] Processing CreateTablet for tablet 97b8db04a690435f8c84aba1b0f5ec2b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:52.400983 22208 tablet_service.cc:1511] Processing CreateTablet for tablet 33d4294bcbec49ad88c8ce7c879b596d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:52.402848 22201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b8db04a690435f8c84aba1b0f5ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.403308 22207 tablet_service.cc:1511] Processing CreateTablet for tablet f2b9f971fd394d129cd62de001799b21 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:52.404331 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d4294bcbec49ad88c8ce7c879b596d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.405803 22135 tablet_service.cc:1511] Processing CreateTablet for tablet 97b8db04a690435f8c84aba1b0f5ec2b (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:52.408668 22052 tablet_service.cc:1511] Processing CreateTablet for tablet 790bdc35efb4419cb67fd1a718e2b584 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:52.412483 22071 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:52.413808 22205 tablet_service.cc:1511] Processing CreateTablet for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:52.415922 22133 tablet_service.cc:1511] Processing CreateTablet for tablet f84b376f41e049819a74ea69b90cd298 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:52.417344 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d1a2cd4888492fad01161b84e51d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.424682 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b9f971fd394d129cd62de001799b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.425961 22055 tablet_service.cc:1511] Processing CreateTablet for tablet 5e89ee7eb571454eb9956953ae2c7c5d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:52.431344 22203 tablet_service.cc:1511] Processing CreateTablet for tablet 42a9ba8203ae4024af5885277061c1a3 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:52.432550 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.436048 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 34d1a2cd4888492fad01161b84e51d77 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:52.437388 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d1a2cd4888492fad01161b84e51d77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.441697 22052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790bdc35efb4419cb67fd1a718e2b584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.445387 22055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e89ee7eb571454eb9956953ae2c7c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.445573 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a9ba8203ae4024af5885277061c1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.447335 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b8db04a690435f8c84aba1b0f5ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.449643 22207 tablet_service.cc:1511] Processing CreateTablet for tablet b43429b68f624c25ae86dad7e60ceb15 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:52.451076 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43429b68f624c25ae86dad7e60ceb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.436854 22209 tablet_service.cc:1511] Processing CreateTablet for tablet f84b376f41e049819a74ea69b90cd298 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:52.453899 22262 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:52.453768 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:52.454434 22262 ts_tablet_manager.cc:1403] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.274s	user 0.022s	sys 0.010s
I20260709 12:25:52.454567 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84b376f41e049819a74ea69b90cd298. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:52.455518 22035 leader_election.cc:343] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.453892 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84b376f41e049819a74ea69b90cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.478974 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:52.482911 22267 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.495019 22262 raft_consensus.cc:359] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.497119 22260 tablet_bootstrap.cc:492] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:52.526999 22260 ts_tablet_manager.cc:1403] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.341s	user 0.018s	sys 0.009s
I20260709 12:25:52.527040 22266 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.529757 22266 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.532209 22266 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:52.531919 22059 tablet_service.cc:1511] Processing CreateTablet for tablet a8619cc30f64448bb01e0e927ff038d1 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:52.533437 22059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8619cc30f64448bb01e0e927ff038d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.498636 22261 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:52.500149 22131 tablet_service.cc:1511] Processing CreateTablet for tablet b43429b68f624c25ae86dad7e60ceb15 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:52.508574 22058 tablet_service.cc:1511] Processing CreateTablet for tablet e5f28925d2fc4ec39e677a2be96ca259 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:52.508993 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:52.513754 22267 raft_consensus.cc:697] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:52.518201 22057 tablet_service.cc:1511] Processing CreateTablet for tablet 1fec8474cec64acca2f6f9303db0b0af (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:52.535432 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:52.544126 22267 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:52.544744 22036 leader_election.cc:343] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.545430 22036 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:25:52.545737 22185 leader_election.cc:343] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.535365 22135 tablet_service.cc:1511] Processing CreateTablet for tablet 68525dff5d9a48b9906b79db6bffb969 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:52.546396 22268 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.537250 22205 tablet_service.cc:1511] Processing CreateTablet for tablet 68525dff5d9a48b9906b79db6bffb969 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:52.537642 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:52.543908 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f28925d2fc4ec39e677a2be96ca259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.548339 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68525dff5d9a48b9906b79db6bffb969. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:52.550302 22184 leader_election.cc:343] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.550776 22184 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:52.554363 22266 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:52.558128 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec8474cec64acca2f6f9303db0b0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.562388 22135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68525dff5d9a48b9906b79db6bffb969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.534539 22262 raft_consensus.cc:385] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.551108 22261 ts_tablet_manager.cc:1403] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.362s	user 0.023s	sys 0.053s
I20260709 12:25:52.579964 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b43429b68f624c25ae86dad7e60ceb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.581583 22054 tablet_service.cc:1511] Processing CreateTablet for tablet 0f24f68619f14d9e9de4306dd59b5709 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:52.583040 22054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f24f68619f14d9e9de4306dd59b5709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.582863 22202 tablet_service.cc:1511] Processing CreateTablet for tablet 790bdc35efb4419cb67fd1a718e2b584 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:52.584156 22202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790bdc35efb4419cb67fd1a718e2b584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.588050 22261 raft_consensus.cc:359] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.588850 22261 raft_consensus.cc:385] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.591138 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 5e89ee7eb571454eb9956953ae2c7c5d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:52.593966 22136 tablet_service.cc:1511] Processing CreateTablet for tablet 5e89ee7eb571454eb9956953ae2c7c5d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:52.594292 22260 raft_consensus.cc:359] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.595186 22260 raft_consensus.cc:385] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.595577 22260 raft_consensus.cc:740] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.596410 22260 consensus_queue.cc:260] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.595326 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e89ee7eb571454eb9956953ae2c7c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.602173 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e89ee7eb571454eb9956953ae2c7c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.603469 22204 tablet_service.cc:1511] Processing CreateTablet for tablet e5f28925d2fc4ec39e677a2be96ca259 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:52.609531 21967 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.618078 22052 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed5fd823f34d34b4fd87d49e53edb0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:52.576907 22262 raft_consensus.cc:740] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.620463 22053 tablet_service.cc:1511] Processing CreateTablet for tablet 522ffe0721f94fd69f4df0687f606515 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:52.621976 22262 consensus_queue.cc:260] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.619431 22052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed5fd823f34d34b4fd87d49e53edb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.624846 22053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522ffe0721f94fd69f4df0687f606515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.627763 22262 ts_tablet_manager.cc:1434] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.173s	user 0.008s	sys 0.003s
I20260709 12:25:52.627826 22133 tablet_service.cc:1511] Processing CreateTablet for tablet e5f28925d2fc4ec39e677a2be96ca259 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:52.637339 22057 tablet_service.cc:1511] Processing CreateTablet for tablet 66ecbcd398b0449b86b36309434ca3d1 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:52.632417 22204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f28925d2fc4ec39e677a2be96ca259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.644207 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ecbcd398b0449b86b36309434ca3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.644416 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f28925d2fc4ec39e677a2be96ca259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.601089 22261 raft_consensus.cc:740] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.647531 22203 tablet_service.cc:1511] Processing CreateTablet for tablet 1fec8474cec64acca2f6f9303db0b0af (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:52.653398 22127 tablet_service.cc:1511] Processing CreateTablet for tablet 790bdc35efb4419cb67fd1a718e2b584 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:52.654858 22127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790bdc35efb4419cb67fd1a718e2b584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.658142 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec8474cec64acca2f6f9303db0b0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.663295 22262 tablet_bootstrap.cc:492] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:52.647176 22261 consensus_queue.cc:260] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.663062 22056 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5597e9e8004903a03d0ac57b864069 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:52.666518 22056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5597e9e8004903a03d0ac57b864069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.667651 22061 tablet_service.cc:1511] Processing CreateTablet for tablet bbe117f2cdc04fab8acb64e91252db18 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:52.666163 22128 tablet_service.cc:1511] Processing CreateTablet for tablet 0f24f68619f14d9e9de4306dd59b5709 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:52.668938 22061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe117f2cdc04fab8acb64e91252db18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.669224 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f24f68619f14d9e9de4306dd59b5709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.699476 22130 tablet_service.cc:1511] Processing CreateTablet for tablet 1fec8474cec64acca2f6f9303db0b0af (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:52.670612 22261 ts_tablet_manager.cc:1434] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.003s
I20260709 12:25:52.714344 22260 ts_tablet_manager.cc:1434] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.187s	user 0.015s	sys 0.003s
I20260709 12:25:52.715060 22203 tablet_service.cc:1511] Processing CreateTablet for tablet 522ffe0721f94fd69f4df0687f606515 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:52.716347 22203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522ffe0721f94fd69f4df0687f606515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.716624 22260 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:52.719413 22057 tablet_service.cc:1511] Processing CreateTablet for tablet 03a703fed624441fb4eb00f38f0ff80d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:52.692768 22207 tablet_service.cc:1511] Processing CreateTablet for tablet a8619cc30f64448bb01e0e927ff038d1 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:52.627826 22134 tablet_service.cc:1511] Processing CreateTablet for tablet a8619cc30f64448bb01e0e927ff038d1 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:52.720774 22207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8619cc30f64448bb01e0e927ff038d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.725849 22057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a703fed624441fb4eb00f38f0ff80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.711807 22262 tablet_bootstrap.cc:654] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.719805 22130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec8474cec64acca2f6f9303db0b0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.734848 22134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8619cc30f64448bb01e0e927ff038d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.741287 22268 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.741859 22268 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.743942 22268 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.743963 22058 tablet_service.cc:1511] Processing CreateTablet for tablet 93141c9281524e9aaffe4907f7e32041 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:52.746058 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:52.747099 22058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93141c9281524e9aaffe4907f7e32041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.747382 22261 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
W20260709 12:25:52.747509 22035 leader_election.cc:343] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.683104 22129 tablet_service.cc:1511] Processing CreateTablet for tablet 522ffe0721f94fd69f4df0687f606515 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:52.762025 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522ffe0721f94fd69f4df0687f606515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.774716 22132 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed5fd823f34d34b4fd87d49e53edb0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:52.776575 22132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed5fd823f34d34b4fd87d49e53edb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.695634 22201 tablet_service.cc:1511] Processing CreateTablet for tablet 0f24f68619f14d9e9de4306dd59b5709 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:52.730733 22210 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed5fd823f34d34b4fd87d49e53edb0 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:52.778272 22260 tablet_bootstrap.cc:654] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.780719 22136 tablet_service.cc:1511] Processing CreateTablet for tablet 66ecbcd398b0449b86b36309434ca3d1 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:52.781126 22127 tablet_service.cc:1511] Processing CreateTablet for tablet bbe117f2cdc04fab8acb64e91252db18 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:52.783496 22136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ecbcd398b0449b86b36309434ca3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.789870 22127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe117f2cdc04fab8acb64e91252db18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.791536 22128 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5597e9e8004903a03d0ac57b864069 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:52.793928 22128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5597e9e8004903a03d0ac57b864069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.807197 22208 tablet_service.cc:1511] Processing CreateTablet for tablet bbe117f2cdc04fab8acb64e91252db18 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:52.809968 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:52.810873 22218 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:52.811939 22209 tablet_service.cc:1511] Processing CreateTablet for tablet 66ecbcd398b0449b86b36309434ca3d1 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:52.812419 22036 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:52.813585 22268 raft_consensus.cc:2804] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.813970 22268 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.814325 22268 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.815794 22206 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5597e9e8004903a03d0ac57b864069 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:52.818147 22209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ecbcd398b0449b86b36309434ca3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.821724 22268 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.824672 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:25:52.826171 22035 leader_election.cc:343] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.826285 22133 tablet_service.cc:1511] Processing CreateTablet for tablet 93141c9281524e9aaffe4907f7e32041 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:52.827579 22133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93141c9281524e9aaffe4907f7e32041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.828434 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:52.829023 22218 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.803388 22261 tablet_bootstrap.cc:654] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.833210 22202 tablet_service.cc:1511] Processing CreateTablet for tablet 03a703fed624441fb4eb00f38f0ff80d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:52.845512 22201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f24f68619f14d9e9de4306dd59b5709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.847393 22260 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:52.848161 22260 ts_tablet_manager.cc:1403] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.002s
I20260709 12:25:52.851399 22218 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:52.852768 22036 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:52.839010 22268 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.869585 22262 tablet_bootstrap.cc:492] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:52.869938 22268 raft_consensus.cc:2804] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.870126 22262 ts_tablet_manager.cc:1403] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.207s	user 0.024s	sys 0.043s
W20260709 12:25:52.870301 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:52.870555 22268 raft_consensus.cc:697] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:52.865280 22208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe117f2cdc04fab8acb64e91252db18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.871726 22268 consensus_queue.cc:237] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.873286 22206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5597e9e8004903a03d0ac57b864069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.878074 22262 raft_consensus.cc:359] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.878814 22262 raft_consensus.cc:385] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.879287 22262 raft_consensus.cc:740] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.880203 22262 consensus_queue.cc:260] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.852533 22260 raft_consensus.cc:359] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.885681 22260 raft_consensus.cc:385] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.886116 22260 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.901335 22260 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.901484 22205 tablet_service.cc:1511] Processing CreateTablet for tablet 93141c9281524e9aaffe4907f7e32041 (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:52.902671 22287 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.903157 22287 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:52.911506 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 58864.6us
I20260709 12:25:52.913126 22287 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.914328 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:52.915587 22111 leader_election.cc:343] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.916306 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:52.916951 22071 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:52.918044 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:52.918123 22261 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:52.918763 22287 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:52.919262 22261 ts_tablet_manager.cc:1403] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.023s
I20260709 12:25:52.919247 22287 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.919811 22287 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.840764 22131 tablet_service.cc:1511] Processing CreateTablet for tablet 03a703fed624441fb4eb00f38f0ff80d (DEFAULT_TABLE table=test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:52.922546 22261 raft_consensus.cc:359] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.909734 22202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a703fed624441fb4eb00f38f0ff80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.926234 22261 raft_consensus.cc:385] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.927107 22261 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.929047 22260 ts_tablet_manager.cc:1434] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:25:52.930137 22260 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:52.930220 22131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a703fed624441fb4eb00f38f0ff80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.936335 22205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93141c9281524e9aaffe4907f7e32041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.937579 22210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed5fd823f34d34b4fd87d49e53edb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.929080 22261 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.948920 22261 ts_tablet_manager.cc:1434] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:25:52.965054 22294 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.965648 22294 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.956591 22287 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.967772 22294 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.969156 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:52.971462 22035 leader_election.cc:343] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.975299 22287 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:52.978773 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:52.978983 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:52.979499 22220 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.980842 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:52.981451 22071 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.982623 22262 ts_tablet_manager.cc:1434] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.112s	user 0.013s	sys 0.000s
I20260709 12:25:52.983669 22262 tablet_bootstrap.cc:492] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:52.987984 22220 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
W20260709 12:25:52.989324 22111 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.990015 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:52.990844 22287 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.991317 22287 raft_consensus.cc:697] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:52.992134 22287 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:52.993752 22262 tablet_bootstrap.cc:654] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.993952 22261 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
W20260709 12:25:52.994841 22036 leader_election.cc:343] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:52.995347 22036 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:52.996115 22294 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.012082 22260 tablet_bootstrap.cc:654] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.020243 22071 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.024168 22261 tablet_bootstrap.cc:654] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.023296 21965 catalog_manager.cc:5697] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.027117 22260 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.027735 22260 ts_tablet_manager.cc:1403] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.007s
I20260709 12:25:53.030773 22260 raft_consensus.cc:359] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.031672 22260 raft_consensus.cc:385] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.032037 22260 raft_consensus.cc:740] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.033025 22260 consensus_queue.cc:260] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.035940 22260 ts_tablet_manager.cc:1434] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:25:53.037041 22260 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.038779 22267 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.039429 22267 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.039983 22262 tablet_bootstrap.cc:492] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.040591 22262 ts_tablet_manager.cc:1403] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.002s
I20260709 12:25:53.042016 22267 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.043802 22260 tablet_bootstrap.cc:654] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.044389 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.043574 22262 raft_consensus.cc:359] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.045490 22262 raft_consensus.cc:385] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.045289 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.045820 22262 raft_consensus.cc:740] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.046103 22220 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.046733 22262 consensus_queue.cc:260] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.047930 22071 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.048370 22111 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.050377 22267 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.050810 22267 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.051234 22267 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.054680 22262 ts_tablet_manager.cc:1434] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:53.055703 22262 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.056017 22260 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.056507 22260 ts_tablet_manager.cc:1403] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:25:53.059684 22260 raft_consensus.cc:359] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.060545 22260 raft_consensus.cc:385] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.060901 22260 raft_consensus.cc:740] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.061667 22260 consensus_queue.cc:260] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.064164 22260 ts_tablet_manager.cc:1434] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:53.064560 22262 tablet_bootstrap.cc:654] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.065299 22260 tablet_bootstrap.cc:492] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.067907 22285 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:53.076798 22262 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.077459 22262 ts_tablet_manager.cc:1403] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:25:53.080200 21967 catalog_manager.cc:5697] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.081110 22262 raft_consensus.cc:359] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.082098 22262 raft_consensus.cc:385] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.082504 22262 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.083562 22262 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.085697 22260 tablet_bootstrap.cc:654] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.086270 22262 ts_tablet_manager.cc:1434] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:25:53.086505 22261 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.087033 22261 ts_tablet_manager.cc:1403] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.020s
I20260709 12:25:53.087426 22262 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.090104 22261 raft_consensus.cc:359] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.090849 22261 raft_consensus.cc:385] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.091147 22261 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.092031 22261 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.094466 22261 ts_tablet_manager.cc:1434] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:53.095742 22261 tablet_bootstrap.cc:492] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.095860 22262 tablet_bootstrap.cc:654] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.102686 22261 tablet_bootstrap.cc:654] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.102686 22260 tablet_bootstrap.cc:492] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.104972 22260 ts_tablet_manager.cc:1403] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 12:25:53.105687 22262 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.106209 22262 ts_tablet_manager.cc:1403] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:25:53.109560 22262 raft_consensus.cc:359] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.110311 22262 raft_consensus.cc:385] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.110718 22262 raft_consensus.cc:740] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.111480 22260 raft_consensus.cc:359] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.111788 22262 consensus_queue.cc:260] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.113451 22260 raft_consensus.cc:385] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.114142 22260 raft_consensus.cc:740] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.115445 22262 ts_tablet_manager.cc:1434] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:53.115990 22260 consensus_queue.cc:260] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.077368 22267 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.119817 22260 ts_tablet_manager.cc:1434] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:25:53.116518 22262 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.123230 22267 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.125191 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.125501 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:53.125886 22070 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.126052 22220 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.127502 22260 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.130883 22268 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.131398 22268 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.134452 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:53.136468 22035 leader_election.cc:343] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.137801 22262 tablet_bootstrap.cc:654] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.137959 22220 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.140761 22070 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.141355 22268 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.141695 22260 tablet_bootstrap.cc:654] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.143025 22111 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:53.143451 22266 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.143930 22266 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.145187 22285 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.145684 22285 raft_consensus.cc:697] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:53.146422 22266 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:53.146512 22285 consensus_queue.cc:237] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.149524 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.150295 22070 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:53.151541 22185 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:53.152426 22266 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.152554 22262 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.152814 22266 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.153129 22262 ts_tablet_manager.cc:1403] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.008s
I20260709 12:25:53.153191 22266 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.154438 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.155157 22220 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:53.155850 22262 raft_consensus.cc:359] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.156489 22262 raft_consensus.cc:385] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.156410 22036 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:53.156857 22262 raft_consensus.cc:740] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.157407 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.158070 22146 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:53.158907 22268 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.159279 22268 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.159613 22268 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.158524 22262 consensus_queue.cc:260] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.165280 22262 ts_tablet_manager.cc:1434] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:53.166280 22262 tablet_bootstrap.cc:492] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.165930 21966 catalog_manager.cc:5697] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.172415 22262 tablet_bootstrap.cc:654] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.172338 22261 tablet_bootstrap.cc:492] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.173303 22261 ts_tablet_manager.cc:1403] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.008s
I20260709 12:25:53.177548 22261 raft_consensus.cc:359] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.178511 22261 raft_consensus.cc:385] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.178865 22285 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.179374 22285 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.178874 22261 raft_consensus.cc:740] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.181478 22285 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:25:53.180889 22261 consensus_queue.cc:260] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.183180 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.183321 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.183799 22070 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
W20260709 12:25:53.184933 22111 leader_election.cc:343] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.186259 22111 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.186566 22266 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.187711 22285 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.188233 22285 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.188706 22285 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.189365 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.190725 22070 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.191102 22266 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:53.192370 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:53.192965 22146 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.207085 22262 tablet_bootstrap.cc:492] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.207157 22070 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:53.207837 22262 ts_tablet_manager.cc:1403] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.007s
I20260709 12:25:53.208302 22185 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:53.200924 22146 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:53.208988 22268 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.210522 22260 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.212193 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:53.201018 22285 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.212909 22260 ts_tablet_manager.cc:1403] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.019s
I20260709 12:25:53.212888 22220 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.213390 22262 raft_consensus.cc:359] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.212069 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:53.222424 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.222694 22262 raft_consensus.cc:385] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.211982 22268 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.219272 22266 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.222997 22070 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.223033 22262 raft_consensus.cc:740] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.223454 22266 raft_consensus.cc:697] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:25:53.223673 22035 leader_election.cc:343] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.223987 22262 consensus_queue.cc:260] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.224323 22266 consensus_queue.cc:237] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.214342 22285 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:25:53.215842 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:25:53.227182 22111 leader_election.cc:343] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.225925 22262 ts_tablet_manager.cc:1434] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:25:53.228663 22262 tablet_bootstrap.cc:492] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.230660 22261 ts_tablet_manager.cc:1434] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.008s
I20260709 12:25:53.232086 22261 tablet_bootstrap.cc:492] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.234571 22262 tablet_bootstrap.cc:654] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.240916 22070 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.221856 22220 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:53.215957 22260 raft_consensus.cc:359] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.242895 22111 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.243420 22260 raft_consensus.cc:385] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.243785 22260 raft_consensus.cc:740] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.244582 22285 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.244493 22260 consensus_queue.cc:260] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.245242 22285 raft_consensus.cc:697] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:53.246117 22262 tablet_bootstrap.cc:492] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.246510 22260 ts_tablet_manager.cc:1434] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 12:25:53.246354 22285 consensus_queue.cc:237] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.247582 22036 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:53.248425 22268 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.246557 22262 ts_tablet_manager.cc:1403] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:25:53.248896 22268 raft_consensus.cc:697] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:53.249145 22260 tablet_bootstrap.cc:492] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.249790 22268 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.251622 22262 raft_consensus.cc:359] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.252300 22262 raft_consensus.cc:385] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.252588 22262 raft_consensus.cc:740] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.253268 22261 tablet_bootstrap.cc:654] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.253326 22262 consensus_queue.cc:260] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.255380 22262 ts_tablet_manager.cc:1434] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:53.255964 22260 tablet_bootstrap.cc:654] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.256295 22262 tablet_bootstrap.cc:492] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.271047 22262 tablet_bootstrap.cc:654] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.274960 21965 catalog_manager.cc:5697] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.283742 21966 catalog_manager.cc:5697] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.306779 22261 tablet_bootstrap.cc:492] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.307873 21965 catalog_manager.cc:5697] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.311940 22260 tablet_bootstrap.cc:492] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.312624 22260 ts_tablet_manager.cc:1403] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.016s
I20260709 12:25:53.309257 22261 ts_tablet_manager.cc:1403] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.022s
I20260709 12:25:53.315351 22262 tablet_bootstrap.cc:492] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.315836 22262 ts_tablet_manager.cc:1403] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.004s
I20260709 12:25:53.316018 22261 raft_consensus.cc:359] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.316533 22261 raft_consensus.cc:385] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.316850 22261 raft_consensus.cc:740] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.317749 22261 consensus_queue.cc:260] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.319377 22260 raft_consensus.cc:359] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.320061 22260 raft_consensus.cc:385] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.320154 22261 ts_tablet_manager.cc:1434] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:53.320364 22260 raft_consensus.cc:740] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.321406 22261 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.321125 22260 consensus_queue.cc:260] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.323455 22260 ts_tablet_manager.cc:1434] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:25:53.318507 22262 raft_consensus.cc:359] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.324229 22262 raft_consensus.cc:385] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.324533 22262 raft_consensus.cc:740] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.325412 22262 consensus_queue.cc:260] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.326996 22260 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.328223 22261 tablet_bootstrap.cc:654] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.333364 22260 tablet_bootstrap.cc:654] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.333514 22262 ts_tablet_manager.cc:1434] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:25:53.334926 22262 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.339908 22261 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.340384 22261 ts_tablet_manager.cc:1403] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:25:53.341161 22262 tablet_bootstrap.cc:654] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.342998 22261 raft_consensus.cc:359] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.343724 22261 raft_consensus.cc:385] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.344103 22261 raft_consensus.cc:740] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.345238 22261 consensus_queue.cc:260] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } }
I20260709 12:25:53.348543 22261 ts_tablet_manager.cc:1434] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:25:53.350224 22261 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.360407 22261 tablet_bootstrap.cc:654] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.361507 22262 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.362011 22262 ts_tablet_manager.cc:1403] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.001s
I20260709 12:25:53.362627 22260 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.363111 22260 ts_tablet_manager.cc:1403] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.017s
I20260709 12:25:53.365305 22262 raft_consensus.cc:359] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.366263 22262 raft_consensus.cc:385] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.366616 22262 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.366869 22260 raft_consensus.cc:359] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.368204 22260 raft_consensus.cc:385] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.368484 22260 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.367749 22262 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.369072 22260 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.371188 22262 ts_tablet_manager.cc:1434] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:53.372876 22262 tablet_bootstrap.cc:492] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.374683 22260 ts_tablet_manager.cc:1434] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:53.375630 22260 tablet_bootstrap.cc:492] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.377404 22145 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.381669 22260 tablet_bootstrap.cc:654] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.383380 22262 tablet_bootstrap.cc:654] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.386823 22261 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.387416 22261 ts_tablet_manager.cc:1403] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.016s
I20260709 12:25:53.387814 22268 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.390573 22261 raft_consensus.cc:359] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.391530 22261 raft_consensus.cc:385] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.391881 22261 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.392802 22261 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.395359 22261 ts_tablet_manager.cc:1434] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:25:53.396682 22261 tablet_bootstrap.cc:492] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.402657 22261 tablet_bootstrap.cc:654] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.403939 22262 tablet_bootstrap.cc:492] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.404455 22262 ts_tablet_manager.cc:1403] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.009s
I20260709 12:25:53.407760 22262 raft_consensus.cc:359] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.408684 22262 raft_consensus.cc:385] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.409034 22262 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.410226 22262 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.413852 22262 ts_tablet_manager.cc:1434] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 12:25:53.415134 22262 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.423306 22262 tablet_bootstrap.cc:654] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.423924 22261 tablet_bootstrap.cc:492] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.424521 22261 ts_tablet_manager.cc:1403] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 12:25:53.425315 22268 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.425858 22268 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.427142 22285 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.428211 22268 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.427803 22285 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.427479 22261 raft_consensus.cc:359] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.428936 22261 raft_consensus.cc:385] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.429292 22261 raft_consensus.cc:740] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.430261 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.431844 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.433187 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:25:53.433825 22035 leader_election.cc:343] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.434854 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.435623 22219 raft_consensus.cc:2393] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 1: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
W20260709 12:25:53.439437 22036 leader_election.cc:343] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.439110 22261 consensus_queue.cc:260] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.439888 22036 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.441290 22261 ts_tablet_manager.cc:1434] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 12:25:53.441506 22268 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.437074 22111 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:53.442490 22261 tablet_bootstrap.cc:492] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.442551 22287 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.448017 22268 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.449081 22261 tablet_bootstrap.cc:654] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.443890 22262 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.433871 22285 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.454052 22262 ts_tablet_manager.cc:1403] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.001s
I20260709 12:25:53.467357 22262 raft_consensus.cc:359] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.468351 22262 raft_consensus.cc:385] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.468719 22262 raft_consensus.cc:740] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.470762 22262 consensus_queue.cc:260] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.473737 22262 ts_tablet_manager.cc:1434] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 12:25:53.474481 22266 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.475975 22266 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.473621 22267 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.478359 22267 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.479897 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.481504 22266 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:53.481715 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.483435 22184 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:53.485541 22267 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.487128 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.488014 22219 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.492321 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.484934 22266 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.495481 22267 raft_consensus.cc:2804] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.496029 22267 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.496503 22267 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.474926 22287 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.498708 22262 tablet_bootstrap.cc:492] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.499675 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.501120 22070 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.506800 22266 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.507431 22266 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.510509 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.511412 22070 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:53.513244 22266 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:53.515785 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.516469 22146 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:53.517776 22184 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.522068 22266 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.525830 22266 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.526340 22266 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.538329 22261 tablet_bootstrap.cc:492] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.538832 22261 ts_tablet_manager.cc:1403] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.097s	user 0.040s	sys 0.020s
I20260709 12:25:53.540076 22287 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.540736 22287 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.543732 22287 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.546165 22267 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.547254 22260 tablet_bootstrap.cc:492] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.547740 22260 ts_tablet_manager.cc:1403] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.172s	user 0.068s	sys 0.072s
I20260709 12:25:53.547968 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.548195 22267 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.551754 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.552402 22219 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.551188 22070 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.556051 22111 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.556653 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:53.557754 22220 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.558647 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.559522 22070 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.568216 22220 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.569845 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.570581 22287 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.570995 22287 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.571476 22287 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.571735 22261 raft_consensus.cc:359] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.572423 22261 raft_consensus.cc:385] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.572683 22261 raft_consensus.cc:740] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.573304 22070 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.575095 22285 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.575775 22262 tablet_bootstrap.cc:654] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.570936 22267 raft_consensus.cc:2804] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.576989 22261 consensus_queue.cc:260] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.577811 22260 raft_consensus.cc:359] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.578509 22260 raft_consensus.cc:385] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.578824 22260 raft_consensus.cc:740] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.578599 22266 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.579383 22267 raft_consensus.cc:697] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:53.580772 22267 consensus_queue.cc:237] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.581333 22261 ts_tablet_manager.cc:1434] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:25:53.581959 22333 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.582427 22333 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.583287 22260 consensus_queue.cc:260] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.584331 22261 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.585441 22260 ts_tablet_manager.cc:1434] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.037s	user 0.020s	sys 0.003s
I20260709 12:25:53.585549 22287 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.586393 22260 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.589713 22287 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.590456 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.591113 22071 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.594144 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.594931 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.595510 22070 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:53.596405 22035 leader_election.cc:343] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.596601 22333 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.597761 22266 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:53.597846 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.599171 22260 tablet_bootstrap.cc:654] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:53.599565 22036 leader_election.cc:343] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.600049 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.602504 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:53.603170 22219 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.606011 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:53.606318 22287 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.607146 22145 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.607663 22071 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.608465 22333 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.609020 22070 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:53.610339 22185 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:53.611325 22266 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.611827 22266 raft_consensus.cc:697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:53.613572 22262 tablet_bootstrap.cc:492] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.612695 22266 consensus_queue.cc:237] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.614020 22262 ts_tablet_manager.cc:1403] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.002s
I20260709 12:25:53.608992 22111 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:53.616804 22287 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.617362 22287 raft_consensus.cc:697] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:53.618302 22287 consensus_queue.cc:237] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.623049 22145 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:53.631762 22285 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.616727 22262 raft_consensus.cc:359] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.633024 22262 raft_consensus.cc:385] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.632295 22285 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.635191 22285 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.631819 22333 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.638120 22333 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.626098 22219 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.641521 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:53.642905 22035 leader_election.cc:343] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.643672 22333 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.644080 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.644999 22261 tablet_bootstrap.cc:654] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:53.645591 22036 leader_election.cc:343] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.646067 22036 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.647224 22333 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.651897 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.651898 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.652889 22219 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.652729 22071 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.633373 22262 raft_consensus.cc:740] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.657089 22111 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.657366 22262 consensus_queue.cc:260] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.658031 22342 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.658442 22342 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.658821 22342 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.659680 22262 ts_tablet_manager.cc:1434] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:25:53.658263 21966 catalog_manager.cc:5697] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.660666 22262 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.668179 22342 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.668677 22219 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.670555 22342 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.671530 21967 catalog_manager.cc:5697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.672416 22262 tablet_bootstrap.cc:654] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.681720 22260 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.682240 22260 ts_tablet_manager.cc:1403] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.004s
I20260709 12:25:53.685022 22260 raft_consensus.cc:359] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.685730 22260 raft_consensus.cc:385] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.686028 22260 raft_consensus.cc:740] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.686714 22260 consensus_queue.cc:260] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.687431 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.688010 22070 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.688103 22294 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:53.688951 22260 ts_tablet_manager.cc:1434] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:53.691282 22260 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.696456 22070 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.697633 22260 tablet_bootstrap.cc:654] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.699788 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:53.700445 22218 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.707820 22266 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:53.708817 22260 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.709700 22260 ts_tablet_manager.cc:1403] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 12:25:53.709746 22218 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:53.712976 22342 consensus_queue.cc:1048] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.714000 22260 raft_consensus.cc:359] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.714651 22260 raft_consensus.cc:385] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.714943 22260 raft_consensus.cc:740] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.715832 22260 consensus_queue.cc:260] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.716557 22287 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.717960 22260 ts_tablet_manager.cc:1434] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:25:53.722191 22260 tablet_bootstrap.cc:492] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.729970 22260 tablet_bootstrap.cc:654] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.734238 22261 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.734758 22261 ts_tablet_manager.cc:1403] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.000s
I20260709 12:25:53.734570 22268 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.735366 22262 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.735854 22262 ts_tablet_manager.cc:1403] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.075s	user 0.034s	sys 0.021s
I20260709 12:25:53.737484 22261 raft_consensus.cc:359] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.738143 22261 raft_consensus.cc:385] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.738418 22261 raft_consensus.cc:740] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.738498 22262 raft_consensus.cc:359] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.739321 22262 raft_consensus.cc:385] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.739142 22261 consensus_queue.cc:260] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.739637 22262 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.740360 22262 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.740748 22111 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.742641 22287 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.743105 22287 raft_consensus.cc:697] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:53.743563 22262 ts_tablet_manager.cc:1434] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:25:53.743930 22287 consensus_queue.cc:237] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.744530 22262 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.752985 22262 tablet_bootstrap.cc:654] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.764326 22261 ts_tablet_manager.cc:1434] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:25:53.766077 22261 tablet_bootstrap.cc:492] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.767257 22314 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:53.772781 22261 tablet_bootstrap.cc:654] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.777750 22287 consensus_queue.cc:1048] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:53.782775 22262 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.783601 22261 tablet_bootstrap.cc:492] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.783835 22262 ts_tablet_manager.cc:1403] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.005s
I20260709 12:25:53.784014 22261 ts_tablet_manager.cc:1403] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:25:53.786502 22262 raft_consensus.cc:359] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.787263 22262 raft_consensus.cc:385] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.787586 22262 raft_consensus.cc:740] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.788452 22262 consensus_queue.cc:260] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.790532 22262 ts_tablet_manager.cc:1434] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:53.791739 22262 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.791440 22261 raft_consensus.cc:359] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.792114 22261 raft_consensus.cc:385] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.792387 22261 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.793010 22261 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.798954 22262 tablet_bootstrap.cc:654] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.803418 22261 ts_tablet_manager.cc:1434] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:25:53.805819 22261 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.810889 22353 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.811625 22353 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.815019 22261 tablet_bootstrap.cc:654] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.815717 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.816669 22071 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:53.820092 22262 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.819947 22185 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:53.820648 22353 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:53.821338 22314 raft_consensus.cc:2804] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.821929 22314 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.822423 22314 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.822444 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.823523 22146 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:53.828490 22261 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.829032 22261 ts_tablet_manager.cc:1403] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 12:25:53.832165 22262 ts_tablet_manager.cc:1403] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.013s
I20260709 12:25:53.832198 22261 raft_consensus.cc:359] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.833086 22261 raft_consensus.cc:385] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.833446 22261 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.834082 22314 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.834661 22261 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.840842 22261 ts_tablet_manager.cc:1434] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:25:53.841290 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:53.841756 22314 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:53.836580 22262 raft_consensus.cc:359] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.842687 22217 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.842865 22261 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.843086 22262 raft_consensus.cc:385] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.843587 22262 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.844376 22262 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.846755 22262 ts_tablet_manager.cc:1434] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:25:53.847201 22070 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.850713 22261 tablet_bootstrap.cc:654] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.853492 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:53.854104 22146 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.855136 22262 tablet_bootstrap.cc:492] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.857576 22260 tablet_bootstrap.cc:492] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.858065 22260 ts_tablet_manager.cc:1403] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.139s	user 0.041s	sys 0.066s
I20260709 12:25:53.862668 22146 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:53.860047 22070 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:53.864048 22184 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.865494 22342 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:53.867132 22314 raft_consensus.cc:2804] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.867838 22262 tablet_bootstrap.cc:654] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.868466 22261 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:53.867851 22314 raft_consensus.cc:697] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:53.868933 22261 ts_tablet_manager.cc:1403] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.001s
I20260709 12:25:53.871567 22314 consensus_queue.cc:237] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.877944 22260 raft_consensus.cc:359] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.878690 22260 raft_consensus.cc:385] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.878966 22260 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.879735 22260 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.882633 22260 ts_tablet_manager.cc:1434] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:25:53.882566 22261 raft_consensus.cc:359] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.883731 22260 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
W20260709 12:25:53.887063 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:53.883648 22261 raft_consensus.cc:385] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.887704 22261 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.888726 22268 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.888635 22261 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.889307 22268 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.890568 22260 tablet_bootstrap.cc:654] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.891599 22268 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.892756 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:53.894678 22035 leader_election.cc:343] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.898247 22262 tablet_bootstrap.cc:492] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.898823 22262 ts_tablet_manager.cc:1403] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.000s
I20260709 12:25:53.901964 22262 raft_consensus.cc:359] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.903307 22260 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.901029 22261 ts_tablet_manager.cc:1434] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:25:53.902583 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.903483 22262 raft_consensus.cc:385] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:53.904772 22036 leader_election.cc:343] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.904525 22261 tablet_bootstrap.cc:492] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:53.905439 22036 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.906093 22260 ts_tablet_manager.cc:1403] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 12:25:53.908846 22333 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.908588 21965 catalog_manager.cc:5697] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.908820 22260 raft_consensus.cc:359] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.910461 22260 raft_consensus.cc:385] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.910858 22260 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.910481 21965 catalog_manager.cc:5697] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.911641 22260 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.904933 22262 raft_consensus.cc:740] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.914944 22260 ts_tablet_manager.cc:1434] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:25:53.914980 22261 tablet_bootstrap.cc:654] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.916096 22260 tablet_bootstrap.cc:492] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.915057 22262 consensus_queue.cc:260] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.918495 22262 ts_tablet_manager.cc:1434] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:25:53.919809 22262 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:53.923125 22260 tablet_bootstrap.cc:654] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.929483 22262 tablet_bootstrap.cc:654] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.934413 22260 tablet_bootstrap.cc:492] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.934934 22260 ts_tablet_manager.cc:1403] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:25:53.937590 22260 raft_consensus.cc:359] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.938256 22260 raft_consensus.cc:385] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.938529 22260 raft_consensus.cc:740] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.939414 22260 consensus_queue.cc:260] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.941718 22260 ts_tablet_manager.cc:1434] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:25:53.942621 22260 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:53.943009 22343 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.943784 22343 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.947948 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.948453 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.948661 22070 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
W20260709 12:25:53.949921 22111 leader_election.cc:343] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.950179 22343 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.950655 22111 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.951615 22343 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.950901 21966 catalog_manager.cc:5697] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.952836 22343 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.953747 22260 tablet_bootstrap.cc:654] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.953601 22343 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.960841 22262 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:53.961686 22262 ts_tablet_manager.cc:1403] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.017s
I20260709 12:25:53.964238 22333 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.964759 22333 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.966861 22333 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.969671 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:53.972312 22036 leader_election.cc:343] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.968776 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.974103 22146 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:53.975943 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:53.977454 22268 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.978000 22268 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.978484 22268 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.983809 22260 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:53.984354 22260 ts_tablet_manager.cc:1403] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.014s
I20260709 12:25:53.984845 22294 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.985355 22294 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.987578 22294 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.987792 22260 raft_consensus.cc:359] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.988480 22260 raft_consensus.cc:385] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.988741 22260 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.989703 22260 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.991050 22267 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.991492 22267 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:53.993449 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:53.995507 22267 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:53.995921 22146 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:53.997200 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:53.997443 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:53.997486 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:53.997872 22219 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.998373 22070 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:53.998587 22294 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.998988 22294 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.999194 22111 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:53.999421 22294 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.000715 22267 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.001099 22267 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.001468 22267 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.004292 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.005229 22260 ts_tablet_manager.cc:1434] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:25:54.005613 22217 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:54.006280 22260 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:54.015064 22267 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.015239 22262 raft_consensus.cc:359] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.015960 22262 raft_consensus.cc:385] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.016243 22262 raft_consensus.cc:740] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.017185 22267 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.018078 22262 consensus_queue.cc:260] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.019023 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:54.019589 22070 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.020295 22262 ts_tablet_manager.cc:1434] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.002s
I20260709 12:25:54.023370 22343 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.026175 22261 tablet_bootstrap.cc:492] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:54.026634 22261 ts_tablet_manager.cc:1403] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.122s	user 0.052s	sys 0.036s
I20260709 12:25:54.026226 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:54.027690 22262 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:54.027959 22071 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.031481 22260 tablet_bootstrap.cc:654] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.031968 22353 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.032800 22343 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.027092 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.033978 22294 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.035086 22217 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.035480 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.037489 22261 raft_consensus.cc:359] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.038192 22261 raft_consensus.cc:385] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.038398 22261 raft_consensus.cc:740] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.038875 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:54.039459 22146 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.039103 22261 consensus_queue.cc:260] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.050184 22261 ts_tablet_manager.cc:1434] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:25:54.056062 22262 tablet_bootstrap.cc:654] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:54.046089 22111 leader_election.cc:343] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.058336 22261 tablet_bootstrap.cc:492] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:54.064170 22333 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.064931 22333 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.068107 22146 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:54.069797 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:54.070915 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:54.071527 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.072396 22219 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:54.077517 22294 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.078325 22036 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:54.077234 22333 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.086788 22268 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.087532 22333 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.087961 22333 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.087670 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.088326 22333 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.088641 22219 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.090734 22217 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:54.082017 22070 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:54.093148 22111 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:54.060292 22071 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:54.094357 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.098599 22343 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.088953 22268 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.098212 22219 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:54.099217 22343 raft_consensus.cc:697] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
W20260709 12:25:54.100051 22036 leader_election.cc:343] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.100567 22111 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:54.100633 22333 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.106169 22267 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.106726 22267 raft_consensus.cc:697] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:54.107450 22343 consensus_queue.cc:237] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.107585 22267 consensus_queue.cc:237] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.108979 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.108846 22342 consensus_queue.cc:1048] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.110998 22333 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.112515 22260 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:54.098757 22294 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.113021 22260 ts_tablet_manager.cc:1403] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.107s	user 0.027s	sys 0.032s
I20260709 12:25:54.113224 22294 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:54.114123 22220 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.115628 22294 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.126147 22260 raft_consensus.cc:359] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.126780 22353 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.127298 22260 raft_consensus.cc:385] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.127851 22260 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.128862 22260 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.132241 22260 ts_tablet_manager.cc:1434] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:25:54.144755 22260 tablet_bootstrap.cc:492] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
W20260709 12:25:54.122141 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 51306.1us
I20260709 12:25:54.151603 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:54.153025 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:54.152426 22146 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.154615 22267 consensus_queue.cc:1048] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:25:54.155251 22035 leader_election.cc:343] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:54.171118 22035 leader_election.cc:343] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.178980 22146 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:54.171909 22267 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:54.180478 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:54.183353 22373 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.183866 22373 raft_consensus.cc:697] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:54.183151 21965 catalog_manager.cc:5697] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.184793 22373 consensus_queue.cc:237] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.199385 22342 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.226214 22342 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.240062 22261 tablet_bootstrap.cc:654] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.244735 22262 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:54.245536 22262 ts_tablet_manager.cc:1403] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.218s	user 0.019s	sys 0.040s
W20260709 12:25:54.242113 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 61743.3us
I20260709 12:25:54.262253 22262 raft_consensus.cc:359] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.266449 22220 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:54.280705 22260 tablet_bootstrap.cc:654] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.288324 22262 raft_consensus.cc:385] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.274899 22333 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.288678 22262 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.296765 22262 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.301789 22342 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.302408 22342 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.289776 22036 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:54.302004 22262 ts_tablet_manager.cc:1434] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:25:54.331223 22287 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.331965 22287 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.334950 22287 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.338783 22261 tablet_bootstrap.cc:492] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:54.338929 22262 tablet_bootstrap.cc:492] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:54.339313 22261 ts_tablet_manager.cc:1403] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.281s	user 0.017s	sys 0.003s
I20260709 12:25:54.291589 22333 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.340129 22268 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:54.344811 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 55214us
I20260709 12:25:54.352429 22268 raft_consensus.cc:697] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:54.356112 22342 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.361537 22268 consensus_queue.cc:237] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.361922 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.362646 22220 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:54.369513 22261 raft_consensus.cc:359] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.370757 22261 raft_consensus.cc:385] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.371230 22261 raft_consensus.cc:740] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.377068 22261 consensus_queue.cc:260] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.386600 22261 ts_tablet_manager.cc:1434] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 12:25:54.388144 22261 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:54.388674 21965 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.390560 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:54.391242 22068 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:54.404134 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:54.406409 22035 leader_election.cc:343] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.407636 22333 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.406740 22261 tablet_bootstrap.cc:654] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.414098 22260 tablet_bootstrap.cc:492] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:54.414547 22260 ts_tablet_manager.cc:1403] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.281s	user 0.033s	sys 0.012s
W20260709 12:25:54.411021 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 49746.9us
I20260709 12:25:54.420507 22266 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.425865 22260 raft_consensus.cc:359] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.426205 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:54.429306 22036 leader_election.cc:343] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.429682 22262 tablet_bootstrap.cc:654] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.429817 22036 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:54.426649 22260 raft_consensus.cc:385] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.430853 22260 raft_consensus.cc:740] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.431613 22333 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.432668 22260 consensus_queue.cc:260] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.442248 21965 catalog_manager.cc:5697] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.443904 22260 ts_tablet_manager.cc:1434] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:25:54.445614 22260 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:54.434207 22111 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:54.444945 21965 catalog_manager.cc:5697] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.446478 22287 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.447005 22287 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.447642 22287 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.450820 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:54.451525 22071 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:54.461704 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.462903 22287 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.474198 22261 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:54.474782 22261 ts_tablet_manager.cc:1403] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.008s
I20260709 12:25:54.475908 22287 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.474318 22262 tablet_bootstrap.cc:492] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:54.476689 22262 ts_tablet_manager.cc:1403] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.004s
I20260709 12:25:54.478018 22261 raft_consensus.cc:359] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.479983 22262 raft_consensus.cc:359] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.482450 21966 catalog_manager.cc:5697] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.484401 22261 raft_consensus.cc:385] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.484480 22262 raft_consensus.cc:385] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.484968 22261 raft_consensus.cc:740] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.484992 22262 raft_consensus.cc:740] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.485967 22261 consensus_queue.cc:260] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.486433 22262 consensus_queue.cc:260] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.488431 22261 ts_tablet_manager.cc:1434] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:25:54.489147 22262 ts_tablet_manager.cc:1434] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:54.489596 22261 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:54.490219 22262 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:54.490324 22287 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.490967 22287 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.493119 22287 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.496804 22260 tablet_bootstrap.cc:654] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.497157 22262 tablet_bootstrap.cc:654] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.483747 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:54.500062 22287 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.500463 22287 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.500808 22287 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.502539 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:54.503227 22071 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.503415 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.504050 22216 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.505432 22266 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.510607 22287 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.511511 22216 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:54.510861 22071 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:54.511629 22261 tablet_bootstrap.cc:654] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.517156 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:54.517820 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.517983 22287 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.518633 22216 raft_consensus.cc:2393] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 1: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
W20260709 12:25:54.519910 22111 leader_election.cc:343] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.521267 22287 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:25:54.524008 22111 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:25:54.524784 22343 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.525388 22343 raft_consensus.cc:697] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:54.526491 22343 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.532685 22260 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:54.533274 22260 ts_tablet_manager.cc:1403] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.003s
I20260709 12:25:54.533347 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:54.535476 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.547223 22071 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.538126 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:54.540657 22353 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.548111 22353 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.550246 22353 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:54.551080 22287 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.552022 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:54.552922 22069 raft_consensus.cc:2393] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:25:54.558099 22260 raft_consensus.cc:359] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.558542 22071 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:54.558877 22260 raft_consensus.cc:385] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.559343 22260 raft_consensus.cc:740] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.560191 22260 consensus_queue.cc:260] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.562676 22260 ts_tablet_manager.cc:1434] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:25:54.566637 22260 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:54.566968 22287 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.568192 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:54.569525 22111 leader_election.cc:343] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.570274 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:54.571442 22388 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.571924 22388 raft_consensus.cc:697] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:54.572781 22388 consensus_queue.cc:237] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.577523 22260 tablet_bootstrap.cc:654] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.580333 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:54.581046 22353 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.583003 22262 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:54.583451 22262 ts_tablet_manager.cc:1403] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.003s
I20260709 12:25:54.588255 22262 raft_consensus.cc:359] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.589143 22262 raft_consensus.cc:385] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.589681 22262 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.590989 22261 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:54.591333 22261 ts_tablet_manager.cc:1403] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.102s	user 0.006s	sys 0.012s
I20260709 12:25:54.590688 22268 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:54.593531 22262 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.595757 22262 ts_tablet_manager.cc:1434] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:25:54.597426 22261 raft_consensus.cc:359] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.598001 22261 raft_consensus.cc:385] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.598245 22261 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.599200 22262 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:54.599236 22261 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.597595 21967 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.607693 22261 ts_tablet_manager.cc:1434] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:25:54.608455 22261 tablet_bootstrap.cc:492] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:54.612380 22314 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.613807 22314 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.614816 22261 tablet_bootstrap.cc:654] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.616348 22314 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:54.616638 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:54.620854 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:54.620945 22287 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.621634 22146 raft_consensus.cc:2393] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:25:54.621809 22353 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.624575 22185 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:54.625801 22266 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.626833 22342 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.628582 22268 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.621654 22287 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.635742 22333 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.635962 22287 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.636439 22333 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.642114 22333 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.645407 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:54.646746 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:54.647589 22035 leader_election.cc:343] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:54.648882 22036 leader_election.cc:343] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.649525 22036 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:54.650544 22268 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.664148 22262 tablet_bootstrap.cc:654] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.677351 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:54.684116 22373 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.692653 22266 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.685566 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.695516 21965 catalog_manager.cc:5697] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.700253 22260 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:54.699843 22342 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.700834 22260 ts_tablet_manager.cc:1403] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.007s
I20260709 12:25:54.706634 22260 raft_consensus.cc:359] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.707377 22260 raft_consensus.cc:385] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.707727 22260 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.708461 22260 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:54.710386 22111 leader_election.cc:343] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.710666 22260 ts_tablet_manager.cc:1434] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:54.722810 22260 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:54.722640 22342 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.724068 22342 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.717342 22333 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.718210 22262 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:54.721689 22261 tablet_bootstrap.cc:492] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:54.726891 22262 ts_tablet_manager.cc:1403] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.130s	user 0.005s	sys 0.010s
I20260709 12:25:54.726925 22261 ts_tablet_manager.cc:1403] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.000s
W20260709 12:25:54.724893 22111 leader_election.cc:343] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.731030 22111 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:54.731935 22342 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.732688 22262 raft_consensus.cc:359] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.733466 22262 raft_consensus.cc:385] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.733789 22262 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.733932 22260 tablet_bootstrap.cc:654] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.734512 22262 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.741375 22262 ts_tablet_manager.cc:1434] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:25:54.742357 22262 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:54.755391 22260 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:54.755461 22262 tablet_bootstrap.cc:654] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.756098 22260 ts_tablet_manager.cc:1403] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 12:25:54.760097 22260 raft_consensus.cc:359] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.761126 22260 raft_consensus.cc:385] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.761600 22260 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.762663 22260 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.765880 22260 ts_tablet_manager.cc:1434] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:25:54.767742 22373 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.768519 22373 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.771780 22373 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.772382 22260 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:54.772754 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:54.773022 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:54.774555 22035 leader_election.cc:343] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:54.775103 22036 leader_election.cc:343] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.775672 22036 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:54.792721 22261 raft_consensus.cc:359] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.793455 22261 raft_consensus.cc:385] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.793844 22261 raft_consensus.cc:740] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.794488 22261 consensus_queue.cc:260] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.796723 22373 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.800258 22333 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.800729 22333 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.801230 22373 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.802814 22333 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.807521 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:54.808216 22146 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:54.808729 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.817449 22261 ts_tablet_manager.cc:1434] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 12:25:54.818288 22261 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:54.816767 22035 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:54.821374 22373 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.821864 22373 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.822346 22373 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.814224 22333 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 12:25:54.827255 22036 leader_election.cc:343] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.834489 22262 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:54.845487 22262 ts_tablet_manager.cc:1403] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.012s
I20260709 12:25:54.854166 22260 tablet_bootstrap.cc:654] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.858211 22373 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.859313 22333 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.859853 22333 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.860340 22373 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.861050 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:54.861639 22146 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.862061 22333 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.864692 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:54.866112 22035 leader_election.cc:343] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.871335 22261 tablet_bootstrap.cc:654] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.876653 22262 raft_consensus.cc:359] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.877393 22262 raft_consensus.cc:385] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.877669 22262 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.882884 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.883548 22218 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:54.885525 22262 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.889078 22036 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:54.889196 22146 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:54.890588 22268 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.890990 22268 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.890589 22262 ts_tablet_manager.cc:1434] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:25:54.891332 22268 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.892144 22262 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:54.893481 22035 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:54.880973 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.904460 22373 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.910127 22373 raft_consensus.cc:697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:54.915235 22260 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:54.915832 22260 ts_tablet_manager.cc:1403] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.007s
I20260709 12:25:54.923681 22262 tablet_bootstrap.cc:654] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.921339 22373 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.918404 22268 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.927440 22268 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:25:54.929553 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:54.931650 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:54.934474 22261 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:54.935072 22261 ts_tablet_manager.cc:1403] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.001s
W20260709 12:25:54.935674 22035 leader_election.cc:343] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.938776 22261 raft_consensus.cc:359] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.939749 22261 raft_consensus.cc:385] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.940096 22261 raft_consensus.cc:740] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.940510 22260 raft_consensus.cc:359] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.941256 22260 raft_consensus.cc:385] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.941599 22260 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.940990 22261 consensus_queue.cc:260] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.942417 22260 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.943744 22261 ts_tablet_manager.cc:1434] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:25:54.944757 22261 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:54.945007 22260 ts_tablet_manager.cc:1434] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:25:54.945266 22266 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:54.945694 22036 leader_election.cc:343] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.945711 22266 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.947927 22266 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:54.950758 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:54.954743 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:54.955574 22068 raft_consensus.cc:2393] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:25:54.956923 22342 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.957158 22185 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:54.959510 22266 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.950439 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:54.965838 22268 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.965783 22220 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.966527 22268 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.969275 22261 tablet_bootstrap.cc:654] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.970736 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:54.974108 22220 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
W20260709 12:25:54.974228 22035 leader_election.cc:343] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.975184 22036 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:54.975828 22268 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:54.976323 22268 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.977146 22268 raft_consensus.cc:697] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:54.977325 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:54.981003 22268 consensus_queue.cc:237] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.947930 22260 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
W20260709 12:25:54.981498 22036 leader_election.cc:343] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.989830 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:54.989840 22266 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.990953 22262 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:54.991421 22262 ts_tablet_manager.cc:1403] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.006s
I20260709 12:25:54.994057 22262 raft_consensus.cc:359] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.994174 22342 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.994736 22262 raft_consensus.cc:385] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.995028 22262 raft_consensus.cc:740] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.995406 22373 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.995669 22262 consensus_queue.cc:260] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:54.998184 22262 ts_tablet_manager.cc:1434] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:54.999054 22262 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:55.002903 22261 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.003388 22261 ts_tablet_manager.cc:1403] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.004s
I20260709 12:25:55.003612 22260 tablet_bootstrap.cc:654] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.006052 22261 raft_consensus.cc:359] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.008826 21967 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.006767 22261 raft_consensus.cc:385] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.011700 22261 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.012523 22261 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.014111 22262 tablet_bootstrap.cc:654] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.025043 22260 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.025641 22260 ts_tablet_manager.cc:1403] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.003s
I20260709 12:25:55.029285 22261 ts_tablet_manager.cc:1434] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:25:55.030215 22261 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.030495 22262 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:55.030957 22262 ts_tablet_manager.cc:1403] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.011s
I20260709 12:25:55.034283 22262 raft_consensus.cc:359] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.034999 22262 raft_consensus.cc:385] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.035261 22262 raft_consensus.cc:740] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.035871 22262 consensus_queue.cc:260] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.036408 22261 tablet_bootstrap.cc:654] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.038594 22262 ts_tablet_manager.cc:1434] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:55.039548 22262 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:55.036455 21966 catalog_manager.cc:5697] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.041538 22260 raft_consensus.cc:359] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.042207 22260 raft_consensus.cc:385] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.042488 22260 raft_consensus.cc:740] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.043174 22260 consensus_queue.cc:260] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.044855 22262 tablet_bootstrap.cc:654] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.045753 22261 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.046180 22261 ts_tablet_manager.cc:1403] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:25:55.048538 22261 raft_consensus.cc:359] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.049154 22261 raft_consensus.cc:385] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.049491 22261 raft_consensus.cc:740] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.050593 22260 ts_tablet_manager.cc:1434] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:25:55.050256 22261 consensus_queue.cc:260] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.051728 22260 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.056118 22342 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.058866 22260 tablet_bootstrap.cc:654] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.066990 22261 ts_tablet_manager.cc:1434] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 12:25:55.068010 22261 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.074090 22260 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.074687 22260 ts_tablet_manager.cc:1403] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:25:55.077275 22261 tablet_bootstrap.cc:654] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.077435 22260 raft_consensus.cc:359] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.078318 22260 raft_consensus.cc:385] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.078655 22260 raft_consensus.cc:740] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.079471 22260 consensus_queue.cc:260] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.082341 22260 ts_tablet_manager.cc:1434] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:55.085153 22260 tablet_bootstrap.cc:492] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.088094 22387 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.090642 22268 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.091280 22260 tablet_bootstrap.cc:654] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.091179 22268 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.093391 22268 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.095403 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:55.097502 22035 leader_election.cc:343] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.099730 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:55.101320 22036 leader_election.cc:343] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.101778 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.103387 22268 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.103802 22262 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:55.104266 22262 ts_tablet_manager.cc:1403] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.008s
I20260709 12:25:55.117914 22260 tablet_bootstrap.cc:492] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.118955 22260 ts_tablet_manager.cc:1403] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.003s
I20260709 12:25:55.119961 22262 raft_consensus.cc:359] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.120694 22262 raft_consensus.cc:385] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.120980 22262 raft_consensus.cc:740] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.121577 22260 raft_consensus.cc:359] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.122253 22260 raft_consensus.cc:385] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.122558 22260 raft_consensus.cc:740] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.123207 22260 consensus_queue.cc:260] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.124253 22261 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.124758 22261 ts_tablet_manager.cc:1403] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.005s
I20260709 12:25:55.125254 22260 ts_tablet_manager.cc:1434] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:55.126156 22260 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.127516 22261 raft_consensus.cc:359] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.128015 22261 raft_consensus.cc:385] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.128307 22261 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.128904 22261 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.130919 22261 ts_tablet_manager.cc:1434] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:55.131834 22261 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.132256 22260 tablet_bootstrap.cc:654] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.137358 22260 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.137537 22261 tablet_bootstrap.cc:654] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.121750 22262 consensus_queue.cc:260] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.137836 22260 ts_tablet_manager.cc:1403] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:25:55.141281 22260 raft_consensus.cc:359] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.141939 22260 raft_consensus.cc:385] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.142195 22260 raft_consensus.cc:740] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.142969 22260 consensus_queue.cc:260] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.145871 22262 ts_tablet_manager.cc:1434] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:25:55.145987 22260 ts_tablet_manager.cc:1434] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:55.147106 22260 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.147415 22262 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:55.152940 22260 tablet_bootstrap.cc:654] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.156263 22262 tablet_bootstrap.cc:654] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.158869 22260 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.159304 22260 ts_tablet_manager.cc:1403] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:25:55.161738 22260 raft_consensus.cc:359] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.162370 22260 raft_consensus.cc:385] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.162657 22260 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.163267 22260 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.165026 22260 ts_tablet_manager.cc:1434] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:25:55.165926 22260 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.168084 22261 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.169366 22261 ts_tablet_manager.cc:1403] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.006s
I20260709 12:25:55.170985 22387 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.171468 22387 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.173575 22261 raft_consensus.cc:359] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.174145 22387 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.174507 22261 raft_consensus.cc:385] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.174806 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.175570 22068 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:55.176586 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:55.178149 22111 leader_election.cc:343] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.178761 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.179523 22387 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.179877 22387 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.180200 22387 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.180320 22260 tablet_bootstrap.cc:654] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.174892 22261 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.181725 22261 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.184351 22261 ts_tablet_manager.cc:1434] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:25:55.185487 22261 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.187222 22387 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.189237 22387 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.190487 22262 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:55.190991 22262 ts_tablet_manager.cc:1403] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.013s
I20260709 12:25:55.192922 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:55.193732 22068 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.193956 22262 raft_consensus.cc:359] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.194741 22262 raft_consensus.cc:385] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.195008 22262 raft_consensus.cc:740] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.195613 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:55.195781 22262 consensus_queue.cc:260] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:55.197300 22111 leader_election.cc:343] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.198189 22262 ts_tablet_manager.cc:1434] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:55.199501 22262 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:55.201066 22068 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:55.203399 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.204690 22387 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.205567 22387 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:55.206645 22387 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.213093 22261 tablet_bootstrap.cc:654] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.224427 22262 tablet_bootstrap.cc:654] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.229391 22261 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.229450 22260 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.230161 22260 ts_tablet_manager.cc:1403] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.008s
I20260709 12:25:55.232636 22261 ts_tablet_manager.cc:1403] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260709 12:25:55.232898 22260 raft_consensus.cc:359] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.233673 22260 raft_consensus.cc:385] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.233947 22260 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.234624 22260 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.238097 22262 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:55.238544 22262 ts_tablet_manager.cc:1403] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.010s
I20260709 12:25:55.238857 22260 ts_tablet_manager.cc:1434] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:55.239566 22260 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.236806 22261 raft_consensus.cc:359] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.241921 22261 raft_consensus.cc:385] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.242364 22261 raft_consensus.cc:740] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.241909 22262 raft_consensus.cc:359] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.242767 22262 raft_consensus.cc:385] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.243049 22262 raft_consensus.cc:740] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.243237 22261 consensus_queue.cc:260] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.243705 22262 consensus_queue.cc:260] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.245571 22261 ts_tablet_manager.cc:1434] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:55.246583 22260 tablet_bootstrap.cc:654] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.244515 21965 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.250532 22262 ts_tablet_manager.cc:1434] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:25:55.251488 22262 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:55.257306 22268 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.257982 22268 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.260308 22268 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.264729 22261 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.266197 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.266868 22144 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:55.268030 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.268872 22220 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:55.271984 22261 tablet_bootstrap.cc:654] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.272370 22035 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.273334 22268 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.273725 22268 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.274093 22268 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.283696 22262 tablet_bootstrap.cc:654] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.288712 22260 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.288754 22268 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.289151 22314 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.289803 22314 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.291821 22314 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.292153 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:55.292976 22144 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.294656 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:25:55.296124 22185 leader_election.cc:343] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.296852 22387 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.289319 22260 ts_tablet_manager.cc:1403] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.018s
I20260709 12:25:55.297356 22387 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.297827 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.298816 22373 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.299531 22387 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.299460 22373 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.300228 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.300875 22068 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:55.302057 22111 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.302493 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.303788 22342 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:55.303901 22111 leader_election.cc:343] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.304224 22342 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.304754 22342 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.304661 22260 raft_consensus.cc:359] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.305426 22260 raft_consensus.cc:385] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.305716 22260 raft_consensus.cc:740] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.310194 22260 consensus_queue.cc:260] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.312072 22260 ts_tablet_manager.cc:1434] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:25:55.312071 22146 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:55.313345 22184 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.313613 22373 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.314086 22260 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.314491 22314 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.314862 22314 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.315189 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.316051 22146 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:55.318917 22035 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.315200 22314 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.320669 22333 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.321027 22333 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.321378 22333 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.322939 22387 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.323396 22387 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.325395 22387 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.327076 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.316602 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.327937 22216 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
W20260709 12:25:55.328492 22111 leader_election.cc:343] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.329959 22260 tablet_bootstrap.cc:654] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.330307 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.331019 22068 raft_consensus.cc:2468] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:55.333894 22111 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.336714 22387 raft_consensus.cc:2804] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.337203 22387 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.337656 22387 raft_consensus.cc:3060] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.341965 22260 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.342432 22260 ts_tablet_manager.cc:1403] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 12:25:55.342310 22287 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.342924 22287 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.344202 22314 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.344959 22287 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.345113 22260 raft_consensus.cc:359] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.345803 22260 raft_consensus.cc:385] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.346087 22260 raft_consensus.cc:740] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.346740 22260 consensus_queue.cc:260] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.347189 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.348482 22144 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:55.349152 22260 ts_tablet_manager.cc:1434] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:55.349929 22035 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.350512 22260 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.350817 22418 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:55.351212 22111 leader_election.cc:343] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.351276 22418 raft_consensus.cc:697] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:55.351964 22287 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.352382 22287 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.352335 22418 consensus_queue.cc:237] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.354048 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.356559 22287 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.356842 22260 tablet_bootstrap.cc:654] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.361603 22268 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.362150 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:55.368870 22220 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.371352 22262 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:55.374734 22262 ts_tablet_manager.cc:1403] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.001s
I20260709 12:25:55.373998 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:25:55.378084 22185 leader_election.cc:343] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.378289 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.340427 22342 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.380111 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.380697 22260 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.380858 22218 raft_consensus.cc:2393] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 1: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:25:55.380784 22342 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.381229 22260 ts_tablet_manager.cc:1403] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.012s
W20260709 12:25:55.382325 22111 leader_election.cc:343] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.382822 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.386449 22262 raft_consensus.cc:359] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.387357 22262 raft_consensus.cc:385] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.387702 22262 raft_consensus.cc:740] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.387941 21966 catalog_manager.cc:5697] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.389948 22314 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.384280 22260 raft_consensus.cc:359] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.392211 22260 raft_consensus.cc:385] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.392328 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:55.392916 22071 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.393364 22261 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.393807 22261 ts_tablet_manager.cc:1403] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.129s	user 0.056s	sys 0.037s
I20260709 12:25:55.393805 22262 consensus_queue.cc:260] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.396466 22261 raft_consensus.cc:359] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.396868 22262 ts_tablet_manager.cc:1434] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:25:55.397123 22261 raft_consensus.cc:385] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.397444 22261 raft_consensus.cc:740] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.397815 22262 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:55.398121 22261 consensus_queue.cc:260] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.400187 22261 ts_tablet_manager.cc:1434] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:25:55.400259 22071 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:55.392503 22260 raft_consensus.cc:740] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.401842 22261 tablet_bootstrap.cc:492] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.401780 22287 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.401286 22260 consensus_queue.cc:260] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.397665 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:55.404611 22260 ts_tablet_manager.cc:1434] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:25:55.405535 22260 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.410396 22333 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.412189 22260 tablet_bootstrap.cc:654] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.428205 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:55.428619 22333 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.428818 22146 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.427706 22220 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:55.413830 22262 tablet_bootstrap.cc:654] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.430673 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:55.431318 22218 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.414886 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:55.432291 22144 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.436530 22260 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.437016 22260 ts_tablet_manager.cc:1403] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.007s
I20260709 12:25:55.439733 22218 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:55.440997 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.441821 22260 raft_consensus.cc:359] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.442489 22260 raft_consensus.cc:385] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.442734 22260 raft_consensus.cc:740] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.443368 22260 consensus_queue.cc:260] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.443768 22333 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.444988 22314 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.445735 22333 raft_consensus.cc:697] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:55.447271 22260 ts_tablet_manager.cc:1434] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:55.417402 22216 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.420997 22261 tablet_bootstrap.cc:654] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.424130 22387 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.445466 22314 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.415095 22111 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.447453 22146 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:55.448005 22333 consensus_queue.cc:237] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.450696 22314 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.451064 22387 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.451143 22342 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.452661 22260 tablet_bootstrap.cc:492] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.451449 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.453455 22071 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:55.454912 22185 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.456167 22314 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.456666 22314 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.457111 22314 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.466924 22260 tablet_bootstrap.cc:654] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.473476 22342 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:55.451968 22111 leader_election.cc:343] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.476373 22353 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.476868 22353 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.476914 21965 catalog_manager.cc:5697] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.480882 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.481585 22071 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:55.482627 22353 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.483536 22185 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.484395 22353 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.484185 22314 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.484793 22353 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.485152 22353 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.448873 22144 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:55.495432 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:55.496284 22069 raft_consensus.cc:3060] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.503780 22342 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.503547 22353 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.504277 22418 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.504395 22342 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.505577 22387 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.506192 22387 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.507567 22342 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.508756 22387 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.513006 22260 tablet_bootstrap.cc:492] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.514874 22260 ts_tablet_manager.cc:1403] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.002s
I20260709 12:25:55.515231 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:55.515863 22071 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.517829 22260 raft_consensus.cc:359] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.514183 22353 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.519008 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:55.528561 22260 raft_consensus.cc:385] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.529136 22260 raft_consensus.cc:740] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.530009 22260 consensus_queue.cc:260] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.526515 22071 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:55.527040 22418 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.531687 22185 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.532039 22342 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.532629 22353 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.532502 22342 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.534624 22342 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.512598 22333 consensus_queue.cc:1048] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.519404 22266 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.536563 22260 ts_tablet_manager.cc:1434] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:25:55.536247 22266 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.537660 22260 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.540299 22314 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.541723 22266 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.541896 22111 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.542837 22342 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.544513 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.545709 22260 tablet_bootstrap.cc:654] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.547843 22261 tablet_bootstrap.cc:492] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.548317 22261 ts_tablet_manager.cc:1403] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.147s	user 0.036s	sys 0.020s
I20260709 12:25:55.550197 22342 raft_consensus.cc:697] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:55.551185 22342 consensus_queue.cc:237] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.551553 22261 raft_consensus.cc:359] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.551406 22314 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.552179 22261 raft_consensus.cc:385] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.552520 22261 raft_consensus.cc:740] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.552538 22314 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.555423 22314 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.556589 22261 consensus_queue.cc:260] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.560127 22261 ts_tablet_manager.cc:1434] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:25:55.561093 22261 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.560840 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.561744 22068 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:55.563760 22069 raft_consensus.cc:2468] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:55.564160 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.567239 22314 raft_consensus.cc:2804] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.567631 22314 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.568051 22314 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.568826 22111 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.571409 22447 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.572038 22447 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.572606 22388 raft_consensus.cc:2804] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.573350 22388 raft_consensus.cc:697] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:55.574246 22388 consensus_queue.cc:237] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.575197 22262 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:55.575655 22262 ts_tablet_manager.cc:1403] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.178s	user 0.029s	sys 0.042s
I20260709 12:25:55.578675 22262 raft_consensus.cc:359] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.579337 22262 raft_consensus.cc:385] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.579627 22262 raft_consensus.cc:740] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.578900 22447 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.580554 22262 consensus_queue.cc:260] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.582333 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.588591 22387 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.591315 22387 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.591879 22262 ts_tablet_manager.cc:1434] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:55.592934 22262 tablet_bootstrap.cc:492] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
W20260709 12:25:55.584038 22036 leader_election.cc:343] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.583977 22447 consensus_queue.cc:1048] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:25:55.596134 22387 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.596598 22261 tablet_bootstrap.cc:654] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.598630 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:55.599329 22141 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.599440 22353 raft_consensus.cc:697] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:55.600358 22353 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.601940 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:55.601775 22184 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.602566 22071 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.611578 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.612366 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.603466 22314 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.608898 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.614403 22069 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:55.615139 22314 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.609148 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.618541 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.619863 22138 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
W20260709 12:25:55.620322 22035 leader_election.cc:343] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.620651 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:55.620833 22035 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.621272 22140 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:55.622367 22111 leader_election.cc:343] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:55.623970 22111 leader_election.cc:343] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.626523 22111 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.623085 22333 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.627614 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.628319 22342 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.637719 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.633947 22418 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.633420 22287 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.634562 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.648494 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.649462 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.643867 22456 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.650893 22456 raft_consensus.cc:697] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:55.640920 22342 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.641693 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:55.642879 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:55.644220 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.645009 22287 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:55.663301 22111 leader_election.cc:343] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.663692 22220 raft_consensus.cc:2393] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 1: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:25:55.667356 22111 leader_election.cc:343] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.667711 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.651998 22456 consensus_queue.cc:237] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.662144 22144 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.653839 22418 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.662680 22287 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.665931 22068 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.669212 22387 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.719020 22342 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.714012 22184 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.725383 22418 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.727087 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.728572 22262 tablet_bootstrap.cc:654] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.729969 22353 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:55.739866 22035 leader_election.cc:343] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.746578 22261 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:55.744580 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.749351 22261 ts_tablet_manager.cc:1403] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.188s	user 0.016s	sys 0.000s
I20260709 12:25:55.749462 22260 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.750844 22260 ts_tablet_manager.cc:1403] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.213s	user 0.037s	sys 0.066s
I20260709 12:25:55.762321 22141 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:55.762411 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.762270 22266 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.763377 22266 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.765367 22266 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:55.767134 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.772938 22260 raft_consensus.cc:359] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.773947 22260 raft_consensus.cc:385] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.774288 22260 raft_consensus.cc:740] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.775151 22260 consensus_queue.cc:260] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.776677 22068 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:55.768023 22071 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:55.780637 22144 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:55.784498 22185 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.785885 22266 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.786540 22266 raft_consensus.cc:697] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:55.787706 22266 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.780290 22111 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.794225 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.795771 22140 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
W20260709 12:25:55.800715 22185 leader_election.cc:343] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.801690 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.804634 22314 raft_consensus.cc:2804] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.805212 22314 raft_consensus.cc:697] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:55.806069 22314 consensus_queue.cc:237] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.806669 22260 ts_tablet_manager.cc:1434] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:25:55.808758 22260 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:55.810122 22111 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.811440 22261 raft_consensus.cc:359] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.812037 22261 raft_consensus.cc:385] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.812273 22466 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.812297 22261 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.813162 22261 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.814651 22261 ts_tablet_manager.cc:1434] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:25:55.816020 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.818464 22260 tablet_bootstrap.cc:654] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.821095 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:55.823197 22464 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.828635 22261 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:55.837191 22287 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:55.838611 22036 leader_election.cc:343] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.839083 22036 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.839440 22287 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.839844 22447 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.844653 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.853588 22268 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.862854 21965 catalog_manager.cc:5697] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.874365 21965 catalog_manager.cc:5697] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:55.882443 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 61124.2us
W20260709 12:25:55.883320 22111 leader_election.cc:343] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:55.884873 22184 leader_election.cc:343] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.885339 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.887670 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:55.888502 22457 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.888661 22065 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:55.890966 22111 leader_election.cc:343] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.891561 22111 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:55.883661 22287 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.893411 22343 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.899132 22262 tablet_bootstrap.cc:492] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:55.899547 22262 ts_tablet_manager.cc:1403] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.307s	user 0.016s	sys 0.010s
I20260709 12:25:55.904639 22219 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.908736 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:55.895685 22287 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.913139 22287 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:55.914114 22261 tablet_bootstrap.cc:654] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.918665 22466 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.921525 22470 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:55.922003 22111 leader_election.cc:343] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.924103 22260 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:55.924573 22260 ts_tablet_manager.cc:1403] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.116s	user 0.025s	sys 0.022s
I20260709 12:25:55.925450 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:55.925325 21963 catalog_manager.cc:5697] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.933132 22260 raft_consensus.cc:359] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.943253 22260 raft_consensus.cc:385] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.943605 22260 raft_consensus.cc:740] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.944346 22260 consensus_queue.cc:260] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.944460 22262 raft_consensus.cc:359] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.945406 22262 raft_consensus.cc:385] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.945765 22262 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.926082 22070 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:55.947384 22262 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.950960 22262 ts_tablet_manager.cc:1434] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:25:55.952236 22262 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:55.955915 22260 ts_tablet_manager.cc:1434] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:25:55.956543 22111 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:55.956935 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:55.960668 22287 raft_consensus.cc:2804] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.961038 22287 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.961390 22287 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.962047 22065 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:55.976070 22111 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:55.977824 22388 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.977756 22470 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.978544 22388 raft_consensus.cc:697] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:55.979449 22388 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:55.982074 22260 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
W20260709 12:25:55.987089 22111 leader_election.cc:343] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.019996 22262 tablet_bootstrap.cc:654] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:56.027916 22111 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:56.028486 22111 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.032866 22261 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:56.033408 22261 ts_tablet_manager.cc:1403] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.205s	user 0.016s	sys 0.015s
I20260709 12:25:56.036034 22261 raft_consensus.cc:359] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.036720 22261 raft_consensus.cc:385] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.037009 22261 raft_consensus.cc:740] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.036813 22268 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.037870 22261 consensus_queue.cc:260] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.038616 21963 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.040216 22261 ts_tablet_manager.cc:1434] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:56.041193 22261 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:56.046905 21965 catalog_manager.cc:5697] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.050179 22342 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.049404 21965 catalog_manager.cc:5697] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.042433 22472 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:25:56.051846 21965 catalog_manager.cc:5697] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.053431 22465 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:56.029516 22287 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.069434 22373 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.071556 22373 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.079963 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:56.081696 22035 leader_election.cc:343] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.083465 22262 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:56.083922 22262 ts_tablet_manager.cc:1403] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.008s
I20260709 12:25:56.084666 22373 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.090459 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.094386 22266 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.094877 22266 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.095927 22261 tablet_bootstrap.cc:654] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.097102 22266 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:56.098721 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.105928 22260 tablet_bootstrap.cc:654] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:56.109308 22036 leader_election.cc:343] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.109783 22036 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:56.110868 22373 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.116322 22262 raft_consensus.cc:359] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.118675 22262 raft_consensus.cc:385] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.119051 22262 raft_consensus.cc:740] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.120397 22262 consensus_queue.cc:260] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.120808 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.118232 22287 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.122947 22262 ts_tablet_manager.cc:1434] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 12:25:56.123879 22260 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:56.124313 22260 ts_tablet_manager.cc:1403] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.000s
I20260709 12:25:56.125428 22262 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:56.126900 22260 raft_consensus.cc:359] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.127589 22260 raft_consensus.cc:385] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.127857 22260 raft_consensus.cc:740] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.129561 22184 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.129992 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:56.130617 22068 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.130676 22266 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.131439 22261 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:56.131882 22261 ts_tablet_manager.cc:1403] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.009s
I20260709 12:25:56.128486 22260 consensus_queue.cc:260] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:56.135797 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:56.140705 22068 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:56.143692 22261 raft_consensus.cc:359] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.145431 22261 raft_consensus.cc:385] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.145741 22261 raft_consensus.cc:740] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
W20260709 12:25:56.175545 22185 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.195824 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:56.195147 22261 consensus_queue.cc:260] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.203912 22261 ts_tablet_manager.cc:1434] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.072s	user 0.015s	sys 0.020s
I20260709 12:25:56.204778 22261 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:56.206128 22266 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.210947 22261 tablet_bootstrap.cc:654] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.212950 22260 ts_tablet_manager.cc:1434] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 12:25:56.213296 22266 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.213871 22260 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:56.213757 22266 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.218236 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.218412 22266 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:25:56.219190 22111 leader_election.cc:343] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.230041 22262 tablet_bootstrap.cc:654] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.235049 22111 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:56.235154 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.235893 22387 raft_consensus.cc:2804] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.236553 22387 raft_consensus.cc:697] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:56.237381 22387 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.241677 22261 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:56.242138 22261 ts_tablet_manager.cc:1403] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.015s
I20260709 12:25:56.247991 22261 raft_consensus.cc:359] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.248737 22261 raft_consensus.cc:385] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.249023 22261 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.249740 22261 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.251609 22184 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.252287 22261 ts_tablet_manager.cc:1434] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:56.252728 22266 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.253347 22261 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:56.253960 22262 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:56.255330 22266 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.259723 22261 tablet_bootstrap.cc:654] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.260221 22262 ts_tablet_manager.cc:1403] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.010s
I20260709 12:25:56.267725 22262 raft_consensus.cc:359] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.268396 22262 raft_consensus.cc:385] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.268684 22262 raft_consensus.cc:740] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.269402 22262 consensus_queue.cc:260] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.271258 22262 ts_tablet_manager.cc:1434] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:56.271186 22373 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.271728 22373 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.272207 22262 tablet_bootstrap.cc:492] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:56.264810 22261 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:56.273483 22261 ts_tablet_manager.cc:1403] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:25:56.275424 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.276322 22260 tablet_bootstrap.cc:654] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.276131 22261 raft_consensus.cc:359] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:56.276820 22036 leader_election.cc:343] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.276804 22261 raft_consensus.cc:385] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.277671 22261 raft_consensus.cc:740] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.278092 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.278347 22261 consensus_queue.cc:260] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.278712 22140 raft_consensus.cc:2468] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:56.279600 22388 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.279493 22456 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.280421 22261 ts_tablet_manager.cc:1434] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:25:56.280071 22388 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.281409 22261 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:56.282428 22388 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.290313 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.290989 21963 catalog_manager.cc:5697] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.291893 22261 tablet_bootstrap.cc:654] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:56.291822 22111 leader_election.cc:343] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.293716 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:56.295024 22111 leader_election.cc:343] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.295433 22111 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.298564 22262 tablet_bootstrap.cc:654] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.301450 22035 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:56.297214 22387 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.303097 22418 raft_consensus.cc:2804] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.302971 22266 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.303509 22418 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.298935 22373 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.303898 22418 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.308107 22260 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:56.308593 22260 ts_tablet_manager.cc:1403] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.011s
I20260709 12:25:56.325891 22418 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.352515 22262 tablet_bootstrap.cc:492] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:56.353046 22262 ts_tablet_manager.cc:1403] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.012s
I20260709 12:25:56.361644 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:56.362706 22144 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.363435 22262 raft_consensus.cc:359] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.364111 22262 raft_consensus.cc:385] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.364363 22262 raft_consensus.cc:740] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.367662 22260 raft_consensus.cc:359] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.368363 22260 raft_consensus.cc:385] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.368626 22260 raft_consensus.cc:740] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.369264 22260 consensus_queue.cc:260] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.371317 22260 ts_tablet_manager.cc:1434] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.002s
I20260709 12:25:56.372193 22260 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:56.374251 22262 consensus_queue.cc:260] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.380904 22314 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:56.383281 22111 consensus_peers.cc:597] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:56.383880 22219 raft_consensus.cc:3060] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.348690 22418 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.400465 22262 ts_tablet_manager.cc:1434] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.006s
I20260709 12:25:56.401368 22262 tablet_bootstrap.cc:492] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:56.398522 22314 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:56.405020 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:56.410604 22387 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.415288 22036 leader_election.cc:343] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.422827 22387 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.431445 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.431273 22465 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:56.433947 22353 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.435159 22064 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:56.436432 22387 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.438124 22144 raft_consensus.cc:2468] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:56.439492 22261 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:56.439954 22261 ts_tablet_manager.cc:1403] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.159s	user 0.026s	sys 0.033s
I20260709 12:25:56.440213 22111 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:56.442920 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.443290 22387 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.443718 22387 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.444089 22387 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:56.444335 22111 leader_election.cc:343] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.448802 22035 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:56.449149 22314 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.449724 22314 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.451262 22373 raft_consensus.cc:2804] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.451902 22373 raft_consensus.cc:697] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:56.452317 22314 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:56.452719 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:25:56.454268 22185 leader_election.cc:343] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.457046 22260 tablet_bootstrap.cc:654] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.459300 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.462073 22142 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:56.457501 22373 consensus_queue.cc:237] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.463158 22184 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.469345 22353 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.469830 22353 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.470258 22353 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.470338 22262 tablet_bootstrap.cc:654] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:56.485383 22502 log.cc:927] Time spent T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:25:56.490229 22387 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.499071 22261 raft_consensus.cc:359] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.516638 22261 raft_consensus.cc:385] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.517042 22261 raft_consensus.cc:740] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.519078 22261 consensus_queue.cc:260] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.526741 22261 ts_tablet_manager.cc:1434] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.003s
I20260709 12:25:56.527597 22261 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:56.527263 22353 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.532050 22215 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:56.518038 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 54969.8us
I20260709 12:25:56.537645 22287 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.538241 22287 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.540323 22287 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.532052 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:56.541317 22070 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.541438 22353 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:56.547945 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:25:56.551577 22111 leader_election.cc:343] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.550496 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.562304 22070 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:56.563356 22387 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.582854 22418 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.583623 22418 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.555045 22353 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.589726 22111 leader_election.cc:343] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.591331 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.591746 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.592016 22140 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:56.593964 22260 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:56.594447 22260 ts_tablet_manager.cc:1403] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.222s	user 0.012s	sys 0.010s
I20260709 12:25:56.594991 22035 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:56.596346 22470 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.596886 22470 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.597460 22470 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.597641 22260 raft_consensus.cc:359] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.598537 22260 raft_consensus.cc:385] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.598863 22260 raft_consensus.cc:740] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.599625 22260 consensus_queue.cc:260] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.600586 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:56.587447 22418 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:25:56.601851 22185 leader_election.cc:343] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.590665 22111 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.604290 22260 ts_tablet_manager.cc:1434] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:56.604543 22465 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.606845 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:56.608070 22260 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:56.587162 22353 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.610013 22470 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.611347 22353 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:56.611358 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.612655 22064 raft_consensus.cc:2393] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:25:56.613386 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:56.614002 22140 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:56.615346 22036 leader_election.cc:343] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.606076 22262 tablet_bootstrap.cc:492] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:56.617565 22111 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:56.618093 22262 ts_tablet_manager.cc:1403] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.217s	user 0.019s	sys 0.008s
I20260709 12:25:56.618574 22465 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:56.621294 22111 leader_election.cc:343] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.620167 22465 raft_consensus.cc:697] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:56.620074 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:56.623507 22465 consensus_queue.cc:237] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.630209 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.632063 22261 tablet_bootstrap.cc:654] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.633703 22141 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.642479 21965 catalog_manager.cc:5697] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.661229 22262 raft_consensus.cc:359] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.669343 22262 raft_consensus.cc:385] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.669854 22262 raft_consensus.cc:740] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.625078 22373 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.682668 22373 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.687129 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.687533 22373 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.693440 22470 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.699481 22141 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:56.700783 22262 consensus_queue.cc:260] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.703116 22262 ts_tablet_manager.cc:1434] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 12:25:56.704087 22262 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:56.704272 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.692647 22140 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:56.709975 22035 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:56.710749 22260 tablet_bootstrap.cc:654] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.713761 22262 tablet_bootstrap.cc:654] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.717710 22353 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.718257 22353 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.720665 22353 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:56.724457 22470 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.724385 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.725200 22470 raft_consensus.cc:697] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:56.725531 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:56.726230 22470 consensus_queue.cc:237] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.728216 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.729203 22140 raft_consensus.cc:2393] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:25:56.729599 22184 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.730554 22353 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.731019 22184 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.736856 22036 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:56.737703 22268 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:56.740024 22036 leader_election.cc:343] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.741580 22456 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.742197 22456 raft_consensus.cc:697] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:56.743221 22456 consensus_queue.cc:237] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.750730 22353 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.752386 22260 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:56.752673 22261 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:56.752842 22260 ts_tablet_manager.cc:1403] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.146s	user 0.022s	sys 0.004s
I20260709 12:25:56.753222 22261 ts_tablet_manager.cc:1403] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.001s
I20260709 12:25:56.748921 22184 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.755481 22353 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.756599 22260 raft_consensus.cc:359] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.757333 22260 raft_consensus.cc:385] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.757611 22260 raft_consensus.cc:740] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.758306 22260 consensus_queue.cc:260] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.761278 22262 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:56.761786 22262 ts_tablet_manager.cc:1403] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.011s
I20260709 12:25:56.763607 22070 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.764575 22353 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.765266 22262 raft_consensus.cc:359] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.765964 22262 raft_consensus.cc:385] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.766156 22262 raft_consensus.cc:740] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.766670 22262 consensus_queue.cc:260] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.767665 22262 ts_tablet_manager.cc:1434] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:56.768270 22262 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:56.770844 22260 ts_tablet_manager.cc:1434] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:25:56.771742 22260 tablet_bootstrap.cc:492] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:56.772459 22472 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.778342 22260 tablet_bootstrap.cc:654] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.781208 22261 raft_consensus.cc:359] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.782112 22261 raft_consensus.cc:385] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.782522 22261 raft_consensus.cc:740] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.783800 22261 consensus_queue.cc:260] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.790982 21963 catalog_manager.cc:5697] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.792054 21965 catalog_manager.cc:5697] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.803128 22262 tablet_bootstrap.cc:654] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.804477 22261 ts_tablet_manager.cc:1434] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:25:56.805608 22261 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:56.814193 21965 catalog_manager.cc:5697] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.818786 22472 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.825332 22465 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.825819 22465 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.831399 22465 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.835081 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.835744 22064 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:56.836679 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.839294 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:56.840631 22465 raft_consensus.cc:2804] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.841075 22465 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.841495 22465 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:56.842056 22111 leader_election.cc:343] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.840299 22261 tablet_bootstrap.cc:654] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.863533 22465 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.866858 22465 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.873557 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:25:56.875226 22111 leader_election.cc:343] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.876354 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:56.877264 22064 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.893028 22260 tablet_bootstrap.cc:492] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:56.893255 22262 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:56.893568 22260 ts_tablet_manager.cc:1403] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.019s
I20260709 12:25:56.893777 22262 ts_tablet_manager.cc:1403] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.006s
I20260709 12:25:56.896617 22260 raft_consensus.cc:359] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.897341 22260 raft_consensus.cc:385] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.897881 22064 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:56.897626 22260 raft_consensus.cc:740] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.910084 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:56.911039 22472 raft_consensus.cc:2804] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.911558 22472 raft_consensus.cc:697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:56.910643 22260 consensus_queue.cc:260] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.912459 22472 consensus_queue.cc:237] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.914058 22260 ts_tablet_manager.cc:1434] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:25:56.915657 22260 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:56.898792 22262 raft_consensus.cc:359] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.917816 22262 raft_consensus.cc:385] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.918191 22262 raft_consensus.cc:740] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.918970 22262 consensus_queue.cc:260] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.920636 22261 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:56.921133 22261 ts_tablet_manager.cc:1403] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.001s
I20260709 12:25:56.921594 22262 ts_tablet_manager.cc:1434] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:25:56.922485 22260 tablet_bootstrap.cc:654] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.923856 22261 raft_consensus.cc:359] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.924547 22261 raft_consensus.cc:385] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.924813 22261 raft_consensus.cc:740] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.925642 22261 consensus_queue.cc:260] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.929519 22314 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.930050 22314 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.932341 22314 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:56.933025 22262 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:56.933954 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:56.934813 22065 raft_consensus.cc:2393] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:25:56.941677 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.941694 22262 tablet_bootstrap.cc:654] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.943429 22184 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:56.944294 22260 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:56.944744 22260 ts_tablet_manager.cc:1403] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.010s
I20260709 12:25:56.944679 22456 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.948012 22260 raft_consensus.cc:359] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.948791 22260 raft_consensus.cc:385] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.949079 22260 raft_consensus.cc:740] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.949805 22260 consensus_queue.cc:260] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.951920 22260 ts_tablet_manager.cc:1434] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:56.952775 22260 tablet_bootstrap.cc:492] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:56.955940 22373 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.943411 22261 ts_tablet_manager.cc:1434] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:56.956493 22373 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.958799 22260 tablet_bootstrap.cc:654] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.960016 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:56.961376 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:56.962127 22141 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:56.963344 22261 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:56.963471 22035 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:56.964366 22470 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.964777 22470 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.965186 22470 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:56.969954 22036 leader_election.cc:343] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.958827 22373 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:56.977310 22456 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.982102 22261 tablet_bootstrap.cc:654] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.982553 22470 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.981534 21965 catalog_manager.cc:5697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.985827 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:56.986492 22141 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.990566 22260 tablet_bootstrap.cc:492] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:56.991274 22260 ts_tablet_manager.cc:1403] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.012s
I20260709 12:25:56.993983 22260 raft_consensus.cc:359] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.994697 22260 raft_consensus.cc:385] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.994966 22260 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.995604 22260 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:56.998229 22260 ts_tablet_manager.cc:1434] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:56.999593 22260 tablet_bootstrap.cc:492] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:56.999357 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:25:57.000855 22036 leader_election.cc:343] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.001921 22262 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:56.998708 22470 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.002489 22262 ts_tablet_manager.cc:1403] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.005s
I20260709 12:25:57.003545 22141 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:57.004854 22035 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:57.007501 22470 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.009348 22261 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:57.010289 22470 raft_consensus.cc:697] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:57.011857 22261 ts_tablet_manager.cc:1403] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.008s
I20260709 12:25:57.009145 22262 raft_consensus.cc:359] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.012580 22262 raft_consensus.cc:385] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.013947 22262 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.014721 22262 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.013646 22260 tablet_bootstrap.cc:654] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.020429 22262 ts_tablet_manager.cc:1434] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:25:57.021533 22262 tablet_bootstrap.cc:492] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:57.015189 22261 raft_consensus.cc:359] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.022136 22261 raft_consensus.cc:385] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.022444 22261 raft_consensus.cc:740] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.023123 22261 consensus_queue.cc:260] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.011152 22470 consensus_queue.cc:237] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.029558 22262 tablet_bootstrap.cc:654] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.030421 22260 tablet_bootstrap.cc:492] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:57.030872 22260 ts_tablet_manager.cc:1403] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.001s
I20260709 12:25:57.033594 22260 raft_consensus.cc:359] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.034364 22260 raft_consensus.cc:385] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.034641 22260 raft_consensus.cc:740] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.035398 22260 consensus_queue.cc:260] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.037487 22260 ts_tablet_manager.cc:1434] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:57.037871 22261 ts_tablet_manager.cc:1434] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:25:57.039757 22373 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.040266 22373 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.042589 22260 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:57.043347 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.043685 22262 tablet_bootstrap.cc:492] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:57.044064 22141 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:57.044274 22262 ts_tablet_manager.cc:1403] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 12:25:57.046315 22035 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:57.047212 22268 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.047588 22268 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.047971 22268 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.047698 22262 raft_consensus.cc:359] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.048729 22262 raft_consensus.cc:385] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.049290 22260 tablet_bootstrap.cc:654] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.049106 22262 raft_consensus.cc:740] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.050246 22262 consensus_queue.cc:260] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.052608 22262 ts_tablet_manager.cc:1434] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:57.052758 22373 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.053753 22262 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:57.054162 22261 tablet_bootstrap.cc:492] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:57.053750 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.054942 22219 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:57.061260 22418 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:57.062602 22261 tablet_bootstrap.cc:654] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.064042 22260 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:57.064548 22260 ts_tablet_manager.cc:1403] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
I20260709 12:25:57.064760 22388 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.065250 22388 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.067739 22388 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.068210 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.062564 22262 tablet_bootstrap.cc:654] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.068827 22064 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:57.070379 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:57.070925 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.071213 22388 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.071606 22388 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.071990 22388 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.072511 22111 leader_election.cc:343] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.077243 22260 raft_consensus.cc:359] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.078477 22260 raft_consensus.cc:385] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.079110 22472 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.079476 22472 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.079535 22388 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.081620 22472 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.070200 22268 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.083926 22268 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.078753 22260 raft_consensus.cc:740] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.085489 22260 consensus_queue.cc:260] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.086699 22373 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.087571 22388 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.088346 22260 ts_tablet_manager.cc:1434] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 12:25:57.088651 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:57.089324 22218 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.094642 22260 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:57.099537 22261 tablet_bootstrap.cc:492] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:57.100040 22261 ts_tablet_manager.cc:1403] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.005s
I20260709 12:25:57.098657 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.104728 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:57.101377 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:57.105152 22261 raft_consensus.cc:359] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.105899 22065 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.105983 22261 raft_consensus.cc:385] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.106362 22261 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.107137 22261 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:57.109396 22111 leader_election.cc:343] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.101591 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.110713 22219 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:57.114439 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:57.120522 22261 ts_tablet_manager.cc:1434] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:25:57.120687 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:57.121383 22144 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.121937 22261 tablet_bootstrap.cc:492] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:57.118599 22215 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.128811 21963 catalog_manager.cc:5697] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.119647 22472 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.133446 22065 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:57.138338 22472 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.140872 22472 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.154825 22268 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.155313 22268 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.156634 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:57.157433 22287 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.157735 22465 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.158592 22218 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:57.161237 22268 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.163924 22472 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.164354 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.174459 22472 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.167450 22144 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:57.175390 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:57.175990 22219 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.154479 22215 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:57.167251 22036 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:57.179315 22268 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.181317 22268 raft_consensus.cc:697] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:57.182080 22268 consensus_queue.cc:237] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.171411 22287 raft_consensus.cc:697] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:57.184121 22287 consensus_queue.cc:237] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.189353 22418 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:57.165021 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.194747 22260 tablet_bootstrap.cc:654] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.192538 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:25:57.201656 22111 leader_election.cc:343] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.204733 22141 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 1: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:25:57.211820 22219 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:57.212970 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:57.214238 22388 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.224045 22261 tablet_bootstrap.cc:654] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.226226 22262 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:57.226764 22262 ts_tablet_manager.cc:1403] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.173s	user 0.021s	sys 0.011s
I20260709 12:25:57.229923 22262 raft_consensus.cc:359] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.230671 22262 raft_consensus.cc:385] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.218601 22388 raft_consensus.cc:697] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:57.230974 22262 raft_consensus.cc:740] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.236986 22262 consensus_queue.cc:260] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.245970 22035 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:57.247442 22268 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.238946 22465 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.259402 22268 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.258330 21966 catalog_manager.cc:5697] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.267237 22262 ts_tablet_manager.cc:1434] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:25:57.263091 22388 consensus_queue.cc:237] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.290009 22260 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:57.290445 22260 ts_tablet_manager.cc:1403] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.007s
I20260709 12:25:57.318032 22262 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:57.323553 21963 catalog_manager.cc:5697] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.331772 22456 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.334092 22353 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.337882 22262 tablet_bootstrap.cc:654] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:57.340664 22036 consensus_peers.cc:597] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.345260 22261 tablet_bootstrap.cc:492] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:57.345911 22261 ts_tablet_manager.cc:1403] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.224s	user 0.018s	sys 0.010s
I20260709 12:25:57.350322 22260 raft_consensus.cc:359] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.353978 22260 raft_consensus.cc:385] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.354305 22260 raft_consensus.cc:740] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.355443 22260 consensus_queue.cc:260] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.349694 22456 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.359208 22456 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.357144 22260 ts_tablet_manager.cc:1434] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.066s	user 0.002s	sys 0.004s
I20260709 12:25:57.366093 22456 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:57.368309 22260 tablet_bootstrap.cc:492] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:57.369565 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.370373 22071 raft_consensus.cc:2393] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:25:57.370307 22261 raft_consensus.cc:359] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.371088 22261 raft_consensus.cc:385] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.371362 22261 raft_consensus.cc:740] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.372035 22261 consensus_queue.cc:260] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:57.375975 22540 log.cc:927] Time spent T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:57.380344 22261 ts_tablet_manager.cc:1434] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:25:57.381292 22261 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:57.386195 22287 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.386834 22287 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.390487 22287 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.388276 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.393064 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.393731 22071 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:57.396121 22111 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:57.396739 22287 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.397084 22287 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.397408 22287 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.399582 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.400269 22217 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:57.401315 22184 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:57.402818 22353 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.405141 22287 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.410027 22287 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.413509 22373 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.424767 22353 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.428930 22260 tablet_bootstrap.cc:654] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.432467 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:57.436020 22071 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.458534 22287 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.459227 22287 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.468056 22262 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:57.468585 22262 ts_tablet_manager.cc:1403] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.151s	user 0.019s	sys 0.036s
I20260709 12:25:57.476719 22287 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.477418 22262 raft_consensus.cc:359] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.479826 22262 raft_consensus.cc:385] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.480196 22262 raft_consensus.cc:740] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.481036 22262 consensus_queue.cc:260] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.439713 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:57.487282 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.503264 22262 ts_tablet_manager.cc:1434] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:25:57.502460 21965 catalog_manager.cc:5697] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.505429 22262 tablet_bootstrap.cc:492] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:57.490662 22219 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.512177 22111 leader_election.cc:343] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.515287 22071 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
W20260709 12:25:57.527789 22036 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.531601 22261 tablet_bootstrap.cc:654] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.545715 22111 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:57.546492 22465 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.546998 22465 raft_consensus.cc:697] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:57.547806 22465 consensus_queue.cc:237] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.549850 22268 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.550339 22268 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.552150 22268 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.552556 22287 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.554011 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.555210 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.555848 22141 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
W20260709 12:25:57.558609 22036 leader_election.cc:343] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.559371 22035 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:57.560811 22418 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.561184 22418 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.561568 22418 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.573146 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:57.615612 22418 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.635123 22260 tablet_bootstrap.cc:492] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:57.635661 22260 ts_tablet_manager.cc:1403] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.268s	user 0.058s	sys 0.047s
I20260709 12:25:57.636339 22219 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:57.644627 22268 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.645135 22268 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.650161 22268 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.652496 22418 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.652632 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.659544 22260 raft_consensus.cc:359] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.660290 22260 raft_consensus.cc:385] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.660573 22260 raft_consensus.cc:740] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.661019 22261 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:57.661597 22261 ts_tablet_manager.cc:1403] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.281s	user 0.042s	sys 0.035s
I20260709 12:25:57.661273 22260 consensus_queue.cc:260] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.665946 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.667765 22262 tablet_bootstrap.cc:654] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.670703 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:57.671908 22141 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.673506 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.674340 22217 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 1: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:25:57.676393 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:57.678642 22465 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.679419 22260 ts_tablet_manager.cc:1434] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:25:57.679152 22465 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.680315 22260 tablet_bootstrap.cc:492] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:57.681130 22465 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.683630 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:57.686997 22111 leader_election.cc:343] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.687426 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:25:57.689155 22111 leader_election.cc:343] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.689467 22472 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.690681 22141 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:57.688143 22388 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.692166 22035 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:57.694033 22418 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.694562 22418 raft_consensus.cc:697] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:57.694702 21963 catalog_manager.cc:5697] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.697826 22036 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:57.698750 22268 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.699265 22036 leader_election.cc:343] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.696921 22418 consensus_queue.cc:237] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.701519 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.702384 22470 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:57.707052 22111 leader_election.cc:343] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.707664 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:57.708614 22287 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.710668 22268 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.712481 22261 raft_consensus.cc:359] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.714823 22261 raft_consensus.cc:385] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.715108 22261 raft_consensus.cc:740] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.715916 22261 consensus_queue.cc:260] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.724406 22261 ts_tablet_manager.cc:1434] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 12:25:57.725798 22261 tablet_bootstrap.cc:492] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:57.737246 21965 catalog_manager.cc:5697] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.745965 22262 tablet_bootstrap.cc:492] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:57.746524 22262 ts_tablet_manager.cc:1403] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.241s	user 0.006s	sys 0.013s
I20260709 12:25:57.747673 22260 tablet_bootstrap.cc:654] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.749714 22261 tablet_bootstrap.cc:654] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.752373 22262 raft_consensus.cc:359] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.752655 22470 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.753115 22262 raft_consensus.cc:385] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.761123 22262 raft_consensus.cc:740] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.761826 22262 consensus_queue.cc:260] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.765980 22262 ts_tablet_manager.cc:1434] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:25:57.766871 22262 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:57.769841 22287 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.781594 22387 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.782088 22387 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.784185 22387 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.784708 22287 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.800019 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.801735 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:57.811769 22262 tablet_bootstrap.cc:654] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.811223 22314 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.813318 22314 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.814170 22261 tablet_bootstrap.cc:492] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
W20260709 12:25:57.814366 22111 leader_election.cc:343] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.814646 22261 ts_tablet_manager.cc:1403] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.008s
W20260709 12:25:57.816185 22111 leader_election.cc:343] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.816581 22111 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:57.819419 22314 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:57.820079 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.823529 22287 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.828284 22261 raft_consensus.cc:359] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.835714 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.838224 22184 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:57.839473 22314 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.848067 22260 tablet_bootstrap.cc:492] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:57.849088 22260 ts_tablet_manager.cc:1403] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.003s
I20260709 12:25:57.829036 22261 raft_consensus.cc:385] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.849972 22261 raft_consensus.cc:740] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.850665 22261 consensus_queue.cc:260] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.851751 22260 raft_consensus.cc:359] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.852439 22260 raft_consensus.cc:385] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.852698 22260 raft_consensus.cc:740] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.852837 22261 ts_tablet_manager.cc:1434] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:25:57.848116 22465 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:57.857833 22261 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:57.862767 22262 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:57.863270 22262 ts_tablet_manager.cc:1403] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.004s
I20260709 12:25:57.864692 22261 tablet_bootstrap.cc:654] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.869992 22262 raft_consensus.cc:359] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.870975 22262 raft_consensus.cc:385] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.871311 22262 raft_consensus.cc:740] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.871984 22262 consensus_queue.cc:260] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.873318 22260 consensus_queue.cc:260] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.875924 22260 ts_tablet_manager.cc:1434] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:25:57.876690 22261 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:57.876837 22260 tablet_bootstrap.cc:492] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:57.877192 22261 ts_tablet_manager.cc:1403] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.009s
I20260709 12:25:57.879818 22261 raft_consensus.cc:359] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.880511 22261 raft_consensus.cc:385] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.880787 22261 raft_consensus.cc:740] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.881610 22261 consensus_queue.cc:260] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.883625 22261 ts_tablet_manager.cc:1434] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:57.884507 22261 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:57.884408 22287 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.891289 22261 tablet_bootstrap.cc:654] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.891256 22262 ts_tablet_manager.cc:1434] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:25:57.895362 22260 tablet_bootstrap.cc:654] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.895570 22262 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:57.900795 22260 tablet_bootstrap.cc:492] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:57.901739 22262 tablet_bootstrap.cc:654] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.901755 22260 ts_tablet_manager.cc:1403] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 12:25:57.906296 22260 raft_consensus.cc:359] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.907213 22260 raft_consensus.cc:385] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.907555 22260 raft_consensus.cc:740] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.908372 22260 consensus_queue.cc:260] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.929004 22260 ts_tablet_manager.cc:1434] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:25:57.930249 22260 tablet_bootstrap.cc:492] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:57.937063 22261 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:57.937614 22261 ts_tablet_manager.cc:1403] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.018s
I20260709 12:25:57.940526 22262 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:57.941023 22262 ts_tablet_manager.cc:1403] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.010s
I20260709 12:25:57.942930 22260 tablet_bootstrap.cc:654] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.944298 22262 raft_consensus.cc:359] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.945031 22262 raft_consensus.cc:385] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.945338 22262 raft_consensus.cc:740] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.941159 22261 raft_consensus.cc:359] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.946252 22261 raft_consensus.cc:385] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.946516 22261 raft_consensus.cc:740] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.947239 22261 consensus_queue.cc:260] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.949914 22262 consensus_queue.cc:260] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.952018 22262 ts_tablet_manager.cc:1434] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:25:57.952361 22261 ts_tablet_manager.cc:1434] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:57.953719 22268 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.954139 22268 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.954682 22261 tablet_bootstrap.cc:492] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:57.955678 22314 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.955919 22268 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:57.956156 22314 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.957743 22262 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:57.958214 22314 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:57.958417 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.961501 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:57.961781 22144 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:57.959266 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:57.963101 22184 leader_election.cc:343] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.959883 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:57.963965 22070 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:57.966073 22261 tablet_bootstrap.cc:654] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.966905 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:25:57.967494 22036 leader_election.cc:343] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.967743 22268 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.968109 22268 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.968417 22268 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.968794 22262 tablet_bootstrap.cc:654] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.974086 22185 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:25:57.982950 22314 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.983475 22314 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.983928 22314 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.988451 22260 tablet_bootstrap.cc:492] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:57.994000 22260 ts_tablet_manager.cc:1403] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.001s
I20260709 12:25:57.998783 22268 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:57.998564 22260 raft_consensus.cc:359] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.001367 22260 raft_consensus.cc:385] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.001757 22260 raft_consensus.cc:740] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.001818 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:58.002471 22140 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.002717 22260 consensus_queue.cc:260] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.008788 22260 ts_tablet_manager.cc:1434] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:25:58.010506 22260 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:58.026160 22140 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:58.027648 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.027961 22260 tablet_bootstrap.cc:654] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.028362 22418 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.028879 22418 raft_consensus.cc:697] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:58.029711 22418 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.043020 22220 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.044230 22314 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.046916 22314 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:58.047904 22268 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.047991 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:58.048851 22070 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.052541 22262 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.053017 22262 ts_tablet_manager.cc:1403] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.095s	user 0.058s	sys 0.025s
I20260709 12:25:58.053926 22070 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:58.054756 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:58.055503 22185 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.056128 22219 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.056186 22262 raft_consensus.cc:359] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.056936 22262 raft_consensus.cc:385] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.056974 22353 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.057390 22262 raft_consensus.cc:740] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.058060 22262 consensus_queue.cc:260] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.060418 22262 ts_tablet_manager.cc:1434] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:58.061271 22262 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.064886 21967 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.065521 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:58.066639 22388 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:58.070188 22036 leader_election.cc:343] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.072265 22260 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:58.072813 22268 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.072813 22260 ts_tablet_manager.cc:1403] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.000s
W20260709 12:25:58.070065 22184 leader_election.cc:343] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.073407 22268 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.075058 22262 tablet_bootstrap.cc:654] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.075439 22268 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.080062 22260 raft_consensus.cc:359] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.080736 22260 raft_consensus.cc:385] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.081001 22260 raft_consensus.cc:740] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.081506 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.081651 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.082218 22218 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:58.081786 22260 consensus_queue.cc:260] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.082580 22140 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:58.084205 22260 ts_tablet_manager.cc:1434] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:58.084086 22035 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.085088 22268 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.085681 22268 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.086105 22268 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.090240 22353 raft_consensus.cc:697] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:58.091492 22353 consensus_queue.cc:237] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.104247 22262 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.107118 22261 tablet_bootstrap.cc:492] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:58.104820 22262 ts_tablet_manager.cc:1403] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.016s
I20260709 12:25:58.107730 22261 ts_tablet_manager.cc:1403] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.153s	user 0.033s	sys 0.021s
I20260709 12:25:58.108470 22268 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.111289 22262 raft_consensus.cc:359] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.111997 22262 raft_consensus.cc:385] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.112282 22262 raft_consensus.cc:740] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.113217 22262 consensus_queue.cc:260] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.116636 22262 ts_tablet_manager.cc:1434] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:25:58.117316 22388 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.117892 22262 tablet_bootstrap.cc:492] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.126610 22262 tablet_bootstrap.cc:654] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.130971 22260 tablet_bootstrap.cc:492] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:58.132563 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:58.134110 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:58.134733 22216 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.135742 22144 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.140493 22262 tablet_bootstrap.cc:492] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.141160 22262 ts_tablet_manager.cc:1403] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 12:25:58.142241 22216 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:58.143698 22036 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.144446 22418 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.144997 22418 raft_consensus.cc:697] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:58.145303 22262 raft_consensus.cc:359] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.146273 22262 raft_consensus.cc:385] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.146165 22418 consensus_queue.cc:237] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.146718 22262 raft_consensus.cc:740] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.147806 22262 consensus_queue.cc:260] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.150727 22262 ts_tablet_manager.cc:1434] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:25:58.152137 22262 tablet_bootstrap.cc:492] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.153052 22144 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:58.159310 22262 tablet_bootstrap.cc:654] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.157969 22261 raft_consensus.cc:359] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.161718 22261 raft_consensus.cc:385] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.162751 22261 raft_consensus.cc:740] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.164853 22261 consensus_queue.cc:260] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.171504 22261 ts_tablet_manager.cc:1434] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:25:58.175709 22261 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:58.184060 22261 tablet_bootstrap.cc:654] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.184456 21966 catalog_manager.cc:5697] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.216717 22268 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.236217 22220 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.244057 22260 tablet_bootstrap.cc:654] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.264968 21963 catalog_manager.cc:5697] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:58.278728 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 72072.5us
I20260709 12:25:58.291570 22262 tablet_bootstrap.cc:492] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.292153 22262 ts_tablet_manager.cc:1403] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.140s	user 0.035s	sys 0.064s
I20260709 12:25:58.295197 22262 raft_consensus.cc:359] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.295904 22262 raft_consensus.cc:385] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.296198 22262 raft_consensus.cc:740] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.296878 22262 consensus_queue.cc:260] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.299048 22262 ts_tablet_manager.cc:1434] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:25:58.299997 22262 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.300673 22287 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.301147 22287 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.303015 22287 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.305070 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:58.306993 22111 leader_election.cc:343] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.310168 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:25:58.311983 22036 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:58.312970 22111 leader_election.cc:343] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.313411 22111 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:58.313730 22262 tablet_bootstrap.cc:654] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.314827 22287 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.312903 22373 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:25:58.329337 22261 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:58.329972 22261 ts_tablet_manager.cc:1403] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.154s	user 0.004s	sys 0.007s
I20260709 12:25:58.332775 22261 raft_consensus.cc:359] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.333765 22261 raft_consensus.cc:385] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.333149 22262 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.334710 22262 ts_tablet_manager.cc:1403] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.009s
I20260709 12:25:58.336357 22260 tablet_bootstrap.cc:492] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:58.336795 22260 ts_tablet_manager.cc:1403] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.206s	user 0.015s	sys 0.002s
I20260709 12:25:58.337291 22262 raft_consensus.cc:359] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.338042 22262 raft_consensus.cc:385] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.338286 22262 raft_consensus.cc:740] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.338907 22262 consensus_queue.cc:260] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.341066 22262 ts_tablet_manager.cc:1434] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:25:58.341981 22262 tablet_bootstrap.cc:492] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.334048 22261 raft_consensus.cc:740] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.355790 22261 consensus_queue.cc:260] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.358389 22353 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:25:58.343137 22260 raft_consensus.cc:359] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.366472 22260 raft_consensus.cc:385] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.366237 22353 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.366770 22260 raft_consensus.cc:740] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.367486 22260 consensus_queue.cc:260] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.369800 22268 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.370254 22268 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.371812 22261 ts_tablet_manager.cc:1434] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.009s
I20260709 12:25:58.372118 22268 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.372805 22262 tablet_bootstrap.cc:654] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.377316 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.378000 22140 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:58.379297 22035 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.380182 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:58.380725 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.380929 22373 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.381356 22373 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.381702 22373 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:58.382421 22036 leader_election.cc:343] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.370249 22260 ts_tablet_manager.cc:1434] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.008s
I20260709 12:25:58.385902 22353 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:58.377288 22261 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:58.387475 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.387106 22260 tablet_bootstrap.cc:492] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:58.389720 22184 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:58.391166 22353 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:58.394881 22418 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.395576 22418 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.397369 22418 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.398074 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.397959 22373 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:58.399535 22035 leader_election.cc:343] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.399958 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:25:58.401554 22036 leader_election.cc:343] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.401960 22036 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:58.402922 22418 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.406023 22260 tablet_bootstrap.cc:654] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.406371 22373 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.408423 22261 tablet_bootstrap.cc:654] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.408663 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:58.409580 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:25:58.410089 22036 leader_election.cc:343] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.410163 22140 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.418952 22140 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:58.420207 22035 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:58.420830 22262 tablet_bootstrap.cc:492] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.421023 22373 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.421388 22262 ts_tablet_manager.cc:1403] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.000s
I20260709 12:25:58.421759 22373 raft_consensus.cc:697] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:58.423029 22373 consensus_queue.cc:237] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.427047 22262 raft_consensus.cc:359] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.427817 22262 raft_consensus.cc:385] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.429409 22262 raft_consensus.cc:740] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.430163 22262 consensus_queue.cc:260] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.432380 22262 ts_tablet_manager.cc:1434] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:58.433298 22262 tablet_bootstrap.cc:492] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.433907 22260 tablet_bootstrap.cc:492] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:58.434379 22260 ts_tablet_manager.cc:1403] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.023s
I20260709 12:25:58.434530 22261 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:58.435021 22261 ts_tablet_manager.cc:1403] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.010s
I20260709 12:25:58.443246 22261 raft_consensus.cc:359] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.443957 22261 raft_consensus.cc:385] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.444199 22261 raft_consensus.cc:740] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
W20260709 12:25:58.444278 22036 consensus_peers.cc:597] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:58.439337 22260 raft_consensus.cc:359] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.447670 22260 raft_consensus.cc:385] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.448047 22260 raft_consensus.cc:740] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.448609 22262 tablet_bootstrap.cc:654] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.448724 22260 consensus_queue.cc:260] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.450901 22260 ts_tablet_manager.cc:1434] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:25:58.451810 22260 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:58.447711 21963 catalog_manager.cc:5697] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.462131 22353 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.462445 22373 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.462985 22353 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.464000 22261 consensus_queue.cc:260] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.466183 22261 ts_tablet_manager.cc:1434] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.005s
I20260709 12:25:58.467146 22261 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:58.467785 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:58.468457 22070 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:58.471673 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.472491 22574 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.472826 22574 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.473383 22574 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.475996 22260 tablet_bootstrap.cc:654] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.476994 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.477712 22144 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
I20260709 12:25:58.479296 22261 tablet_bootstrap.cc:654] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.480572 22353 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:58.488808 22584 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.489346 22584 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.491459 22584 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.493747 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.494387 22574 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:58.495024 22036 leader_election.cc:343] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.496419 22574 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:58.494148 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.499080 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:58.499699 22144 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.500247 22262 tablet_bootstrap.cc:492] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.500715 22262 ts_tablet_manager.cc:1403] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.001s
I20260709 12:25:58.503201 22140 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:58.506603 22035 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:58.513448 22470 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.517463 22470 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.517843 22470 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.518443 22262 raft_consensus.cc:359] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.519550 22262 raft_consensus.cc:385] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.519893 22262 raft_consensus.cc:740] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.520656 22262 consensus_queue.cc:260] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.525398 22262 ts_tablet_manager.cc:1434] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:25:58.526454 22262 tablet_bootstrap.cc:492] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.535085 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:58.535697 22071 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.522406 22574 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:25:58.542124 22262 tablet_bootstrap.cc:654] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.560065 22287 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.560613 22287 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.560720 22071 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:58.562592 22287 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.567487 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:58.568357 22071 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:58.577652 22111 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.585536 22287 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.586047 22287 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.586395 22287 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.587468 22465 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.587885 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.587967 22465 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.590672 22573 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.597764 22465 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.599061 22144 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:58.603080 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.604708 22261 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:58.605259 22261 ts_tablet_manager.cc:1403] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.138s	user 0.039s	sys 0.024s
I20260709 12:25:58.590790 22470 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.608270 22261 raft_consensus.cc:359] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.608892 22261 raft_consensus.cc:385] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.609221 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.612401 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:58.613901 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:58.614480 22141 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.615810 22268 consensus_queue.cc:1048] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.619060 22470 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.619887 22260 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:58.620523 22260 ts_tablet_manager.cc:1403] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.025s
I20260709 12:25:58.622733 22287 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.628253 22287 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:25:58.628728 22111 leader_election.cc:343] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:58.639974 22111 leader_election.cc:343] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.634997 22262 tablet_bootstrap.cc:492] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.636631 22141 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:58.643210 22262 ts_tablet_manager.cc:1403] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.117s	user 0.017s	sys 0.010s
I20260709 12:25:58.644268 22035 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.645411 22470 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.646031 22470 raft_consensus.cc:697] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:58.646126 22262 raft_consensus.cc:359] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.646872 22262 raft_consensus.cc:385] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.647172 22262 raft_consensus.cc:740] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.647094 22470 consensus_queue.cc:237] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.648017 22262 consensus_queue.cc:260] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.649379 22465 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.650032 22465 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.652441 22465 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.654846 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:58.655437 22065 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.656251 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:58.658254 22262 ts_tablet_manager.cc:1434] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:58.659228 22262 tablet_bootstrap.cc:492] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.636891 22260 raft_consensus.cc:359] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.609198 22261 raft_consensus.cc:740] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.659852 22260 raft_consensus.cc:385] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.660562 22260 raft_consensus.cc:740] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.660244 22261 consensus_queue.cc:260] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.637648 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:58.661798 22260 consensus_queue.cc:260] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.663759 22261 ts_tablet_manager.cc:1434] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
W20260709 12:25:58.634683 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 44406.1us
I20260709 12:25:58.664193 22573 raft_consensus.cc:697] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:58.664793 22261 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:58.666393 22262 tablet_bootstrap.cc:654] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.670508 22065 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:58.665061 22573 consensus_queue.cc:237] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.676985 22261 tablet_bootstrap.cc:654] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.678264 22262 tablet_bootstrap.cc:492] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.678766 22262 ts_tablet_manager.cc:1403] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.000s
W20260709 12:25:58.681195 22036 leader_election.cc:343] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.663873 22260 ts_tablet_manager.cc:1434] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 12:25:58.687477 22260 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:58.692610 22584 consensus_queue.cc:1048] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:58.698053 21966 catalog_manager.cc:5697] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.709514 21963 catalog_manager.cc:5697] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.713063 22573 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.713961 22260 tablet_bootstrap.cc:654] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.713734 22573 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:58.707346 22111 leader_election.cc:343] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.714258 22142 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.715370 22111 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:58.719400 22287 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:58.719754 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:58.719803 22111 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:58.728226 22602 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.732895 22602 raft_consensus.cc:697] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:58.727314 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.733868 22602 consensus_queue.cc:237] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.737452 22261 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:58.743121 22573 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:58.743896 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:58.741189 22261 ts_tablet_manager.cc:1403] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.013s
I20260709 12:25:58.728091 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:58.745994 22262 raft_consensus.cc:359] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.746680 22262 raft_consensus.cc:385] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.746960 22262 raft_consensus.cc:740] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
W20260709 12:25:58.751271 22185 leader_election.cc:343] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.755003 22418 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.755522 22418 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.759881 22261 raft_consensus.cc:359] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.760641 22261 raft_consensus.cc:385] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.760933 22261 raft_consensus.cc:740] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.794982 22262 consensus_queue.cc:260] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.799010 22268 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.799582 22268 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.803115 22268 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.804889 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.806602 22418 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.806670 22144 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:58.808007 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.812016 22573 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.812690 22573 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.813118 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:58.815384 22573 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:58.819154 22260 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:58.819645 22260 ts_tablet_manager.cc:1403] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.006s
W20260709 12:25:58.819304 22036 leader_election.cc:343] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.821370 22262 ts_tablet_manager.cc:1434] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.115s	user 0.010s	sys 0.001s
W20260709 12:25:58.821923 22036 leader_election.cc:343] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.822647 22262 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.825282 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.825117 22260 raft_consensus.cc:359] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.826092 22260 raft_consensus.cc:385] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.826448 22260 raft_consensus.cc:740] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.828815 22035 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:58.811278 22065 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:58.829684 22470 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.830188 22470 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.830624 22470 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:58.831373 22035 leader_election.cc:343] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.831887 22035 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:58.833259 22584 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.839569 22261 consensus_queue.cc:260] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.840801 22260 consensus_queue.cc:260] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.843919 22260 ts_tablet_manager.cc:1434] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
W20260709 12:25:58.844151 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 103948us
I20260709 12:25:58.844981 22260 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
W20260709 12:25:58.845010 22111 leader_election.cc:343] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.848950 22261 ts_tablet_manager.cc:1434] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.103s	user 0.012s	sys 0.000s
W20260709 12:25:58.850862 22111 leader_election.cc:343] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.860255 22111 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:58.865428 22287 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.865887 22287 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.866300 22287 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.860055 22574 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:25:58.876272 22287 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.866238 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.879313 22287 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.878379 22214 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.872113 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:58.886245 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:58.890570 22262 tablet_bootstrap.cc:654] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.884864 22144 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 0.
W20260709 12:25:58.894870 22111 leader_election.cc:343] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.901428 22184 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:58.902534 22574 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.902925 22574 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.887478 22470 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.903275 22574 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.906553 22470 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:58.907228 22261 tablet_bootstrap.cc:492] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:58.912743 22260 tablet_bootstrap.cc:654] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.923267 22574 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.925618 22262 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:58.925657 22574 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:58.926234 22262 ts_tablet_manager.cc:1403] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.013s
I20260709 12:25:58.926463 22261 tablet_bootstrap.cc:654] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.929069 22262 raft_consensus.cc:359] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.929915 22262 raft_consensus.cc:385] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.930217 22262 raft_consensus.cc:740] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.931206 22261 tablet_bootstrap.cc:492] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:58.930917 22262 consensus_queue.cc:260] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:58.931679 22261 ts_tablet_manager.cc:1403] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 12:25:58.932489 22262 ts_tablet_manager.cc:1434] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:58.976437 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:58.985457 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:58.986497 22144 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.991843 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:58.993180 22262 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:58.931665 22260 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:59.008460 22573 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.009411 22573 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.014225 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:59.016458 22573 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:59.017655 22260 ts_tablet_manager.cc:1403] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.155s	user 0.005s	sys 0.013s
I20260709 12:25:58.993254 22142 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:59.032563 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 46979.2us
I20260709 12:25:59.035422 22185 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:59.055042 22584 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.056993 22599 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.055893 22584 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.062917 22584 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:59.070844 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:59.071507 22144 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:59.071940 22068 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.073380 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:59.074352 22143 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:25:59.075786 22261 raft_consensus.cc:359] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.076614 22261 raft_consensus.cc:385] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.080101 22260 raft_consensus.cc:359] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.076921 22261 raft_consensus.cc:740] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.080976 22260 raft_consensus.cc:385] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.088750 22260 raft_consensus.cc:740] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.087581 22068 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:59.094550 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:59.097498 22185 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:59.100049 22598 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.100814 22598 raft_consensus.cc:697] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:25:59.112164 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:59.115890 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:59.089998 22142 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:25:59.118637 22353 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.103780 22598 consensus_queue.cc:237] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.116313 22261 consensus_queue.cc:260] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.124050 22035 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:59.110759 22260 consensus_queue.cc:260] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.132581 22619 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.135896 22619 raft_consensus.cc:697] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:59.136276 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:59.137148 22068 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.132697 22618 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:59.134693 22262 tablet_bootstrap.cc:654] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.134608 22035 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:59.142815 22261 ts_tablet_manager.cc:1434] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.211s	user 0.010s	sys 0.000s
I20260709 12:25:59.142678 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:59.143831 22260 ts_tablet_manager.cc:1434] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.126s	user 0.005s	sys 0.003s
I20260709 12:25:59.145344 22260 tablet_bootstrap.cc:492] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:59.145325 22619 consensus_queue.cc:237] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.147182 22268 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.147840 22268 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.148299 22268 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.152187 22261 tablet_bootstrap.cc:492] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.174218 22574 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.174463 22619 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.174782 22574 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.199965 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:59.201737 22574 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:59.201495 22268 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.203867 22268 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:59.221612 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:25:59.222522 22142 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.248634 22068 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:59.254858 22261 tablet_bootstrap.cc:654] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.250484 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:59.265651 22036 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:59.269866 22036 leader_election.cc:343] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:59.271024 22036 leader_election.cc:343] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.306013 22260 tablet_bootstrap.cc:654] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.312686 22036 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.338037 22142 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:25:59.339488 22214 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.352191 21963 catalog_manager.cc:5697] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 0 to 1, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.351090 22111 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:59.359411 22629 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.359969 22629 raft_consensus.cc:697] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:59.359431 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:59.365307 22262 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:59.365942 22262 ts_tablet_manager.cc:1403] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.374s	user 0.028s	sys 0.019s
I20260709 12:25:59.367072 22573 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:59.369743 21967 catalog_manager.cc:5697] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:59.375801 22036 leader_election.cc:343] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.378103 22035 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:59.389421 22584 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.391213 22584 raft_consensus.cc:697] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:25:59.360920 22629 consensus_queue.cc:237] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.392237 22584 consensus_queue.cc:237] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.402094 22262 raft_consensus.cc:359] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.403141 22262 raft_consensus.cc:385] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.403520 22262 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.404364 22262 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.414508 22633 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:59.418466 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 60518.9us
I20260709 12:25:59.415335 22633 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.421275 22260 tablet_bootstrap.cc:492] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:59.421808 22260 ts_tablet_manager.cc:1403] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.277s	user 0.017s	sys 0.023s
I20260709 12:25:59.424505 22260 raft_consensus.cc:359] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.425211 22260 raft_consensus.cc:385] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.425493 22260 raft_consensus.cc:740] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.425698 22633 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:59.426204 22260 consensus_queue.cc:260] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.428417 22260 ts_tablet_manager.cc:1434] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:25:59.431838 22260 tablet_bootstrap.cc:492] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:59.417161 22262 ts_tablet_manager.cc:1434] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.051s	user 0.001s	sys 0.010s
I20260709 12:25:59.434839 22262 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:59.435190 22598 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.439617 22261 tablet_bootstrap.cc:492] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.443446 22261 ts_tablet_manager.cc:1403] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.292s	user 0.009s	sys 0.015s
I20260709 12:25:59.445257 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:59.454734 22598 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.458369 22618 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.478682 22638 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.479446 22638 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.458909 22618 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.489039 22618 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:59.489583 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:59.484935 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:59.524427 22260 tablet_bootstrap.cc:654] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.528241 22638 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:59.530380 22262 tablet_bootstrap.cc:654] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.534039 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:25:59.536279 22035 leader_election.cc:343] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.538173 22261 raft_consensus.cc:359] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.539156 22261 raft_consensus.cc:385] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.539507 22261 raft_consensus.cc:740] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.542980 22261 consensus_queue.cc:260] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.511826 22388 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:25:59.546043 22261 ts_tablet_manager.cc:1434] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 12:25:59.547389 22261 tablet_bootstrap.cc:492] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.548939 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:59.550537 22353 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:59.558511 22036 leader_election.cc:343] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.564128 22036 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:59.565202 22618 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:59.567466 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 63878.5us
W20260709 12:25:59.571316 22111 leader_election.cc:343] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:59.583632 22111 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:59.587409 22036 consensus_peers.cc:597] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.592607 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:59.593351 22065 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:59.595114 22262 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:59.595592 22262 ts_tablet_manager.cc:1403] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.000s
I20260709 12:25:59.597801 22216 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.594440 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:59.602352 22261 tablet_bootstrap.cc:654] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.607692 22111 leader_election.cc:343] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.608171 22111 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:59.611064 22635 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:59.622025 22111 leader_election.cc:343] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.622103 21966 catalog_manager.cc:5697] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.633121 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:59.633898 22638 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.634284 22638 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.634684 22638 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.639678 22262 raft_consensus.cc:359] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.640532 22262 raft_consensus.cc:385] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.640815 22262 raft_consensus.cc:740] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.641682 22262 consensus_queue.cc:260] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.657997 22603 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.658527 22603 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.666319 22638 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.668246 22638 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:59.671509 22262 ts_tablet_manager.cc:1434] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 12:25:59.686131 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:59.686755 22065 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.690178 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:59.690843 22262 tablet_bootstrap.cc:492] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: Bootstrap starting.
I20260709 12:25:59.691876 22603 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:25:59.693653 22111 leader_election.cc:343] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.694965 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:25:59.698717 22598 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:59.704813 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:25:59.707541 22111 leader_election.cc:343] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.709314 22064 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:25:59.727419 22111 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:59.730839 22603 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.731257 22603 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.731614 22603 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.714218 22065 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:59.719521 22260 tablet_bootstrap.cc:492] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:59.723483 22619 consensus_queue.cc:1048] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.739053 22260 ts_tablet_manager.cc:1403] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.308s	user 0.012s	sys 0.010s
I20260709 12:25:59.744592 22603 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.740728 21966 catalog_manager.cc:5697] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.753566 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:25:59.753850 22261 tablet_bootstrap.cc:492] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.754236 22065 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.754397 22261 ts_tablet_manager.cc:1403] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.207s	user 0.013s	sys 0.015s
I20260709 12:25:59.756225 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:25:59.766081 22262 tablet_bootstrap.cc:654] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.778395 21967 catalog_manager.cc:5697] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.781368 22065 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:25:59.768383 22260 raft_consensus.cc:359] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.782056 22260 raft_consensus.cc:385] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.782366 22260 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.783061 22260 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.770227 22629 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.784395 22629 raft_consensus.cc:697] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:59.785282 22629 consensus_queue.cc:237] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.774375 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:25:59.768787 22603 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:25:59.774405 22261 raft_consensus.cc:359] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.788033 22261 raft_consensus.cc:385] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.788336 22261 raft_consensus.cc:740] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.789103 22261 consensus_queue.cc:260] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.790227 22260 ts_tablet_manager.cc:1434] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 12:25:59.791627 22261 ts_tablet_manager.cc:1434] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:25:59.792420 22260 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Bootstrap starting.
I20260709 12:25:59.792910 22261 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.797015 22262 tablet_bootstrap.cc:492] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: No bootstrap required, opened a new log
I20260709 12:25:59.798740 22111 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:25:59.800289 22646 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.800808 22646 raft_consensus.cc:697] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:25:59.801190 22262 ts_tablet_manager.cc:1403] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.008s
I20260709 12:25:59.801700 22646 consensus_queue.cc:237] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.804339 22262 raft_consensus.cc:359] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.805095 22262 raft_consensus.cc:385] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.805395 22262 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Initialized, Role: FOLLOWER
W20260709 12:25:59.808158 22111 leader_election.cc:343] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.811318 22261 tablet_bootstrap.cc:654] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.805970 22262 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:25:59.815663 22017 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:59.815783 22262 ts_tablet_manager.cc:1434] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:25:59.820106 22261 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.820605 22261 ts_tablet_manager.cc:1403] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.028s	user 0.002s	sys 0.009s
I20260709 12:25:59.822880 22261 raft_consensus.cc:359] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.823591 22261 raft_consensus.cc:385] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.823875 22261 raft_consensus.cc:740] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.824607 22261 consensus_queue.cc:260] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.833724 22261 ts_tablet_manager.cc:1434] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:25:59.834596 22214 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.834780 22261 tablet_bootstrap.cc:492] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.841678 22261 tablet_bootstrap.cc:654] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.841678 22260 tablet_bootstrap.cc:654] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.863952 22603 consensus_queue.cc:1048] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.864414 22261 tablet_bootstrap.cc:492] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.865921 22261 ts_tablet_manager.cc:1403] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.004s
I20260709 12:25:59.868839 22261 raft_consensus.cc:359] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.869504 22261 raft_consensus.cc:385] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.869784 22261 raft_consensus.cc:740] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.870344 22261 consensus_queue.cc:260] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.871338 21967 catalog_manager.cc:5697] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.872433 22261 ts_tablet_manager.cc:1434] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:25:59.872988 21967 catalog_manager.cc:5697] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.876848 22261 tablet_bootstrap.cc:492] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.880839 22260 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: No bootstrap required, opened a new log
I20260709 12:25:59.881364 22260 ts_tablet_manager.cc:1403] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.005s
I20260709 12:25:59.884244 22260 raft_consensus.cc:359] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.884965 22260 raft_consensus.cc:385] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.885285 22260 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.887038 22261 tablet_bootstrap.cc:654] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.886123 22260 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.896581 22260 ts_tablet_manager.cc:1434] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:59.901870 22388 consensus_queue.cc:1048] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.904119 22261 tablet_bootstrap.cc:492] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.904598 22261 ts_tablet_manager.cc:1403] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.016s
I20260709 12:25:59.907588 22261 raft_consensus.cc:359] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.914371 22261 raft_consensus.cc:385] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.914641 22261 raft_consensus.cc:740] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.915306 22261 consensus_queue.cc:260] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.917621 22261 ts_tablet_manager.cc:1434] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:25:59.918553 22261 tablet_bootstrap.cc:492] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.924798 22261 tablet_bootstrap.cc:654] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.935273 22261 tablet_bootstrap.cc:492] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.936142 22261 ts_tablet_manager.cc:1403] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 12:25:59.938279 22261 raft_consensus.cc:359] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.938742 22261 raft_consensus.cc:385] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.939007 22261 raft_consensus.cc:740] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.939606 22261 consensus_queue.cc:260] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.940832 22261 ts_tablet_manager.cc:1434] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20260709 12:25:59.942162 22261 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.946425 22220 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.950114 22214 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.956950 22261 tablet_bootstrap.cc:654] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.961673 22620 consensus_queue.cc:1048] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:59.963048 22598 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.963541 22598 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.962926 22619 consensus_queue.cc:1048] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.965574 22598 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:25:59.967408 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:25:59.970717 22261 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.971354 22261 ts_tablet_manager.cc:1403] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 12:25:59.971949 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:25:59.973846 22185 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:25:59.974797 22599 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.979023 22261 raft_consensus.cc:359] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.979712 22261 raft_consensus.cc:385] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.979987 22261 raft_consensus.cc:740] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.980768 22261 consensus_queue.cc:260] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:25:59.982709 22261 ts_tablet_manager.cc:1434] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:25:59.983673 22261 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:25:59.989769 22261 tablet_bootstrap.cc:654] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.995329 22261 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:25:59.995832 22261 ts_tablet_manager.cc:1403] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:26:00.001134 22261 raft_consensus.cc:359] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.001886 22261 raft_consensus.cc:385] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.002182 22261 raft_consensus.cc:740] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.002810 22261 consensus_queue.cc:260] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.004968 22261 ts_tablet_manager.cc:1434] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.002s
I20260709 12:26:00.006019 22261 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:26:00.012684 22261 tablet_bootstrap.cc:654] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.023695 22261 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:26:00.024166 22261 ts_tablet_manager.cc:1403] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.018s	user 0.001s	sys 0.009s
I20260709 12:26:00.026651 22261 raft_consensus.cc:359] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.027344 22261 raft_consensus.cc:385] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.027629 22261 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.028270 22261 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.030349 22261 ts_tablet_manager.cc:1434] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:26:00.032567 22261 tablet_bootstrap.cc:492] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b: Bootstrap starting.
I20260709 12:26:00.034379 22619 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.034904 22619 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.038283 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:00.038782 22261 tablet_bootstrap.cc:654] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.038969 22214 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:26:00.040279 22036 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:00.041299 22620 raft_consensus.cc:2804] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.041535 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:00.041838 22620 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.042214 22139 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:26:00.042371 22620 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.045835 22214 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.037124 22619 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:00.056541 22620 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.059165 22620 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:00.060400 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:00.061040 22139 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.061645 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:00.062173 22261 tablet_bootstrap.cc:492] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b: No bootstrap required, opened a new log
I20260709 12:26:00.062196 22220 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.062654 22261 ts_tablet_manager.cc:1403] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 12:26:00.065940 22261 raft_consensus.cc:359] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.066613 22261 raft_consensus.cc:385] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.066856 22261 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.067468 22261 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.068372 22603 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.068848 22603 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.069340 22220 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:00.071516 22603 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:00.071738 22036 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:00.072652 22620 raft_consensus.cc:2804] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.073122 22620 raft_consensus.cc:697] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:00.073975 22620 consensus_queue.cc:237] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.075732 22139 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:00.075635 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:00.078066 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:00.078661 22261 ts_tablet_manager.cc:1434] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:26:00.078792 22064 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:26:00.078168 22216 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 0.
I20260709 12:26:00.081902 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:00.083129 22638 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.083487 22638 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.083806 22638 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.087064 22598 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.087745 22598 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.091815 22574 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.092794 22574 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.094434 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:00.100683 22638 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.102424 22638 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:00.103159 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:00.104107 22064 raft_consensus.cc:2393] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 1: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:00.106828 22574 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:00.107381 22598 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:00.108099 22373 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.108533 22373 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.110404 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:00.110704 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:00.110458 22373 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:00.112414 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:00.112828 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:00.112993 22220 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.113193 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:00.113375 22068 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.113803 22139 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:26:00.115135 22035 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:00.116277 22373 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.116580 22373 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.116848 22373 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.117489 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:00.118242 22574 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.118666 22184 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:00.119719 22573 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.123966 22373 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.124668 22574 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.125756 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:00.126425 22214 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 0.
I20260709 12:26:00.127820 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:00.128460 22142 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.128968 22068 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:00.130714 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:00.133349 22638 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.133839 22638 raft_consensus.cc:697] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:00.134644 22638 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.135521 22220 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:00.136359 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:00.137954 22214 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.138600 22142 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:00.139763 22035 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:00.140556 22619 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.141018 22619 raft_consensus.cc:697] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:00.135231 22373 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 1 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:00.141770 21966 catalog_manager.cc:5697] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.142114 22619 consensus_queue.cc:237] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:00.148343 22214 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:00.159924 21966 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.165616 21967 catalog_manager.cc:5697] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.189575 22220 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.196286 22611 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.214558 22638 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.245419 22216 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.291245 22611 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.301090 22611 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:00.469274 22268 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.486362 22268 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.535781 22618 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.547133 22618 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:00.620889 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 51961.7us
W20260709 12:26:00.626240 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 57140.2us
I20260709 12:26:00.642280 22638 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.675935 22603 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.362722 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:01.387665 22692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:01.388545 22694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:01.388944 20873 server_base.cc:1061] running on GCE node
W20260709 12:26:01.389155 22691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:01.391700 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:01.391968 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:01.392175 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783599961392157 us; error 0 us; skew 500 ppm
I20260709 12:26:01.392777 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:01.396169 20873 webserver.cc:533] Webserver started at http://127.20.98.68:37031/ using document root <none> and password file <none>
I20260709 12:26:01.396703 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:01.396935 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:01.397316 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:01.398562 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-3-root/instance:
uuid: "ed678a3f9e3d4e0ba5801f1663548796"
format_stamp: "Formatted at 2026-07-09 12:26:01 on dist-test-slave-g3x6"
I20260709 12:26:01.403812 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:26:01.410320 22699 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:01.413296 20873 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:26:01.414156 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-3-root
uuid: "ed678a3f9e3d4e0ba5801f1663548796"
format_stamp: "Formatted at 2026-07-09 12:26:01 on dist-test-slave-g3x6"
I20260709 12:26:01.414630 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:01.429160 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:01.430727 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:01.432399 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:01.435087 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:01.435338 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:01.435601 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:01.435798 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:01.501992 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.68:44299
I20260709 12:26:01.502079 22761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.68:44299 every 8 connection(s)
I20260709 12:26:01.507243 20873 auto_leader_rebalancer-test.cc:439] add a tserver: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:01.522435 22762 heartbeater.cc:344] Connected to a master server at 127.20.98.126:34211
I20260709 12:26:01.524312 22762 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:01.525370 22762 heartbeater.cc:507] Master 127.20.98.126:34211 requested a full tablet report, sending...
I20260709 12:26:01.529330 21963 ts_manager.cc:194] Registered new tserver with Master: ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:01.531184 21963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40564
I20260709 12:26:01.947999 22140 consensus_queue.cc:237] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:01.954766 22216 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:01.958277 22068 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:01.959754 22769 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:01.960676 22603 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:01.984611 22111 consensus_peers.cc:597] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8e08d44df7b4ab4a3721b9aeb2aaa24. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:01.984004 22603 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:01.986690 22214 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:01.987340 22064 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.002756 21963 catalog_manager.cc:5697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.018630 22216 consensus_queue.cc:237] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.027336 22142 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.029464 22598 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.070382 22064 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.071832 22598 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.079164 22574 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.083696 22142 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
W20260709 12:26:02.087546 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51286e1e6cac4310b4960b85e10b91cd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.094347 22068 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.103627 21967 catalog_manager.cc:5697] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.106312 22214 consensus_queue.cc:237] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.120599 22142 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.122891 22783 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:02.126724 22185 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2012f4a3900141a5b86022143147dd81. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.130079 22064 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.132485 22783 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:02.135746 22574 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.143692 22068 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.146346 22142 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.166863 21967 catalog_manager.cc:5697] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.184779 22068 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.197474 22216 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.198752 22373 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:02.198767 22140 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:02.209787 22687 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:02.223037 22036 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 285ef7a597884d3a8a0ad5e993a8eb93. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:02.227991 22687 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.229524 22140 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.232802 22216 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:02.249322 21966 catalog_manager.cc:5697] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.342247 22795 ts_tablet_manager.cc:933] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:02.345548 22795 tablet_copy_client.cc:323] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:02.368641 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:02.369262 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-b8e08d44df7b4ab4a3721b9aeb2aaa24
I20260709 12:26:02.378039 22156 tablet_copy_source_session.cc:215] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:02.382428 22795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.395601 22795 tablet_copy_client.cc:806] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:02.396260 22795 tablet_copy_client.cc:670] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:02.402796 22795 tablet_copy_client.cc:538] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:02.412252 22795 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:02.433146 22795 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:02.434062 22795 tablet_bootstrap.cc:492] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:02.434621 22795 ts_tablet_manager.cc:1403] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.003s
I20260709 12:26:02.436996 22795 raft_consensus.cc:359] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.438141 22795 raft_consensus.cc:740] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:02.438805 22795 consensus_queue.cc:260] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.448463 22795 ts_tablet_manager.cc:1434] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:26:02.449226 22762 heartbeater.cc:499] Master 127.20.98.126:34211 was elected leader, sending a full tablet report...
I20260709 12:26:02.453486 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-b8e08d44df7b4ab4a3721b9aeb2aaa24 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:02.454174 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-b8e08d44df7b4ab4a3721b9aeb2aaa24 on tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:02.463217 22795 ts_tablet_manager.cc:933] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:02.464763 22795 tablet_copy_client.cc:323] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:02.475382 22230 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 51286e1e6cac4310b4960b85e10b91cd from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:02.476119 22230 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 51286e1e6cac4310b4960b85e10b91cd from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-51286e1e6cac4310b4960b85e10b91cd
I20260709 12:26:02.484897 22230 tablet_copy_source_session.cc:215] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:02.488467 22795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51286e1e6cac4310b4960b85e10b91cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.504112 22795 tablet_copy_client.cc:806] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:02.504793 22795 tablet_copy_client.cc:670] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:02.508908 22795 tablet_copy_client.cc:538] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:02.518739 22795 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:02.541563 22795 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:02.542579 22795 tablet_bootstrap.cc:492] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:02.543363 22795 ts_tablet_manager.cc:1403] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 12:26:02.547595 22795 raft_consensus.cc:359] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.548688 22795 raft_consensus.cc:740] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:02.549728 22795 consensus_queue.cc:260] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.552346 22795 ts_tablet_manager.cc:1434] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:26:02.557056 22230 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-51286e1e6cac4310b4960b85e10b91cd received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:02.557605 22230 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-51286e1e6cac4310b4960b85e10b91cd on tablet 51286e1e6cac4310b4960b85e10b91cd with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:02.574309 22795 ts_tablet_manager.cc:933] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:02.577077 22795 tablet_copy_client.cc:323] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:02.589210 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet 285ef7a597884d3a8a0ad5e993a8eb93 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:02.589860 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet 285ef7a597884d3a8a0ad5e993a8eb93 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-285ef7a597884d3a8a0ad5e993a8eb93
I20260709 12:26:02.599280 22081 tablet_copy_source_session.cc:215] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:02.601951 22795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 285ef7a597884d3a8a0ad5e993a8eb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.629273 22795 tablet_copy_client.cc:806] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:02.631011 22803 ts_tablet_manager.cc:933] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:02.633083 22795 tablet_copy_client.cc:670] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:02.638685 22795 tablet_copy_client.cc:538] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:02.650352 22803 tablet_copy_client.cc:323] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:02.650789 22795 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:02.652500 22230 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 2012f4a3900141a5b86022143147dd81 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:02.653088 22230 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 2012f4a3900141a5b86022143147dd81 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-2012f4a3900141a5b86022143147dd81
I20260709 12:26:02.663564 22230 tablet_copy_source_session.cc:215] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:02.667769 22803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2012f4a3900141a5b86022143147dd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:02.676656 22795 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:02.679010 22795 tablet_bootstrap.cc:492] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:02.679721 22795 ts_tablet_manager.cc:1403] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.003s
I20260709 12:26:02.682929 22795 raft_consensus.cc:359] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.683727 22795 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:02.684324 22795 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.686671 22795 ts_tablet_manager.cc:1434] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:02.688697 22803 tablet_copy_client.cc:806] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:02.689131 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-285ef7a597884d3a8a0ad5e993a8eb93 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:02.689740 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-285ef7a597884d3a8a0ad5e993a8eb93 on tablet 285ef7a597884d3a8a0ad5e993a8eb93 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:02.689266 22803 tablet_copy_client.cc:670] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:02.699584 22803 tablet_copy_client.cc:538] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:02.707859 22803 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:02.731186 22803 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:02.732180 22803 tablet_bootstrap.cc:492] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:02.732923 22803 ts_tablet_manager.cc:1403] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:26:02.736143 22803 raft_consensus.cc:359] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.737110 22803 raft_consensus.cc:740] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:02.737879 22803 consensus_queue.cc:260] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:02.741835 22803 ts_tablet_manager.cc:1434] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:26:02.744083 22230 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2012f4a3900141a5b86022143147dd81 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:02.744509 22230 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2012f4a3900141a5b86022143147dd81 on tablet 2012f4a3900141a5b86022143147dd81 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:02.910153 22737 raft_consensus.cc:1217] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:02.983866 22737 raft_consensus.cc:1217] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:03.020232 22737 raft_consensus.cc:1217] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:03.042608 22737 raft_consensus.cc:1217] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:03.372985 22687 raft_consensus.cc:1064] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:03.375617 22687 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:03.388072 22737 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.388968 22216 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.389580 22139 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.390861 22687 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.391742 22373 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.393347 22791 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.418741 22687 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.421474 22737 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.426589 22214 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.435411 22139 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.441793 22603 raft_consensus.cc:1064] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:03.449090 22603 consensus_queue.cc:237] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:03.470719 21966 catalog_manager.cc:5697] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.474472 22787 raft_consensus.cc:1064] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:03.477083 22787 consensus_queue.cc:237] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:03.500690 22214 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.503206 22737 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.504318 22068 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.512972 22574 raft_consensus.cc:1064] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:03.517274 22769 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:03.519070 22611 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.521358 22611 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:03.520972 22574 consensus_queue.cc:237] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:03.533576 22143 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.533733 22736 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.536546 22068 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.536515 22807 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.537735 22817 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.543207 22807 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:03.556830 22807 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.560389 22143 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.564173 22064 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:03.603799 22737 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.604314 22071 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.609898 22823 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:03.639837 22140 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:03.642089 22791 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:03.654353 22139 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:03.653357 22373 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.660653 22737 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:03.659379 22139 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.667197 22769 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.711632 22216 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.719273 22807 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.723610 22791 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:03.728106 22737 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.733565 22736 raft_consensus.cc:2955] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.735025 22070 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.742238 21965 catalog_manager.cc:5697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.730679 21963 catalog_manager.cc:5697] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.786959 22823 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.789191 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 285ef7a597884d3a8a0ad5e993a8eb93 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:03.795605 22216 consensus_queue.cc:237] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:03.811390 21963 catalog_manager.cc:5697] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.813539 22070 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.821954 22737 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:03.832949 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet 285ef7a597884d3a8a0ad5e993a8eb93 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:03.835395 22787 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:03.838654 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 106051us
I20260709 12:26:03.844041 22834 tablet_replica.cc:333] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:03.844511 22574 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.849470 22817 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.866505 22834 raft_consensus.cc:2243] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.852404 22736 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.867800 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2012f4a3900141a5b86022143147dd81 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:03.868485 22834 raft_consensus.cc:2272] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.873009 22834 ts_tablet_manager.cc:1916] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:03.849139 22070 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.879106 22737 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:26:03.897285 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 51582.6us
I20260709 12:26:03.898386 21967 catalog_manager.cc:5697] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.900164 21963 catalog_manager.cc:5697] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.913734 22140 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:03.917372 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 2012f4a3900141a5b86022143147dd81 with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:03.923843 22834 ts_tablet_manager.cc:1929] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:03.929816 22834 log.cc:1199] T 285ef7a597884d3a8a0ad5e993a8eb93 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/285ef7a597884d3a8a0ad5e993a8eb93
I20260709 12:26:03.931728 22216 consensus_queue.cc:237] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:03.933743 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet 285ef7a597884d3a8a0ad5e993a8eb93 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:03.938822 22736 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:03.939414 22837 tablet_replica.cc:333] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:03.940920 22574 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:03.943845 22736 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.947177 22070 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:03.950656 22574 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:03.959739 22737 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.960301 22574 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.966991 22070 raft_consensus.cc:2955] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:03.974749 22837 raft_consensus.cc:2243] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:03.980149 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51286e1e6cac4310b4960b85e10b91cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:03.985045 22837 raft_consensus.cc:2272] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:03.986792 21966 catalog_manager.cc:5697] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:03.992806 22817 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:04.002307 22837 ts_tablet_manager.cc:1916] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:04.006948 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet 51286e1e6cac4310b4960b85e10b91cd with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:04.022308 22839 tablet_replica.cc:333] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:04.028038 22839 raft_consensus.cc:2243] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.028926 22839 pending_rounds.cc:70] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Trying to abort 1 pending ops.
I20260709 12:26:04.029364 22839 pending_rounds.cc:77] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305625450559234048 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "51286e1e6cac4310b4960b85e10b91cd" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } } }
I20260709 12:26:04.030805 22839 raft_consensus.cc:2917] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:26:04.037562 22839 raft_consensus.cc:2889] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:26:04.038272 22839 raft_consensus.cc:2272] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.044391 22839 ts_tablet_manager.cc:1916] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:04.053157 22837 ts_tablet_manager.cc:1929] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:04.053685 22837 log.cc:1199] T 2012f4a3900141a5b86022143147dd81 P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/2012f4a3900141a5b86022143147dd81
I20260709 12:26:04.058050 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet 2012f4a3900141a5b86022143147dd81 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:04.062548 22839 ts_tablet_manager.cc:1929] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:04.063138 22839 log.cc:1199] T 51286e1e6cac4310b4960b85e10b91cd P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/51286e1e6cac4310b4960b85e10b91cd
I20260709 12:26:04.065328 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 51286e1e6cac4310b4960b85e10b91cd (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:04.098534 22146 consensus_queue.cc:237] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:04.108911 22139 raft_consensus.cc:2955] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:04.128182 22736 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.128923 22066 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:04.148268 22838 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:04.154276 22831 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:04.166229 22831 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:04.167992 22070 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:04.167873 22736 raft_consensus.cc:2955] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:04.183955 21966 catalog_manager.cc:5697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:04.186164 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:04.197419 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:04.198393 22834 tablet_replica.cc:333] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:04.199462 22834 raft_consensus.cc:2243] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:04.200264 22834 raft_consensus.cc:2272] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:04.203804 22834 ts_tablet_manager.cc:1916] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:04.216041 22834 ts_tablet_manager.cc:1929] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:04.216506 22834 log.cc:1199] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/b8e08d44df7b4ab4a3721b9aeb2aaa24
I20260709 12:26:04.218266 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet b8e08d44df7b4ab4a3721b9aeb2aaa24 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:05.263832 22216 consensus_queue.cc:237] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:05.269500 22142 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:05.271057 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2100de7ab7b84cf39a4370858e9b6927. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.271173 22817 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.271739 22070 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.273087 22807 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.280778 22844 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.283385 22142 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.288297 22066 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.299808 21965 catalog_manager.cc:5697] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.304325 22142 consensus_queue.cc:237] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:05.312220 22217 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:05.313587 22111 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2b9f971fd394d129cd62de001799b21. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.313517 22066 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.314508 22831 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.315591 22840 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.340380 22831 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.348845 22066 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.365078 22217 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.369366 21963 catalog_manager.cc:5697] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.375264 22146 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:05.388649 22216 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:05.389950 22111 consensus_peers.cc:597] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31f3273ca74242e9b116e3e87078ccef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.390820 22831 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.392841 22070 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.394272 22831 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:05.405154 22835 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.410153 22216 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.430545 22216 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:05.436661 21965 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.441617 22139 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:05.443076 22185 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45d56621ac1d470dac3f492c5c1b5256. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.439622 22066 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.444564 22070 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.445398 22807 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.446290 22845 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.470888 22807 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.475152 22070 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.488845 22139 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:05.492796 21963 catalog_manager.cc:5697] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.798525 22861 ts_tablet_manager.cc:933] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:05.806428 22861 tablet_copy_client.cc:323] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:05.808274 22230 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 2100de7ab7b84cf39a4370858e9b6927 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:05.808879 22230 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 2100de7ab7b84cf39a4370858e9b6927 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-2100de7ab7b84cf39a4370858e9b6927
I20260709 12:26:05.815536 22230 tablet_copy_source_session.cc:215] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:05.818332 22861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2100de7ab7b84cf39a4370858e9b6927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.832631 22861 tablet_copy_client.cc:806] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:05.833263 22861 tablet_copy_client.cc:670] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:05.839592 22861 tablet_copy_client.cc:538] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:05.848410 22861 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:05.865309 22861 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:05.866019 22861 tablet_bootstrap.cc:492] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:05.866575 22861 ts_tablet_manager.cc:1403] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.005s
I20260709 12:26:05.868813 22861 raft_consensus.cc:359] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:05.869550 22861 raft_consensus.cc:740] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:05.870253 22861 consensus_queue.cc:260] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:05.874245 22861 ts_tablet_manager.cc:1434] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:05.877538 22230 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2100de7ab7b84cf39a4370858e9b6927 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:05.877991 22230 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2100de7ab7b84cf39a4370858e9b6927 on tablet 2100de7ab7b84cf39a4370858e9b6927 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:05.889161 22861 ts_tablet_manager.cc:933] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:05.894618 22861 tablet_copy_client.cc:323] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:05.896438 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet f2b9f971fd394d129cd62de001799b21 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:05.897055 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet f2b9f971fd394d129cd62de001799b21 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-f2b9f971fd394d129cd62de001799b21
I20260709 12:26:05.906642 22156 tablet_copy_source_session.cc:215] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:05.910732 22861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b9f971fd394d129cd62de001799b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.929448 22861 tablet_copy_client.cc:806] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:05.930027 22861 tablet_copy_client.cc:670] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:05.935231 22861 tablet_copy_client.cc:538] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:05.945996 22861 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:05.980224 22866 ts_tablet_manager.cc:933] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:05.982566 22866 tablet_copy_client.cc:323] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:05.984191 22861 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:05.984514 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet 31f3273ca74242e9b116e3e87078ccef from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:05.985060 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet 31f3273ca74242e9b116e3e87078ccef from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-31f3273ca74242e9b116e3e87078ccef
I20260709 12:26:05.986852 22861 tablet_bootstrap.cc:492] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:05.987681 22861 ts_tablet_manager.cc:1403] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.018s
I20260709 12:26:05.991037 22861 raft_consensus.cc:359] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:05.991952 22861 raft_consensus.cc:740] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:05.992668 22861 consensus_queue.cc:260] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:06.003520 22861 ts_tablet_manager.cc:1434] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:26:06.006217 22156 tablet_copy_source_session.cc:215] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.015399 22866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31f3273ca74242e9b116e3e87078ccef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.024232 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f2b9f971fd394d129cd62de001799b21 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:06.024762 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f2b9f971fd394d129cd62de001799b21 on tablet f2b9f971fd394d129cd62de001799b21 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:06.034946 22861 ts_tablet_manager.cc:933] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:06.040930 22861 tablet_copy_client.cc:323] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:06.043308 22230 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 45d56621ac1d470dac3f492c5c1b5256 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:06.043927 22230 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 45d56621ac1d470dac3f492c5c1b5256 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-45d56621ac1d470dac3f492c5c1b5256
I20260709 12:26:06.052271 22230 tablet_copy_source_session.cc:215] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.056214 22861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d56621ac1d470dac3f492c5c1b5256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.056958 22866 tablet_copy_client.cc:806] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.057916 22866 tablet_copy_client.cc:670] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.064179 22866 tablet_copy_client.cc:538] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.072067 22866 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:06.074893 22861 tablet_copy_client.cc:806] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:06.075758 22861 tablet_copy_client.cc:670] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:06.081274 22861 tablet_copy_client.cc:538] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:06.089269 22861 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:06.105931 22866 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:06.106757 22866 tablet_bootstrap.cc:492] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:06.107403 22866 ts_tablet_manager.cc:1403] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.005s
I20260709 12:26:06.111567 22866 raft_consensus.cc:359] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:06.112485 22866 raft_consensus.cc:740] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:06.114192 22861 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:06.113732 22866 consensus_queue.cc:260] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:06.115164 22861 tablet_bootstrap.cc:492] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:06.115870 22861 ts_tablet_manager.cc:1403] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.004s
I20260709 12:26:06.116374 22866 ts_tablet_manager.cc:1434] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:26:06.121044 22861 raft_consensus.cc:359] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:06.121918 22861 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:06.123236 22861 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:06.125401 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-31f3273ca74242e9b116e3e87078ccef received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:06.125916 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-31f3273ca74242e9b116e3e87078ccef on tablet 31f3273ca74242e9b116e3e87078ccef with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:06.128539 22861 ts_tablet_manager.cc:1434] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:26:06.133898 22230 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-45d56621ac1d470dac3f492c5c1b5256 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:06.134363 22230 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-45d56621ac1d470dac3f492c5c1b5256 on tablet 45d56621ac1d470dac3f492c5c1b5256 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:06.323999 22737 raft_consensus.cc:1217] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.502552 22737 raft_consensus.cc:1217] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.535354 22737 raft_consensus.cc:1217] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.631242 22737 raft_consensus.cc:1217] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.702562 22845 raft_consensus.cc:1064] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:06.705541 22845 consensus_queue.cc:237] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:06.718461 22142 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.718523 22737 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.719949 22845 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.721258 22066 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.721231 22873 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:06.722965 22817 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.736632 22845 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.737007 22142 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.761852 21965 catalog_manager.cc:5697] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.764103 22066 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.766956 22737 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.848217 22216 consensus_queue.cc:237] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:06.853790 22737 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.857093 22065 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.858683 22817 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:06.860561 22817 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:06.871004 22880 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.874991 22737 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.876778 22065 raft_consensus.cc:2955] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.881937 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2100de7ab7b84cf39a4370858e9b6927 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:06.892135 21966 catalog_manager.cc:5697] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.902733 22854 raft_consensus.cc:1064] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:06.904768 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet 2100de7ab7b84cf39a4370858e9b6927 with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:06.906165 22854 consensus_queue.cc:237] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:06.924669 22885 tablet_replica.cc:333] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:06.925784 22885 raft_consensus.cc:2243] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:06.926561 22885 raft_consensus.cc:2272] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:06.929952 22885 ts_tablet_manager.cc:1916] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:06.931460 22217 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.932241 22737 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.931460 22065 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.934562 22835 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.935406 22854 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.937364 22874 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.945816 22885 ts_tablet_manager.cc:1929] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:06.947271 22885 log.cc:1199] T 2100de7ab7b84cf39a4370858e9b6927 P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/2100de7ab7b84cf39a4370858e9b6927
I20260709 12:26:06.949394 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 2100de7ab7b84cf39a4370858e9b6927 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:06.992063 22857 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.993297 22070 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:06.996670 22737 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.006639 22217 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.012318 21966 catalog_manager.cc:5697] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.034902 22142 consensus_queue.cc:237] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:07.041884 22217 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.042001 22737 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.043358 22835 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.044368 22854 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.054126 22835 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.067694 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2b9f971fd394d129cd62de001799b21 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.072778 22216 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.068146 22737 raft_consensus.cc:2955] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.089340 21967 catalog_manager.cc:5697] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.109040 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet f2b9f971fd394d129cd62de001799b21 with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:07.111174 22890 tablet_replica.cc:333] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:07.112289 22890 raft_consensus.cc:2243] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.113116 22890 raft_consensus.cc:2272] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.116750 22890 ts_tablet_manager.cc:1916] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.125932 22840 raft_consensus.cc:1064] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:07.130710 22840 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:07.141688 22890 ts_tablet_manager.cc:1929] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.142378 22890 log.cc:1199] T f2b9f971fd394d129cd62de001799b21 P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/f2b9f971fd394d129cd62de001799b21
I20260709 12:26:07.144004 22217 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.144945 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet f2b9f971fd394d129cd62de001799b21 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:07.147264 22736 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.147523 22840 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.148967 22070 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.149150 22854 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:07.150602 22880 raft_consensus.cc:1064] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:07.151113 22854 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.153107 22880 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:07.189301 22736 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.188135 22840 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.190896 22873 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.191936 22070 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.194383 22142 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.196844 22817 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.198278 22070 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.198946 22817 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:07.208971 22737 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.231608 21967 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.248616 22217 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.274523 22142 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:07.322919 22070 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.323397 22737 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.335155 22873 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.339260 22857 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.344676 22066 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.353229 22899 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:07.355906 22874 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.369289 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 31f3273ca74242e9b116e3e87078ccef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.380151 21963 catalog_manager.cc:5697] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.383705 22070 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.366076 22736 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.383742 21967 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.401656 22737 raft_consensus.cc:2955] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.413702 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet 31f3273ca74242e9b116e3e87078ccef with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:07.423254 22142 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.430486 22900 tablet_replica.cc:333] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:07.436076 22900 raft_consensus.cc:2243] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.437225 22900 raft_consensus.cc:2272] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.445051 22217 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:07.448240 22900 ts_tablet_manager.cc:1916] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.471441 22139 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.472538 22737 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.472759 22880 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.476143 22880 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.476475 22900 ts_tablet_manager.cc:1929] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.481606 22900 log.cc:1199] T 31f3273ca74242e9b116e3e87078ccef P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/31f3273ca74242e9b116e3e87078ccef
I20260709 12:26:07.485841 22879 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.487733 22737 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.489212 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet 31f3273ca74242e9b116e3e87078ccef (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:07.490684 22139 raft_consensus.cc:2955] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.504091 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45d56621ac1d470dac3f492c5c1b5256 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.504423 21963 catalog_manager.cc:5697] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:07.519161 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 45d56621ac1d470dac3f492c5c1b5256 with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:07.520167 22890 tablet_replica.cc:333] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:07.531361 22890 raft_consensus.cc:2243] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.532099 22890 raft_consensus.cc:2272] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.539927 22890 ts_tablet_manager.cc:1916] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.555377 22890 ts_tablet_manager.cc:1929] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.556530 22890 log.cc:1199] T 45d56621ac1d470dac3f492c5c1b5256 P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/45d56621ac1d470dac3f492c5c1b5256
I20260709 12:26:07.558524 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet 45d56621ac1d470dac3f492c5c1b5256 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:08.592335 22214 consensus_queue.cc:237] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:08.598739 22139 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:08.599916 22185 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33d4294bcbec49ad88c8ce7c879b596d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.600133 22880 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.601441 22067 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.602860 22880 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.613875 22902 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.615324 22139 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.616986 22067 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.630136 22217 consensus_queue.cc:237] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:08.639007 21967 catalog_manager.cc:5697] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.653708 22139 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.655254 22902 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:08.657294 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fec8474cec64acca2f6f9303db0b0af. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.658306 22067 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.659622 22902 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.666923 22906 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.681419 22139 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.687188 22070 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.710839 21966 catalog_manager.cc:5697] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.726961 22067 consensus_queue.cc:237] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:08.739367 22214 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:08.739749 22036 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d4304a0cf75473e8fd1d5791213f0a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.740607 22139 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.740607 22870 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:08.742336 22830 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.754827 22870 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.757828 22139 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.758620 22214 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.773097 22139 consensus_queue.cc:237] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:08.778095 21963 catalog_manager.cc:5697] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.793982 22214 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:08.794902 22111 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c66fbf1879e84a19b490058938a4bc34. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.795089 22070 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.795822 22916 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.796727 22899 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.813584 22916 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.815407 22214 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.815407 22067 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:08.837248 21967 catalog_manager.cc:5697] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:09.128293 22928 ts_tablet_manager.cc:933] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:09.155663 22928 tablet_copy_client.cc:323] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:09.158293 22930 ts_tablet_manager.cc:933] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:09.163430 22230 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 1fec8474cec64acca2f6f9303db0b0af from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:09.164448 22230 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 1fec8474cec64acca2f6f9303db0b0af from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-1fec8474cec64acca2f6f9303db0b0af
I20260709 12:26:09.177676 22931 ts_tablet_manager.cc:933] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:09.179039 22230 tablet_copy_source_session.cc:215] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.182657 22930 tablet_copy_client.cc:323] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:09.187182 22229 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 33d4294bcbec49ad88c8ce7c879b596d from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:09.188234 22229 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 33d4294bcbec49ad88c8ce7c879b596d from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-33d4294bcbec49ad88c8ce7c879b596d
I20260709 12:26:09.191464 22928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec8474cec64acca2f6f9303db0b0af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.236279 22229 tablet_copy_source_session.cc:215] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:26:09.240729 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 64851.7us
W20260709 12:26:09.241953 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 64838.6us
I20260709 12:26:09.266103 22931 tablet_copy_client.cc:323] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:09.268676 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet 8d4304a0cf75473e8fd1d5791213f0a3 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:09.269309 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet 8d4304a0cf75473e8fd1d5791213f0a3 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-8d4304a0cf75473e8fd1d5791213f0a3
I20260709 12:26:09.279608 22930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d4294bcbec49ad88c8ce7c879b596d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.284631 22081 tablet_copy_source_session.cc:215] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.287745 22928 tablet_copy_client.cc:806] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.288600 22928 tablet_copy_client.cc:670] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.289935 22931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4304a0cf75473e8fd1d5791213f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.304373 22928 tablet_copy_client.cc:538] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.312638 22935 ts_tablet_manager.cc:933] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:09.317831 22930 tablet_copy_client.cc:806] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.318549 22930 tablet_copy_client.cc:670] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.319998 22928 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:09.322255 22935 tablet_copy_client.cc:323] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:09.323009 22930 tablet_copy_client.cc:538] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.324839 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet c66fbf1879e84a19b490058938a4bc34 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:09.325625 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet c66fbf1879e84a19b490058938a4bc34 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-c66fbf1879e84a19b490058938a4bc34
I20260709 12:26:09.334019 22930 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:09.336202 22931 tablet_copy_client.cc:806] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.345716 22931 tablet_copy_client.cc:670] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.344071 22156 tablet_copy_source_session.cc:215] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.350782 22931 tablet_copy_client.cc:538] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.353276 22935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66fbf1879e84a19b490058938a4bc34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.364773 22931 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:09.396697 22931 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.397737 22931 tablet_bootstrap.cc:492] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:09.398491 22931 ts_tablet_manager.cc:1403] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.011s
I20260709 12:26:09.405746 22931 raft_consensus.cc:359] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.407246 22931 raft_consensus.cc:740] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:09.408059 22931 consensus_queue.cc:260] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.410322 22935 tablet_copy_client.cc:806] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.410961 22930 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.411542 22935 tablet_copy_client.cc:670] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.413200 22930 tablet_bootstrap.cc:492] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:09.414077 22930 ts_tablet_manager.cc:1403] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.018s
I20260709 12:26:09.424387 22930 raft_consensus.cc:359] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.425421 22930 raft_consensus.cc:740] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:09.426632 22930 consensus_queue.cc:260] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.425920 22935 tablet_copy_client.cc:538] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.444773 22930 ts_tablet_manager.cc:1434] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:26:09.449893 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-33d4294bcbec49ad88c8ce7c879b596d received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:09.450464 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-33d4294bcbec49ad88c8ce7c879b596d on tablet 33d4294bcbec49ad88c8ce7c879b596d with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:09.462563 22928 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.463755 22928 tablet_bootstrap.cc:492] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:09.466252 22928 ts_tablet_manager.cc:1403] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.147s	user 0.020s	sys 0.014s
I20260709 12:26:09.469601 22928 raft_consensus.cc:359] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.464967 22935 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:09.481282 22928 raft_consensus.cc:740] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:09.482168 22928 consensus_queue.cc:260] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.485102 22928 ts_tablet_manager.cc:1434] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:26:09.487892 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-1fec8474cec64acca2f6f9303db0b0af received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:09.488338 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-1fec8474cec64acca2f6f9303db0b0af on tablet 1fec8474cec64acca2f6f9303db0b0af with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:09.510526 22935 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.511677 22935 tablet_bootstrap.cc:492] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:09.512465 22935 ts_tablet_manager.cc:1403] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.008s
I20260709 12:26:09.515594 22935 raft_consensus.cc:359] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.516539 22935 raft_consensus.cc:740] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:09.517370 22935 consensus_queue.cc:260] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:09.520138 22935 ts_tablet_manager.cc:1434] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:09.523268 22931 ts_tablet_manager.cc:1434] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.124s	user 0.041s	sys 0.030s
I20260709 12:26:09.525774 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-8d4304a0cf75473e8fd1d5791213f0a3 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:09.526214 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-8d4304a0cf75473e8fd1d5791213f0a3 on tablet 8d4304a0cf75473e8fd1d5791213f0a3 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:09.528841 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-c66fbf1879e84a19b490058938a4bc34 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:09.529328 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-c66fbf1879e84a19b490058938a4bc34 on tablet c66fbf1879e84a19b490058938a4bc34 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:09.684790 22736 raft_consensus.cc:1217] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:09.687568 22736 raft_consensus.cc:1217] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:09.705749 22736 raft_consensus.cc:1217] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:09.736821 22736 raft_consensus.cc:1217] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:10.092978 22921 raft_consensus.cc:1064] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:10.095793 22921 consensus_queue.cc:237] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.102802 22736 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.102942 22213 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.104578 22140 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.107331 22927 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.108529 22870 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.110620 22870 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.124490 22943 raft_consensus.cc:1064] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:10.127585 22943 consensus_queue.cc:237] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.137465 22901 raft_consensus.cc:1064] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:10.143606 22901 consensus_queue.cc:237] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.147619 22870 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.149374 22140 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.174153 22736 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.175948 22952 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.182492 22067 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.183921 22901 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.193638 22735 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.194772 22216 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.199411 22213 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.204641 22952 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.218129 21966 catalog_manager.cc:5697] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.251101 22952 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.253310 22736 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.291602 22907 raft_consensus.cc:1064] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:10.294360 22907 consensus_queue.cc:237] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.314031 22737 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.314445 22216 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.317858 22917 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.319583 22067 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.322089 22067 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.328063 22917 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.356917 22140 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.370786 22943 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.371433 22067 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.371537 22737 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.373692 22957 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.375690 22957 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.400178 22140 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.402832 22957 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.404963 22070 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.411404 22907 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.413575 22943 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.421983 22067 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.426533 22735 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.440511 22736 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.444103 22140 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.449738 21965 catalog_manager.cc:5697] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.458102 22142 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.488644 21963 catalog_manager.cc:5697] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.489727 22142 consensus_queue.cc:237] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.490906 21963 catalog_manager.cc:5697] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.500674 22736 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.501080 22214 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.503192 22952 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.504540 22899 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:10.513561 22901 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.518935 22216 consensus_queue.cc:237] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.523010 22067 consensus_queue.cc:237] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.531006 22214 consensus_queue.cc:237] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:10.532389 22139 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.535327 22735 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.537693 22736 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.538829 22070 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.539726 22917 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.540177 22921 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.542052 22927 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.544327 22907 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.552028 22870 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.555001 22735 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.559955 22067 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.559617 22139 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.561106 22735 raft_consensus.cc:2955] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.563742 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d4304a0cf75473e8fd1d5791213f0a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.570061 22957 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.570856 22970 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:26:10.573982 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 61663us
I20260709 12:26:10.576386 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c66fbf1879e84a19b490058938a4bc34 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.580847 21965 catalog_manager.cc:5697] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.596598 22067 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.585083 22736 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.589408 22917 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.593290 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33d4294bcbec49ad88c8ce7c879b596d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.592630 22737 raft_consensus.cc:2955] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.600235 21963 catalog_manager.cc:5697] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.594229 22214 raft_consensus.cc:2955] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.629395 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet c66fbf1879e84a19b490058938a4bc34 with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:10.628341 21967 catalog_manager.cc:5697] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.636425 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4304a0cf75473e8fd1d5791213f0a3 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:10.667439 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d4294bcbec49ad88c8ce7c879b596d with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:10.680521 22973 tablet_replica.cc:333] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:10.682238 22907 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.690532 22735 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.688616 22972 tablet_replica.cc:333] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:10.697744 22973 raft_consensus.cc:2243] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.698701 22973 raft_consensus.cc:2272] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.701378 22972 raft_consensus.cc:2243] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.702301 22972 raft_consensus.cc:2272] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.702168 22070 raft_consensus.cc:2955] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.704407 22974 tablet_replica.cc:333] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:10.705691 22974 raft_consensus.cc:2243] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.708990 22972 ts_tablet_manager.cc:1916] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.718959 21965 catalog_manager.cc:5697] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:10.725138 22973 ts_tablet_manager.cc:1916] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.726028 22974 raft_consensus.cc:2272] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.730311 22974 ts_tablet_manager.cc:1916] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.751994 22972 ts_tablet_manager.cc:1929] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.752682 22972 log.cc:1199] T c66fbf1879e84a19b490058938a4bc34 P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/c66fbf1879e84a19b490058938a4bc34
I20260709 12:26:10.754554 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet c66fbf1879e84a19b490058938a4bc34 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:10.760178 22974 ts_tablet_manager.cc:1929] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.760798 22974 log.cc:1199] T 33d4294bcbec49ad88c8ce7c879b596d P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/33d4294bcbec49ad88c8ce7c879b596d
I20260709 12:26:10.763727 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 33d4294bcbec49ad88c8ce7c879b596d (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:10.764137 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fec8474cec64acca2f6f9303db0b0af with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:10.766089 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fec8474cec64acca2f6f9303db0b0af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.772066 22974 tablet_replica.cc:333] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:10.763391 22973 ts_tablet_manager.cc:1929] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.774003 22974 raft_consensus.cc:2243] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.774425 22973 log.cc:1199] T 8d4304a0cf75473e8fd1d5791213f0a3 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/8d4304a0cf75473e8fd1d5791213f0a3
I20260709 12:26:10.775059 22974 raft_consensus.cc:2272] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.776615 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet 8d4304a0cf75473e8fd1d5791213f0a3 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:10.779392 22974 ts_tablet_manager.cc:1916] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.798565 22974 ts_tablet_manager.cc:1929] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.798959 22974 log.cc:1199] T 1fec8474cec64acca2f6f9303db0b0af P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/1fec8474cec64acca2f6f9303db0b0af
I20260709 12:26:10.800290 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 1fec8474cec64acca2f6f9303db0b0af (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:11.860885 22216 consensus_queue.cc:237] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:11.867295 22139 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.869375 22065 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:11.870668 22185 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e89ee7eb571454eb9956953ae2c7c5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.870482 22978 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:11.872053 22970 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.884922 22142 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:11.882906 22970 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:11.905495 22070 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:11.915616 22065 consensus_queue.cc:237] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:11.922437 21965 catalog_manager.cc:5697] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:11.936395 22216 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.938344 22142 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:11.938968 22036 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97b8db04a690435f8c84aba1b0f5ec2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.945842 22921 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.949282 22921 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.959460 22976 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:11.961941 22142 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:11.979682 22142 consensus_queue.cc:237] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.051002 21963 catalog_manager.cc:5697] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.086396 22216 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.150801 22214 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.151876 22065 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.159149 22951 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:12.160269 22111 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40fdb108e6f14522a9ef82da47fc0b74. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.161748 22997 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:26:12.174692 22997 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.176736 22065 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.184435 22216 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.198243 21963 catalog_manager.cc:5697] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.192617 22146 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.210443 22216 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:12.211457 22070 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:12.213531 22111 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f77cd08fd9014998aebc07bff003d1a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.214524 22994 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:12.215644 22996 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.231936 22065 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.230132 22997 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.240479 22216 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:12.254395 21965 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.346171 23003 ts_tablet_manager.cc:933] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:12.348381 23003 tablet_copy_client.cc:323] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:12.350167 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet 97b8db04a690435f8c84aba1b0f5ec2b from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:12.350761 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet 97b8db04a690435f8c84aba1b0f5ec2b from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-97b8db04a690435f8c84aba1b0f5ec2b
I20260709 12:26:12.359004 22081 tablet_copy_source_session.cc:215] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.373381 23003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b8db04a690435f8c84aba1b0f5ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.382844 23005 ts_tablet_manager.cc:933] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:12.393265 23005 tablet_copy_client.cc:323] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:12.395012 22229 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 5e89ee7eb571454eb9956953ae2c7c5d from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:12.395579 22229 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 5e89ee7eb571454eb9956953ae2c7c5d from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-5e89ee7eb571454eb9956953ae2c7c5d
I20260709 12:26:12.398772 23003 tablet_copy_client.cc:806] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.399434 23003 tablet_copy_client.cc:670] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.403826 22229 tablet_copy_source_session.cc:215] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.405939 23003 tablet_copy_client.cc:538] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.408656 23005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e89ee7eb571454eb9956953ae2c7c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.416290 23003 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:12.430789 23005 tablet_copy_client.cc:806] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.431627 23005 tablet_copy_client.cc:670] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.436762 23005 tablet_copy_client.cc:538] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.441497 23003 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.442519 23003 tablet_bootstrap.cc:492] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:12.443293 23003 ts_tablet_manager.cc:1403] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 12:26:12.446789 23005 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:12.447717 23003 raft_consensus.cc:359] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.448808 23003 raft_consensus.cc:740] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:12.449717 23003 consensus_queue.cc:260] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.453092 23003 ts_tablet_manager.cc:1434] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:26:12.461236 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-97b8db04a690435f8c84aba1b0f5ec2b received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:12.461683 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-97b8db04a690435f8c84aba1b0f5ec2b on tablet 97b8db04a690435f8c84aba1b0f5ec2b with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:12.480208 23005 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.481247 23005 tablet_bootstrap.cc:492] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:12.482017 23005 ts_tablet_manager.cc:1403] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.009s
I20260709 12:26:12.485287 23005 raft_consensus.cc:359] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.486240 23005 raft_consensus.cc:740] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:12.487306 23005 consensus_queue.cc:260] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.492782 23005 ts_tablet_manager.cc:1434] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:26:12.494498 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-5e89ee7eb571454eb9956953ae2c7c5d received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:12.494904 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-5e89ee7eb571454eb9956953ae2c7c5d on tablet 5e89ee7eb571454eb9956953ae2c7c5d with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:12.619894 23005 ts_tablet_manager.cc:933] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:12.622179 23005 tablet_copy_client.cc:323] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:12.624244 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet 40fdb108e6f14522a9ef82da47fc0b74 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:12.624886 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet 40fdb108e6f14522a9ef82da47fc0b74 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-40fdb108e6f14522a9ef82da47fc0b74
I20260709 12:26:12.635951 22156 tablet_copy_source_session.cc:215] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.642385 23005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40fdb108e6f14522a9ef82da47fc0b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.667445 23005 tablet_copy_client.cc:806] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.668072 23005 tablet_copy_client.cc:670] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.672736 23005 tablet_copy_client.cc:538] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.683060 23005 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:12.700305 23005 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.701084 23005 tablet_bootstrap.cc:492] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:12.701754 23005 ts_tablet_manager.cc:1403] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.008s
I20260709 12:26:12.704612 23005 raft_consensus.cc:359] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.705447 23005 raft_consensus.cc:740] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:12.706096 23005 consensus_queue.cc:260] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.709894 23005 ts_tablet_manager.cc:1434] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:12.711302 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-40fdb108e6f14522a9ef82da47fc0b74 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:12.711688 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-40fdb108e6f14522a9ef82da47fc0b74 on tablet 40fdb108e6f14522a9ef82da47fc0b74 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:12.729383 23005 ts_tablet_manager.cc:933] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:12.731220 23005 tablet_copy_client.cc:323] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:12.732836 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet f77cd08fd9014998aebc07bff003d1a8 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:12.733392 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet f77cd08fd9014998aebc07bff003d1a8 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-f77cd08fd9014998aebc07bff003d1a8
I20260709 12:26:12.741356 22156 tablet_copy_source_session.cc:215] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.744680 23005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77cd08fd9014998aebc07bff003d1a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.765112 22735 raft_consensus.cc:1217] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:12.765580 23005 tablet_copy_client.cc:806] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.766141 23005 tablet_copy_client.cc:670] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.780012 23005 tablet_copy_client.cc:538] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.789062 23005 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:12.807600 23005 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.808495 23005 tablet_bootstrap.cc:492] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:12.809146 23005 ts_tablet_manager.cc:1403] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:26:12.811705 23005 raft_consensus.cc:359] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.812487 23005 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:12.813059 23005 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:12.815114 23005 ts_tablet_manager.cc:1434] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:12.816932 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f77cd08fd9014998aebc07bff003d1a8 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:12.817413 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f77cd08fd9014998aebc07bff003d1a8 on tablet f77cd08fd9014998aebc07bff003d1a8 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:12.863332 22735 raft_consensus.cc:1217] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.159508 22735 raft_consensus.cc:1217] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.211334 22970 raft_consensus.cc:1064] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:13.214496 22970 consensus_queue.cc:237] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.220822 22735 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.221148 22065 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.222360 22970 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.223258 22978 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.224103 22142 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.227067 22978 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.245671 22981 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.250787 22735 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.251083 22142 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.270363 22070 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.277258 21963 catalog_manager.cc:5697] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.331828 22214 consensus_queue.cc:237] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.336714 22735 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.339504 22970 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.339744 22735 raft_consensus.cc:1217] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.344127 22142 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.348487 22978 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.362463 22970 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.364828 22737 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.373185 22142 raft_consensus.cc:2955] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.390854 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e89ee7eb571454eb9956953ae2c7c5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.394286 21965 catalog_manager.cc:5697] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.407861 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e89ee7eb571454eb9956953ae2c7c5d with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:13.410077 23014 raft_consensus.cc:1064] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:13.412410 23014 consensus_queue.cc:237] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.421057 23023 tablet_replica.cc:333] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:13.423002 23023 raft_consensus.cc:2243] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.424149 23023 raft_consensus.cc:2272] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.427750 23023 ts_tablet_manager.cc:1916] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.431710 22737 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.439569 22927 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.448939 22214 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.451449 22927 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.474458 23023 ts_tablet_manager.cc:1929] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:13.475131 23023 log.cc:1199] T 5e89ee7eb571454eb9956953ae2c7c5d P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/5e89ee7eb571454eb9956953ae2c7c5d
I20260709 12:26:13.477033 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet 5e89ee7eb571454eb9956953ae2c7c5d (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:13.477972 22142 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.480438 22927 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.485327 23025 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.491789 22214 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.496985 22146 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.512778 22737 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.514154 21965 catalog_manager.cc:5697] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.530395 22065 consensus_queue.cc:237] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.538548 22735 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.541780 22214 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.541966 22927 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.543818 22927 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.554708 23014 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.556460 22737 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.563987 22216 raft_consensus.cc:2955] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.565706 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97b8db04a690435f8c84aba1b0f5ec2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.576947 21965 catalog_manager.cc:5697] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.589304 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet 97b8db04a690435f8c84aba1b0f5ec2b with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:13.591485 23029 tablet_replica.cc:333] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:13.592701 23029 raft_consensus.cc:2243] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.593550 23029 raft_consensus.cc:2272] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.598737 23029 ts_tablet_manager.cc:1916] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.623651 23029 ts_tablet_manager.cc:1929] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:13.624058 23029 log.cc:1199] T 97b8db04a690435f8c84aba1b0f5ec2b P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/97b8db04a690435f8c84aba1b0f5ec2b
I20260709 12:26:13.625667 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 97b8db04a690435f8c84aba1b0f5ec2b (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:13.739218 22997 raft_consensus.cc:1064] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:13.742550 22997 consensus_queue.cc:237] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.758688 22214 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.773471 22994 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:13.774735 22737 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.777228 22065 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.779549 22994 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.781486 22994 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.782572 23033 raft_consensus.cc:1064] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:13.800384 23033 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.808211 22994 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.814838 22214 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.816334 22737 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.816759 22216 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.817847 22070 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.819371 22995 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.820376 22997 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.828431 23032 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:13.837276 22737 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.868557 21965 catalog_manager.cc:5697] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.876605 22067 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.878326 23038 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.893239 22065 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.905575 22735 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.909694 22214 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.915757 21967 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.918473 22146 consensus_queue.cc:237] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.926970 22737 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.928673 22067 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.930311 22997 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.941720 23038 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.943730 22997 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.951877 22737 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.959378 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40fdb108e6f14522a9ef82da47fc0b74 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.964301 22146 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:13.974455 22065 raft_consensus.cc:2955] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.975765 22214 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.977100 22735 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.995548 22997 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.996172 21967 catalog_manager.cc:5697] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:13.997707 22997 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.009136 22995 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:14.010934 22214 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:14.017050 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet 40fdb108e6f14522a9ef82da47fc0b74 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:14.026737 22737 raft_consensus.cc:2955] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:14.035148 23042 tablet_replica.cc:333] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:14.036643 23042 raft_consensus.cc:2243] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.037492 23042 raft_consensus.cc:2272] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.041373 23042 ts_tablet_manager.cc:1916] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.052153 21967 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:14.068385 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f77cd08fd9014998aebc07bff003d1a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.070817 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet f77cd08fd9014998aebc07bff003d1a8 with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:14.072861 23042 ts_tablet_manager.cc:1929] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.073418 23042 log.cc:1199] T 40fdb108e6f14522a9ef82da47fc0b74 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/40fdb108e6f14522a9ef82da47fc0b74
I20260709 12:26:14.077322 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet 40fdb108e6f14522a9ef82da47fc0b74 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:14.079559 23043 tablet_replica.cc:333] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:14.080675 23043 raft_consensus.cc:2243] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.081583 23043 raft_consensus.cc:2272] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.085733 23043 ts_tablet_manager.cc:1916] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.099788 23043 ts_tablet_manager.cc:1929] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:14.100118 23043 log.cc:1199] T f77cd08fd9014998aebc07bff003d1a8 P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/f77cd08fd9014998aebc07bff003d1a8
I20260709 12:26:14.101490 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet f77cd08fd9014998aebc07bff003d1a8 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:15.137853 22067 consensus_queue.cc:237] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:15.143411 22214 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:15.143453 22036 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 790bdc35efb4419cb67fd1a718e2b584. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.144002 22142 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.144737 22927 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.145690 23014 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.157799 23014 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.167788 22142 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.169267 22214 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.173075 22070 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:15.183629 21963 catalog_manager.cc:5697] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.190891 22214 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.192601 22927 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.192838 22142 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:15.193717 22036 consensus_peers.cc:597] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f84b376f41e049819a74ea69b90cd298. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.195077 22927 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.216689 23025 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.219167 22219 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.219801 22146 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.236476 22139 consensus_queue.cc:237] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:15.245429 22216 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:15.248565 22111 consensus_peers.cc:597] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42a9ba8203ae4024af5885277061c1a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.248682 22070 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.253638 22994 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.256821 22994 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.259133 21967 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.276571 22994 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.281002 22070 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.283007 22219 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.290786 22067 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:15.299350 21963 catalog_manager.cc:5697] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.303921 22146 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.304052 22216 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:15.305600 23025 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:15.306639 22036 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 299ade5c6c9e48928f5602c43824af92. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.307466 23048 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:15.318879 22927 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.320137 22219 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.352315 21966 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.380671 22146 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:15.592278 23063 ts_tablet_manager.cc:933] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:15.595055 23063 tablet_copy_client.cc:323] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:15.596812 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet 790bdc35efb4419cb67fd1a718e2b584 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:15.597348 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet 790bdc35efb4419cb67fd1a718e2b584 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-790bdc35efb4419cb67fd1a718e2b584
I20260709 12:26:15.604249 22081 tablet_copy_source_session.cc:215] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:15.607455 23063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 790bdc35efb4419cb67fd1a718e2b584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.622243 23065 ts_tablet_manager.cc:933] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:15.624369 23065 tablet_copy_client.cc:323] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:15.626037 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet f84b376f41e049819a74ea69b90cd298 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:15.626566 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet f84b376f41e049819a74ea69b90cd298 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-f84b376f41e049819a74ea69b90cd298
I20260709 12:26:15.626734 23063 tablet_copy_client.cc:806] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:15.627386 23063 tablet_copy_client.cc:670] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:15.639395 23063 tablet_copy_client.cc:538] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:15.659700 23063 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:15.665794 22081 tablet_copy_source_session.cc:215] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:15.671432 23065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84b376f41e049819a74ea69b90cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.690356 23065 tablet_copy_client.cc:806] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:15.691094 23065 tablet_copy_client.cc:670] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:15.698302 23069 ts_tablet_manager.cc:933] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:15.698946 23065 tablet_copy_client.cc:538] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:15.698832 23067 ts_tablet_manager.cc:933] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:15.701438 23069 tablet_copy_client.cc:323] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:15.711673 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet 42a9ba8203ae4024af5885277061c1a3 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:15.712267 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet 42a9ba8203ae4024af5885277061c1a3 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-42a9ba8203ae4024af5885277061c1a3
I20260709 12:26:15.712451 23063 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:15.713610 23063 tablet_bootstrap.cc:492] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:15.713603 23065 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:15.714669 23063 ts_tablet_manager.cc:1403] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.025s
I20260709 12:26:15.715137 23067 tablet_copy_client.cc:323] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:15.720773 22156 tablet_copy_source_session.cc:215] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:15.723004 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet 299ade5c6c9e48928f5602c43824af92 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:15.723613 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet 299ade5c6c9e48928f5602c43824af92 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-299ade5c6c9e48928f5602c43824af92
I20260709 12:26:15.726454 23063 raft_consensus.cc:359] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:15.727432 23063 raft_consensus.cc:740] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:15.728149 23063 consensus_queue.cc:260] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:15.743194 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a9ba8203ae4024af5885277061c1a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:15.834901 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 58088us
I20260709 12:26:15.816447 22081 tablet_copy_source_session.cc:215] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:15.895538 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 299ade5c6c9e48928f5602c43824af92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:15.954363 23067 tablet_copy_client.cc:806] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:15.955659 23067 tablet_copy_client.cc:670] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:15.961346 23067 tablet_copy_client.cc:538] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:15.981279 23063 ts_tablet_manager.cc:1434] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.265s	user 0.062s	sys 0.125s
I20260709 12:26:15.983484 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-790bdc35efb4419cb67fd1a718e2b584 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:15.983940 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-790bdc35efb4419cb67fd1a718e2b584 on tablet 790bdc35efb4419cb67fd1a718e2b584 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:15.995136 23069 tablet_copy_client.cc:806] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:15.996773 23067 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:15.998432 23065 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:15.997848 23069 tablet_copy_client.cc:670] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.006762 23065 tablet_bootstrap.cc:492] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:16.009900 23069 tablet_copy_client.cc:538] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.012434 23065 ts_tablet_manager.cc:1403] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.299s	user 0.125s	sys 0.098s
I20260709 12:26:16.023303 23069 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:16.074343 23065 raft_consensus.cc:359] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:16.082958 23065 raft_consensus.cc:740] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:16.083706 23065 consensus_queue.cc:260] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:16.090629 23065 ts_tablet_manager.cc:1434] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.001s
I20260709 12:26:16.092490 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f84b376f41e049819a74ea69b90cd298 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:16.093089 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f84b376f41e049819a74ea69b90cd298 on tablet f84b376f41e049819a74ea69b90cd298 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:16.117126 23067 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.118153 23067 tablet_bootstrap.cc:492] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:16.118927 23067 ts_tablet_manager.cc:1403] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.122s	user 0.021s	sys 0.031s
I20260709 12:26:16.122153 23067 raft_consensus.cc:359] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:16.123081 23067 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:16.123838 23067 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:16.126679 23067 ts_tablet_manager.cc:1434] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:16.128511 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-299ade5c6c9e48928f5602c43824af92 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:16.128911 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-299ade5c6c9e48928f5602c43824af92 on tablet 299ade5c6c9e48928f5602c43824af92 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:16.148023 23069 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:16.148934 23069 tablet_bootstrap.cc:492] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:16.149704 23069 ts_tablet_manager.cc:1403] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.127s	user 0.019s	sys 0.004s
I20260709 12:26:16.152637 23069 raft_consensus.cc:359] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:16.153394 23069 raft_consensus.cc:740] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:16.153985 23069 consensus_queue.cc:260] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:16.156275 23069 ts_tablet_manager.cc:1434] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:16.158206 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-42a9ba8203ae4024af5885277061c1a3 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:16.158631 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-42a9ba8203ae4024af5885277061c1a3 on tablet 42a9ba8203ae4024af5885277061c1a3 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:16.171506 22737 raft_consensus.cc:1217] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:16.173187 22735 raft_consensus.cc:1217] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:16.180852 22735 raft_consensus.cc:1217] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:16.621445 22735 raft_consensus.cc:1217] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:16.678434 23048 raft_consensus.cc:1064] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:16.681903 23048 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:16.688849 22735 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.689199 22214 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.689436 22146 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.690964 23048 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:16.692083 23025 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:16.692898 22927 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:16.718948 23048 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.729611 22217 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.741868 22995 raft_consensus.cc:1064] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:16.721902 22139 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.744040 22995 consensus_queue.cc:237] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:16.751796 22735 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.766937 21963 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.794615 23081 raft_consensus.cc:1064] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:16.798384 23081 consensus_queue.cc:237] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:16.811496 22735 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.812505 22214 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.821856 23075 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:16.825502 22070 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.828596 23075 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:16.846206 22737 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.847537 22214 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.852876 22927 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:16.853157 22995 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.856122 22927 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:16.864116 22139 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:16.866506 23048 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:16.879451 23075 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:16.884939 23025 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.896327 22735 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.898846 22214 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.889621 22217 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.919576 22146 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.926327 22065 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.948997 22735 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.965246 22066 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:16.970785 21965 catalog_manager.cc:5697] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.972457 21965 catalog_manager.cc:5697] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.976555 22735 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:16.981129 22927 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.982681 22146 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:16.986474 23081 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.991072 23048 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:16.993115 22735 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.020787 21965 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.030735 22146 consensus_queue.cc:237] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:17.034646 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f84b376f41e049819a74ea69b90cd298 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:17.039557 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet f84b376f41e049819a74ea69b90cd298 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:17.049469 22142 raft_consensus.cc:2955] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.066322 23100 tablet_replica.cc:333] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:17.073475 23100 raft_consensus.cc:2243] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.074862 23100 raft_consensus.cc:2272] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.077973 23098 raft_consensus.cc:1064] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:17.080549 23098 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:17.086136 22065 consensus_queue.cc:237] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:17.088241 23100 ts_tablet_manager.cc:1916] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:17.092824 22735 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.094472 22927 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:17.101711 22214 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.103161 23025 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.103987 23081 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:17.104218 22735 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.106825 22217 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.109158 23081 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.114662 22737 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.113132 22217 raft_consensus.cc:2955] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.115469 22216 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.117983 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 790bdc35efb4419cb67fd1a718e2b584 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:17.118978 22142 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.124138 23098 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.126241 21965 catalog_manager.cc:5697] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.130972 23103 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:17.134948 23103 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:17.140619 22737 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:17.144567 23101 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.149194 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet 790bdc35efb4419cb67fd1a718e2b584 with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:17.155450 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 42a9ba8203ae4024af5885277061c1a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:17.158170 23100 ts_tablet_manager.cc:1929] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:17.158883 23100 log.cc:1199] T f84b376f41e049819a74ea69b90cd298 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/f84b376f41e049819a74ea69b90cd298
I20260709 12:26:17.161289 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet f84b376f41e049819a74ea69b90cd298 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:17.163964 22216 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.172451 22927 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:17.177947 23107 tablet_replica.cc:333] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:17.181885 23107 raft_consensus.cc:2243] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.182542 23107 raft_consensus.cc:2272] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.184255 22927 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.189858 22736 raft_consensus.cc:2955] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.199770 23107 ts_tablet_manager.cc:1916] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:17.200796 21965 catalog_manager.cc:5697] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.205662 22214 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.224769 22146 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.230242 23107 ts_tablet_manager.cc:1929] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:17.229734 22735 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.230985 23107 log.cc:1199] T 790bdc35efb4419cb67fd1a718e2b584 P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/790bdc35efb4419cb67fd1a718e2b584
I20260709 12:26:17.238168 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 790bdc35efb4419cb67fd1a718e2b584 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:17.249015 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a9ba8203ae4024af5885277061c1a3 with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:17.251417 21965 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.258260 23110 tablet_replica.cc:333] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:17.259462 23110 raft_consensus.cc:2243] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.260800 23110 raft_consensus.cc:2272] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.264097 23110 ts_tablet_manager.cc:1916] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:17.266216 22065 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:17.272271 22214 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.272347 22735 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:17.276235 23025 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:17.277776 23025 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:17.280140 23110 ts_tablet_manager.cc:1929] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:17.280630 23110 log.cc:1199] T 42a9ba8203ae4024af5885277061c1a3 P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/42a9ba8203ae4024af5885277061c1a3
I20260709 12:26:17.282279 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet 42a9ba8203ae4024af5885277061c1a3 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:17.287456 23098 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.294556 22735 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.296669 22214 raft_consensus.cc:2955] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:17.302152 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 299ade5c6c9e48928f5602c43824af92 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:17.306265 21963 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.330642 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet 299ade5c6c9e48928f5602c43824af92 with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:17.331609 23107 tablet_replica.cc:333] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:17.339413 23107 raft_consensus.cc:2243] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.340159 23107 raft_consensus.cc:2272] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.344173 23107 ts_tablet_manager.cc:1916] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:17.370458 23107 ts_tablet_manager.cc:1929] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:17.370807 23107 log.cc:1199] T 299ade5c6c9e48928f5602c43824af92 P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/299ade5c6c9e48928f5602c43824af92
I20260709 12:26:17.372064 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 299ade5c6c9e48928f5602c43824af92 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:18.398093 22067 consensus_queue.cc:237] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
W20260709 12:26:18.404471 22036 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7b7dc5b82134cd492412751a2d63d9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.404603 22216 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.404596 22146 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.406126 23098 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.406993 23048 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.414949 23048 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.417695 22217 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.421155 22146 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.430588 22216 consensus_queue.cc:237] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:18.435804 21963 catalog_manager.cc:5697] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.450589 22067 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.453245 23074 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:18.454186 22185 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed9f4c2d15b547e18ff1bfcfd082ae32. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.455449 22146 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.460479 23074 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.470391 23079 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.478446 22067 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.478112 22146 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.491271 22065 consensus_queue.cc:237] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:18.504839 22146 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.505034 21967 catalog_manager.cc:5697] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.506295 22927 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.510792 22217 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:18.516923 22036 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbe117f2cdc04fab8acb64e91252db18. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.518270 23125 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:18.534444 22217 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.532135 23098 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.535472 22140 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.553372 21967 catalog_manager.cc:5697] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.556946 22140 consensus_queue.cc:237] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:18.564227 22065 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:18.565735 22111 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4ed5fd823f34d34b4fd87d49e53edb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.566205 22217 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.568265 23120 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.569356 23102 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.579990 23102 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.581733 22065 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.581946 22216 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.604112 21966 catalog_manager.cc:5697] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:18.842986 23131 ts_tablet_manager.cc:933] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:18.844947 23131 tablet_copy_client.cc:323] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:18.846431 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet f7b7dc5b82134cd492412751a2d63d9f from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:18.846875 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet f7b7dc5b82134cd492412751a2d63d9f from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-f7b7dc5b82134cd492412751a2d63d9f
I20260709 12:26:18.852603 22081 tablet_copy_source_session.cc:215] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:18.855751 23131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b7dc5b82134cd492412751a2d63d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.873154 23131 tablet_copy_client.cc:806] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.873829 23131 tablet_copy_client.cc:670] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.877372 23131 tablet_copy_client.cc:538] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.892289 23131 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:18.902813 23133 ts_tablet_manager.cc:933] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:18.925503 23133 tablet_copy_client.cc:323] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:18.927165 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet bbe117f2cdc04fab8acb64e91252db18 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:18.927714 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet bbe117f2cdc04fab8acb64e91252db18 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-bbe117f2cdc04fab8acb64e91252db18
I20260709 12:26:18.936265 23131 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.937284 23131 tablet_bootstrap.cc:492] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:18.937986 23131 ts_tablet_manager.cc:1403] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.007s
I20260709 12:26:18.941699 23131 raft_consensus.cc:359] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:18.942564 23131 raft_consensus.cc:740] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:18.943226 23131 consensus_queue.cc:260] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:18.951856 22081 tablet_copy_source_session.cc:215] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:18.957558 23133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe117f2cdc04fab8acb64e91252db18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.965929 23131 ts_tablet_manager.cc:1434] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.028s	user 0.016s	sys 0.007s
I20260709 12:26:18.974527 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f7b7dc5b82134cd492412751a2d63d9f received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:18.975083 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-f7b7dc5b82134cd492412751a2d63d9f on tablet f7b7dc5b82134cd492412751a2d63d9f with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:18.979252 23131 ts_tablet_manager.cc:933] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:18.987385 23131 tablet_copy_client.cc:323] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:18.988185 23133 tablet_copy_client.cc:806] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.988926 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet b4ed5fd823f34d34b4fd87d49e53edb0 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:18.989221 23133 tablet_copy_client.cc:670] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.989539 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet b4ed5fd823f34d34b4fd87d49e53edb0 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-b4ed5fd823f34d34b4fd87d49e53edb0
I20260709 12:26:18.993338 23133 tablet_copy_client.cc:538] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.997526 22156 tablet_copy_source_session.cc:215] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:19.000234 23138 ts_tablet_manager.cc:933] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:19.002828 23131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed5fd823f34d34b4fd87d49e53edb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:19.006664 23133 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:19.019909 23138 tablet_copy_client.cc:323] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:19.021656 22229 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet ed9f4c2d15b547e18ff1bfcfd082ae32 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:19.022224 22229 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet ed9f4c2d15b547e18ff1bfcfd082ae32 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-ed9f4c2d15b547e18ff1bfcfd082ae32
I20260709 12:26:19.029657 23131 tablet_copy_client.cc:806] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:19.030483 23131 tablet_copy_client.cc:670] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:19.036746 23131 tablet_copy_client.cc:538] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:19.036911 22229 tablet_copy_source_session.cc:215] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:19.040349 23133 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.042222 23133 tablet_bootstrap.cc:492] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:19.042979 23133 ts_tablet_manager.cc:1403] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.014s
I20260709 12:26:19.044471 23138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9f4c2d15b547e18ff1bfcfd082ae32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:19.046247 23133 raft_consensus.cc:359] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:19.047179 23133 raft_consensus.cc:740] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:19.047878 23133 consensus_queue.cc:260] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:19.050288 23133 ts_tablet_manager.cc:1434] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:19.052297 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-bbe117f2cdc04fab8acb64e91252db18 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:19.052709 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-bbe117f2cdc04fab8acb64e91252db18 on tablet bbe117f2cdc04fab8acb64e91252db18 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:19.062263 23131 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:19.067734 23138 tablet_copy_client.cc:806] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:19.068451 23138 tablet_copy_client.cc:670] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:19.073900 23138 tablet_copy_client.cc:538] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:19.083073 23138 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:19.111634 23138 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.112674 23138 tablet_bootstrap.cc:492] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:19.113466 23138 ts_tablet_manager.cc:1403] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.012s
I20260709 12:26:19.116544 23138 raft_consensus.cc:359] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:19.117465 23138 raft_consensus.cc:740] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:19.118311 23138 consensus_queue.cc:260] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:19.121059 23138 ts_tablet_manager.cc:1434] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:19.122805 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-ed9f4c2d15b547e18ff1bfcfd082ae32 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:19.123284 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-ed9f4c2d15b547e18ff1bfcfd082ae32 on tablet ed9f4c2d15b547e18ff1bfcfd082ae32 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:19.141680 23131 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.142637 23131 tablet_bootstrap.cc:492] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:19.143415 23131 ts_tablet_manager.cc:1403] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.081s	user 0.044s	sys 0.019s
I20260709 12:26:19.146312 23131 raft_consensus.cc:359] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:19.147231 23131 raft_consensus.cc:740] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:19.148012 23131 consensus_queue.cc:260] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:19.150427 23131 ts_tablet_manager.cc:1434] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:19.185770 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-b4ed5fd823f34d34b4fd87d49e53edb0 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:19.186889 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-b4ed5fd823f34d34b4fd87d49e53edb0 on tablet b4ed5fd823f34d34b4fd87d49e53edb0 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:19.302366 22736 raft_consensus.cc:1217] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:19.390333 22736 raft_consensus.cc:1217] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:19.469519 22736 raft_consensus.cc:1217] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:19.502727 22736 raft_consensus.cc:1217] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:19.734120 23125 raft_consensus.cc:1064] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:19.737454 23125 consensus_queue.cc:237] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:19.747881 22735 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.748044 22142 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.750303 22214 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.750252 23145 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.751542 23125 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.752627 23098 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.772360 23098 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.775365 22142 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.785769 22214 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.793684 21967 catalog_manager.cc:5697] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.794312 22735 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.851557 22067 consensus_queue.cc:237] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:19.871906 22735 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:19.873049 22140 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:19.874565 23125 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.875687 23144 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.886575 23098 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.890513 22736 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.901891 23147 raft_consensus.cc:1064] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:19.909211 23147 consensus_queue.cc:237] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:19.916056 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7b7dc5b82134cd492412751a2d63d9f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:19.920578 22140 raft_consensus.cc:2955] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.925012 23098 raft_consensus.cc:1064] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:19.927580 23098 consensus_queue.cc:237] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:19.921873 21967 catalog_manager.cc:5697] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:19.941951 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet f7b7dc5b82134cd492412751a2d63d9f with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:19.950832 22736 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.956566 23159 tablet_replica.cc:333] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:19.958261 22214 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.959824 23159 raft_consensus.cc:2243] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.959707 23156 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.961066 23098 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.961649 23079 raft_consensus.cc:1064] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:19.964485 22216 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.967120 22066 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.968580 22736 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.969213 22140 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.970531 23144 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.971010 23159 raft_consensus.cc:2272] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.970683 23079 consensus_queue.cc:237] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:19.972718 23120 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.979350 23102 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.983525 23101 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.976056 23159 ts_tablet_manager.cc:1916] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:20.122931 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 76711.1us
I20260709 12:26:20.122977 23159 ts_tablet_manager.cc:1929] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:20.131729 23159 log.cc:1199] T f7b7dc5b82134cd492412751a2d63d9f P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/f7b7dc5b82134cd492412751a2d63d9f
I20260709 12:26:20.131916 22734 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:20.136355 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet f7b7dc5b82134cd492412751a2d63d9f (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:20.139976 23120 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.141127 22066 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:20.142206 23171 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:20.149541 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 62508.4us
I20260709 12:26:20.150504 22214 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.157900 22142 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:20.164846 23171 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:20.164903 22733 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.174391 23074 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:20.190140 21966 catalog_manager.cc:5697] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.199433 23156 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.209609 22733 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.214521 22142 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.254319 21967 catalog_manager.cc:5697] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.254940 22066 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.240588 22216 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.287987 22067 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.295010 22142 consensus_queue.cc:237] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:20.296985 22069 consensus_queue.cc:237] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:20.311267 22142 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.315521 22737 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.316130 22217 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.316854 23120 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:20.319027 22736 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.322968 23169 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:20.270116 23170 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.324959 23169 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.325815 23120 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.329252 23120 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.341807 23145 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.347893 22733 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.352799 22139 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.355772 22737 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.360015 22214 raft_consensus.cc:2955] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.384313 22139 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.395282 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b4ed5fd823f34d34b4fd87d49e53edb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:20.394982 21965 catalog_manager.cc:5697] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.405282 21967 catalog_manager.cc:5697] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.425236 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbe117f2cdc04fab8acb64e91252db18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:20.429109 22214 consensus_queue.cc:237] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:20.439716 22737 raft_consensus.cc:2955] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.441913 22066 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.442711 21965 catalog_manager.cc:5697] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.445152 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet bbe117f2cdc04fab8acb64e91252db18 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:20.445379 23079 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.446400 23159 tablet_replica.cc:333] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:20.447510 23159 raft_consensus.cc:2243] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.448278 23159 raft_consensus.cc:2272] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.451110 22733 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.453195 23079 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.454267 23159 ts_tablet_manager.cc:1916] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.460187 23074 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.469415 22737 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.471673 22066 raft_consensus.cc:2955] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:20.482676 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet b4ed5fd823f34d34b4fd87d49e53edb0 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:20.504292 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ed9f4c2d15b547e18ff1bfcfd082ae32 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:20.512467 23176 tablet_replica.cc:333] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:20.516830 21967 catalog_manager.cc:5697] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.513010 23159 ts_tablet_manager.cc:1929] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:20.527100 23159 log.cc:1199] T bbe117f2cdc04fab8acb64e91252db18 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/bbe117f2cdc04fab8acb64e91252db18
I20260709 12:26:20.530452 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet bbe117f2cdc04fab8acb64e91252db18 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:20.534973 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet ed9f4c2d15b547e18ff1bfcfd082ae32 with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:20.538312 23176 raft_consensus.cc:2243] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.539266 23176 raft_consensus.cc:2272] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.547804 23177 tablet_replica.cc:333] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:20.553159 23176 ts_tablet_manager.cc:1916] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.553716 23177 raft_consensus.cc:2243] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.554670 23177 raft_consensus.cc:2272] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.558292 23177 ts_tablet_manager.cc:1916] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.568248 23176 ts_tablet_manager.cc:1929] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:20.569348 23176 log.cc:1199] T b4ed5fd823f34d34b4fd87d49e53edb0 P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/b4ed5fd823f34d34b4fd87d49e53edb0
I20260709 12:26:20.571164 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet b4ed5fd823f34d34b4fd87d49e53edb0 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:20.571357 23177 ts_tablet_manager.cc:1929] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:20.571931 23177 log.cc:1199] T ed9f4c2d15b547e18ff1bfcfd082ae32 P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/ed9f4c2d15b547e18ff1bfcfd082ae32
I20260709 12:26:20.573661 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet ed9f4c2d15b547e18ff1bfcfd082ae32 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:21.508713 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:21.590166 22066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:21.590793 22066 raft_consensus.cc:606] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:21.605911 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:21.606501 22142 raft_consensus.cc:606] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:21.609560 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:21.610116 22142 raft_consensus.cc:606] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:21.614302 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:21.614878 22142 raft_consensus.cc:606] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:21.618427 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:21.618875 22142 raft_consensus.cc:606] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:21.620952 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:21.621455 22142 raft_consensus.cc:606] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:21.622373 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:21.623487 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:21.624254 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:21.635516 22142 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:21.640861 23102 raft_consensus.cc:993] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:21.641422 23102 raft_consensus.cc:1081] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:21.642915 22217 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:21.643103 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:21.643687 22214 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.644019 22214 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.649616 22214 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:21.650370 22111 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03a703fed624441fb4eb00f38f0ff80d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.650528 23102 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.650386 22066 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:21.652228 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:21.652402 23102 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.652864 22066 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.662460 23179 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.664353 22069 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.673681 22214 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:21.674690 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:21.675151 22066 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:21.675302 22142 raft_consensus.cc:3055] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:21.675712 22142 raft_consensus.cc:740] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:21.676586 22185 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:21.676497 22142 consensus_queue.cc:260] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:21.677579 22142 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.679600 23074 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.680145 23074 raft_consensus.cc:697] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:21.680922 23074 consensus_queue.cc:237] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:21.693801 23116 raft_consensus.cc:993] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:21.694350 23179 raft_consensus.cc:1081] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:21.693904 22069 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:21.696326 22213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:21.701593 22213 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.702095 22213 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.699887 21967 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.700716 22142 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:21.724895 22213 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:21.726648 22217 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.739033 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:21.739703 22066 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.768169 22213 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:21.770360 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:21.770977 22142 raft_consensus.cc:3055] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:21.771283 22142 raft_consensus.cc:740] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:21.772084 22142 consensus_queue.cc:260] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:21.774225 22216 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:21.775378 22036 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3caebc0658346798308160a170ffc71. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.777509 22142 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.780689 23169 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.788077 21966 catalog_manager.cc:5697] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.795565 22139 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:21.799652 23169 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.805546 22066 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:21.806774 22185 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:21.806782 23156 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.812125 22070 raft_consensus.cc:1240] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:21.812484 22142 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:21.807955 23074 raft_consensus.cc:2804] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.814157 23074 raft_consensus.cc:697] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:21.814998 23074 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:21.821719 22139 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.820788 22214 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.828635 22066 consensus_queue.cc:237] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:21.861204 21965 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
W20260709 12:26:21.874351 22036 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c387a77990f741e2ae187b3f92c6d472. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.876652 22139 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:21.877251 21966 catalog_manager.cc:5697] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.878391 23197 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.879855 22214 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:21.881692 23169 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.898530 23169 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.902294 22214 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:21.905587 22139 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
W20260709 12:26:21.914050 22017 auto_rebalancer.cc:629] Failed to schedule move for tablet 99368f219dd84b6994a569b62a8579d0: Remote error: Service unavailable: leader transfer in progress
I20260709 12:26:21.921690 21967 catalog_manager.cc:5697] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.992592 23179 raft_consensus.cc:993] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:21.993273 23179 raft_consensus.cc:1081] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:21.995440 22737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:34992
I20260709 12:26:21.996057 22737 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:21.996464 22737 raft_consensus.cc:3060] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.000492 23116 raft_consensus.cc:993] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:22.000950 23116 raft_consensus.cc:1081] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:22.002933 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:34992
I20260709 12:26:22.003494 22733 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.003851 22733 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.019951 22733 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.023584 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:22.024224 22066 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.024349 23116 raft_consensus.cc:993] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:22.024876 23116 raft_consensus.cc:1081] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:22.026898 22733 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:22.027446 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:22.028074 22139 raft_consensus.cc:3055] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.028391 22139 raft_consensus.cc:740] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:22.029264 22139 consensus_queue.cc:260] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.029855 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:22.032022 22066 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:22.033620 22702 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:22.033830 22139 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.030469 22214 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.034657 22214 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.047046 22139 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:22.045768 22737 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.047674 22214 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:22.049803 23202 raft_consensus.cc:2804] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.055403 22214 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:22.056401 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:22.057193 22066 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.060370 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:22.061012 22069 raft_consensus.cc:3060] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.064582 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:22.065183 22142 raft_consensus.cc:3055] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.065495 22142 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:22.066390 22142 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:22.067752 22142 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.070915 22069 raft_consensus.cc:2468] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:22.072140 22702 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:22.075841 22737 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:22.076954 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:22.078352 22139 raft_consensus.cc:3055] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.078729 22139 raft_consensus.cc:740] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:22.079907 22066 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:22.079854 22139 consensus_queue.cc:260] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.081080 22139 raft_consensus.cc:3060] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.081270 22185 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:22.084261 23074 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.084776 23074 raft_consensus.cc:697] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:22.086082 23074 consensus_queue.cc:237] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:22.090296 22139 raft_consensus.cc:2468] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:22.083077 22142 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:22.102670 23204 raft_consensus.cc:2804] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.103672 23204 raft_consensus.cc:697] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:22.106190 23204 consensus_queue.cc:237] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.107116 23202 raft_consensus.cc:697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:22.110040 23202 consensus_queue.cc:237] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.120743 23197 raft_consensus.cc:993] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:22.121423 23197 raft_consensus.cc:1081] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:22.125614 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:35008
I20260709 12:26:22.126338 22733 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:22.126837 22733 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.165792 23209 ts_tablet_manager.cc:933] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:22.167774 22733 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.170279 23209 tablet_copy_client.cc:323] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:22.175122 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet 03a703fed624441fb4eb00f38f0ff80d from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:22.175681 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet 03a703fed624441fb4eb00f38f0ff80d from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-03a703fed624441fb4eb00f38f0ff80d
I20260709 12:26:22.176381 22733 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:22.175153 23206 ts_tablet_manager.cc:933] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:22.178879 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:22.179556 22142 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.183094 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:22.183686 22066 raft_consensus.cc:3055] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:22.183986 22066 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:22.184754 22066 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.185942 22156 tablet_copy_source_session.cc:215] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:22.185993 22066 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.187979 21966 catalog_manager.cc:5697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.198704 21966 catalog_manager.cc:5697] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.205612 23209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a703fed624441fb4eb00f38f0ff80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:22.184772 21965 catalog_manager.cc:5697] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.215421 22142 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:22.221741 22139 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.196002 22066 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:22.230398 23074 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:22.231405 22702 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:22.232432 23202 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.232928 23202 raft_consensus.cc:697] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:22.233803 23202 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:22.241096 22066 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.246784 23074 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:22.249871 23209 tablet_copy_client.cc:806] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:22.255435 23209 tablet_copy_client.cc:670] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:22.275421 21966 catalog_manager.cc:5697] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.294296 23209 tablet_copy_client.cc:538] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:22.298146 22139 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.303165 23182 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.326164 22066 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.330039 23074 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.330806 23206 tablet_copy_client.cc:323] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:22.336199 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet e3caebc0658346798308160a170ffc71 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:22.336776 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet e3caebc0658346798308160a170ffc71 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-e3caebc0658346798308160a170ffc71
I20260709 12:26:22.396683 22081 tablet_copy_source_session.cc:215] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:22.400766 23206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3caebc0658346798308160a170ffc71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:22.415019 23222 ts_tablet_manager.cc:933] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:22.440244 23222 tablet_copy_client.cc:323] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:22.442073 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet c387a77990f741e2ae187b3f92c6d472 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:22.442689 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet c387a77990f741e2ae187b3f92c6d472 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-c387a77990f741e2ae187b3f92c6d472
I20260709 12:26:22.456278 22081 tablet_copy_source_session.cc:215] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:22.459821 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c387a77990f741e2ae187b3f92c6d472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:22.499600 23222 tablet_copy_client.cc:806] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:22.500303 23222 tablet_copy_client.cc:670] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:22.501400 22069 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.503629 23074 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:22.506309 23222 tablet_copy_client.cc:538] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:22.517947 23222 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:22.532240 22139 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.537031 23074 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.550796 23222 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:22.551905 23222 tablet_bootstrap.cc:492] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:22.552713 23222 ts_tablet_manager.cc:1403] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.035s	user 0.026s	sys 0.004s
I20260709 12:26:22.558696 23222 raft_consensus.cc:359] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:22.559916 23222 raft_consensus.cc:740] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:22.560662 23222 consensus_queue.cc:260] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:22.567982 23222 ts_tablet_manager.cc:1434] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:22.569844 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-c387a77990f741e2ae187b3f92c6d472 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:22.570380 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-c387a77990f741e2ae187b3f92c6d472 on tablet c387a77990f741e2ae187b3f92c6d472 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:22.560701 23209 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:22.597792 22063 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:22.599472 23202 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:22.608731 22140 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:22.610756 23202 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:22.620082 22070 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:22.622143 23202 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:22.680706 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:22.721227 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 68273.4us
I20260709 12:26:22.723143 22070 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:22.732316 23209 tablet_bootstrap.cc:700] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Time spent opening tablet: real 0.136s	user 0.002s	sys 0.001s
I20260709 12:26:22.735426 22139 raft_consensus.cc:1275] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:22.762588 23228 log.cc:927] Time spent T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 12:26:22.763916 23233 consensus_queue.cc:1048] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:22.772469 23206 tablet_copy_client.cc:806] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:22.773118 23206 tablet_copy_client.cc:670] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:22.769223 23202 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:22.801417 22142 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:22.802986 23204 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:22.809821 23206 tablet_copy_client.cc:538] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:22.861527 23209 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:22.862581 23209 tablet_bootstrap.cc:492] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:22.863312 23209 ts_tablet_manager.cc:1403] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.303s	user 0.020s	sys 0.005s
I20260709 12:26:22.877158 23209 raft_consensus.cc:359] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:22.878129 23209 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:22.878811 23209 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:22.906307 23209 ts_tablet_manager.cc:1434] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:26:22.907938 22737 raft_consensus.cc:1217] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:22.907999 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-03a703fed624441fb4eb00f38f0ff80d received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:22.908655 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-03a703fed624441fb4eb00f38f0ff80d on tablet 03a703fed624441fb4eb00f38f0ff80d with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:22.918807 23206 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:22.967526 22140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:22.968127 22140 raft_consensus.cc:606] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:22.972031 22140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:22.972667 22140 raft_consensus.cc:606] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:22.976084 22140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:22.976810 22140 raft_consensus.cc:606] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:22.979084 22069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:22.979668 22069 raft_consensus.cc:606] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:22.982398 22140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:22.982962 22140 raft_consensus.cc:606] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:22.986871 22139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:22.987398 22139 raft_consensus.cc:606] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:22.990762 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:22.992542 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:22.993294 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.017649 23206 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:23.026263 23206 tablet_bootstrap.cc:492] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:23.027042 23206 ts_tablet_manager.cc:1403] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.001s
I20260709 12:26:23.037793 23206 raft_consensus.cc:359] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:23.039007 23206 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:23.049767 23206 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:23.062048 23206 ts_tablet_manager.cc:1434] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.004s
I20260709 12:26:23.062923 23116 raft_consensus.cc:993] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.063409 23116 raft_consensus.cc:1081] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.072065 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:23.072685 22214 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.073048 22214 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.073724 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-e3caebc0658346798308160a170ffc71 received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:23.074221 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-e3caebc0658346798308160a170ffc71 on tablet e3caebc0658346798308160a170ffc71 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:23.092734 23192 raft_consensus.cc:993] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.093364 23192 raft_consensus.cc:1081] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.096403 22214 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:23.098909 22214 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:23.100101 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:23.100786 22069 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.108793 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:23.109745 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:23.110370 22214 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.110989 22214 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.117933 22069 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.119359 22185 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:23.120674 23217 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.122129 23217 raft_consensus.cc:697] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:23.123364 23217 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:23.129935 22214 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.133435 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:23.134198 22069 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.140628 22214 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:23.145152 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:23.145802 22140 raft_consensus.cc:3055] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.146116 22140 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:23.146867 22140 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.148169 22140 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:23.155449 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 61033.2us
I20260709 12:26:23.159307 23243 raft_consensus.cc:993] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:23.159843 23243 raft_consensus.cc:1081] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:23.161495 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:34992
I20260709 12:26:23.162111 22733 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.162479 22733 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.163444 22140 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.165778 22184 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:23.166592 23074 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.167001 23074 raft_consensus.cc:697] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:23.167752 23074 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.171685 22069 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.181017 22733 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.185741 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:23.187433 22737 raft_consensus.cc:1217] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:23.188608 22146 raft_consensus.cc:3055] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.189121 22146 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
W20260709 12:26:23.203325 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 45533us
I20260709 12:26:23.206017 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:23.210440 22217 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.224097 21965 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.261775 22736 raft_consensus.cc:1217] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:23.207342 22733 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:23.209149 22140 raft_consensus.cc:3055] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.265050 22140 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:23.265937 22140 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.266981 22140 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.195516 22146 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:23.269857 22146 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:23.273335 23192 consensus_queue.cc:1175] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ed678a3f9e3d4e0ba5801f1663548796" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20260709 12:26:23.280329 22146 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.289574 23179 raft_consensus.cc:993] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.253046 22217 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:23.296152 23192 raft_consensus.cc:1081] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.299710 22213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:23.300364 22213 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.300727 22702 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:23.301652 23232 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.302116 23232 raft_consensus.cc:697] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:23.303215 22140 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:23.302996 23232 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.300743 22213 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.312840 22213 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.316000 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:23.316789 22069 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.324337 22069 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.325687 22185 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:23.326678 23188 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.327150 23188 raft_consensus.cc:697] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:23.328051 23188 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.332490 23156 raft_consensus.cc:1064] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:23.332674 23169 raft_consensus.cc:993] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:23.333139 23169 raft_consensus.cc:1081] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:23.334117 22213 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:23.335223 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:23.335893 22140 raft_consensus.cc:3055] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.336201 22140 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:23.337229 22140 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.338424 22140 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.346088 22139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59944
I20260709 12:26:23.346658 22139 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.347047 22139 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.346721 21967 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.351789 23156 consensus_queue.cc:237] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.355235 22139 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.364812 22139 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:23.366169 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:23.366514 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:23.366842 22213 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.370499 22069 raft_consensus.cc:3055] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.370915 22069 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:23.371654 22069 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.373010 22069 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.380847 22140 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.383435 21967 catalog_manager.cc:5697] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.387439 21967 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.389433 22213 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:23.391546 22069 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:23.397034 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:23.398037 23245 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.398541 23245 raft_consensus.cc:697] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:23.399510 23245 consensus_queue.cc:237] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.415344 22733 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.415720 22140 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.417475 23251 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.417788 22213 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.419013 23156 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.423298 23251 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:23.444468 23246 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.439105 21967 catalog_manager.cc:5697] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.453521 22737 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.468228 23245 raft_consensus.cc:993] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.471246 23245 raft_consensus.cc:1081] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:23.470993 21966 catalog_manager.cc:5697] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.477042 22213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:23.477675 22213 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.478147 22213 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.480629 22140 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.494989 22217 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.530646 22069 consensus_queue.cc:237] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.492600 22213 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.537803 22217 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:23.540143 23251 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:23.544289 22733 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:23.546761 23251 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:23.558720 23197 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.560174 22737 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.567324 22216 raft_consensus.cc:2955] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.573483 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:23.574103 22140 raft_consensus.cc:3055] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.574412 22140 raft_consensus.cc:740] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
W20260709 12:26:23.574594 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 65823.7us
I20260709 12:26:23.575222 22140 consensus_queue.cc:260] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.576241 22140 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.578243 22213 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:23.581782 22733 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Advancing to term 2
I20260709 12:26:23.582741 22140 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.583885 22184 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:23.585358 23260 raft_consensus.cc:2804] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.586040 23260 raft_consensus.cc:697] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:23.591346 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c387a77990f741e2ae187b3f92c6d472 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:23.587373 23260 consensus_queue.cc:237] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:23.598354 21966 catalog_manager.cc:5697] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.600667 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:23.601306 22069 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.606757 22733 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:23.608253 22140 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:23.609802 23217 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.613521 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet c387a77990f741e2ae187b3f92c6d472 with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:23.626971 23074 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.626730 21967 catalog_manager.cc:5697] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.628906 22069 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:23.639762 23263 tablet_replica.cc:333] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:23.640699 23263 raft_consensus.cc:2243] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:23.641541 23263 raft_consensus.cc:2272] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:23.647604 22140 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.650049 23263 ts_tablet_manager.cc:1916] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:23.670462 23260 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.670989 22069 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:23.675868 23264 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:23.676327 23263 ts_tablet_manager.cc:1929] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:23.676964 23263 log.cc:1199] T c387a77990f741e2ae187b3f92c6d472 P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/c387a77990f741e2ae187b3f92c6d472
I20260709 12:26:23.681557 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet c387a77990f741e2ae187b3f92c6d472 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:23.695045 22063 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.697319 23260 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.727414 23260 raft_consensus.cc:1064] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:23.730402 23260 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.742692 22139 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:23.744288 22736 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:23.746032 23260 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:23.749408 23188 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.750212 22066 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:23.765954 23188 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:26:23.789928 23260 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.793675 22736 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.795737 22069 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.804160 23156 raft_consensus.cc:1064] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:23.809716 22139 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.814615 23156 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.816195 21966 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 2 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.816123 22140 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.841068 22069 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.846321 23243 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.896116 22214 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.896147 22146 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.899389 22214 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:23.902156 23232 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:26:23.916308 22143 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.818109 23260 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:26:23.927317 23260 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.933200 22146 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.939306 22213 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.942385 22736 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:23.942483 23156 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:23.943070 23232 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.944669 23217 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.946578 23241 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.953365 22146 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:23.974758 23264 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:23.980007 22736 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.983266 22069 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.983294 22214 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:23.991956 23074 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.004268 23156 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:24.006129 23169 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.008353 22733 raft_consensus.cc:2955] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.084762 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.140867 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03a703fed624441fb4eb00f38f0ff80d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:24.150166 23197 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.153587 22737 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.167833 22066 raft_consensus.cc:1275] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.170836 22146 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.183840 23285 consensus_queue.cc:1048] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.202467 21965 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 4 to 5, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.207458 22140 raft_consensus.cc:1275] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.208889 23074 consensus_queue.cc:1048] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.231603 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 03a703fed624441fb4eb00f38f0ff80d with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:24.236346 22214 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.261437 23299 tablet_replica.cc:333] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:24.262658 21965 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.265681 23299 raft_consensus.cc:2243] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.266600 23299 raft_consensus.cc:2272] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.272823 22146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:24.273468 22146 raft_consensus.cc:606] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:24.278885 23299 ts_tablet_manager.cc:1916] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:24.284027 22063 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.292441 22146 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.293901 23197 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.303380 22734 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:24.307425 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:24.306782 23298 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.308054 22214 raft_consensus.cc:606] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:24.313627 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:24.314188 22214 raft_consensus.cc:606] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:24.316701 23299 ts_tablet_manager.cc:1929] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:24.317251 23299 log.cc:1199] T 03a703fed624441fb4eb00f38f0ff80d P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/03a703fed624441fb4eb00f38f0ff80d
I20260709 12:26:24.321151 23251 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:24.321617 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet 03a703fed624441fb4eb00f38f0ff80d (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:24.322347 22139 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.326874 22140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:24.327451 22140 raft_consensus.cc:606] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:24.330581 22217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:24.331102 22217 raft_consensus.cc:606] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:24.341361 21967 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.344161 22063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:24.344913 22063 raft_consensus.cc:606] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:24.346428 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3caebc0658346798308160a170ffc71 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:24.345234 22734 raft_consensus.cc:2955] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:24.348174 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:24.350337 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:24.351109 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.354209 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet e3caebc0658346798308160a170ffc71 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:24.370489 23302 tablet_replica.cc:333] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:24.371358 23302 raft_consensus.cc:2243] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.372252 23302 raft_consensus.cc:2272] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.376488 23302 ts_tablet_manager.cc:1916] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:24.392122 23302 ts_tablet_manager.cc:1929] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:24.392591 23302 log.cc:1199] T e3caebc0658346798308160a170ffc71 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/e3caebc0658346798308160a170ffc71
I20260709 12:26:24.394219 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet e3caebc0658346798308160a170ffc71 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:24.406704 23246 raft_consensus.cc:993] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.407460 23251 raft_consensus.cc:1081] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.410991 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:35008
I20260709 12:26:24.411556 22733 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.411896 22733 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.418105 22733 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.420756 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:24.421469 22063 raft_consensus.cc:3055] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.421757 22063 raft_consensus.cc:740] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:24.423048 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:24.422766 22063 consensus_queue.cc:260] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.423662 22140 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.424026 22063 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.426096 23294 raft_consensus.cc:993] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.426577 23294 raft_consensus.cc:1081] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.433009 22737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:35006
I20260709 12:26:24.433611 22737 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.433995 22737 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.433848 22063 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.435348 22702 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:24.436355 23281 raft_consensus.cc:2804] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.436857 23281 raft_consensus.cc:697] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:24.437686 23281 consensus_queue.cc:237] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.440822 22140 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.441779 22733 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:24.444914 22737 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.448005 22737 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:24.448948 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:24.448973 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:24.449644 22214 raft_consensus.cc:3055] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.449946 22063 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.450088 22214 raft_consensus.cc:740] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:24.450932 22214 consensus_queue.cc:260] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.449720 21963 catalog_manager.cc:5697] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.453347 22214 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.459825 22063 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.461040 22702 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:24.461962 23281 raft_consensus.cc:2804] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.463181 23264 raft_consensus.cc:993] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.463292 23281 raft_consensus.cc:697] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:24.463886 23292 raft_consensus.cc:1081] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.463909 22214 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.465723 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:35006
I20260709 12:26:24.465332 23281 consensus_queue.cc:237] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.466367 22733 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.466768 22733 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.472265 22733 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.474116 22733 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:24.474820 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:24.475436 22140 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.475924 21963 catalog_manager.cc:5697] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.478160 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:24.478762 22214 raft_consensus.cc:3055] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.479032 22214 raft_consensus.cc:740] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:24.479717 22214 consensus_queue.cc:260] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.480788 22214 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.482452 22140 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.487311 22214 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.490084 22701 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:24.494408 23281 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.500779 23294 raft_consensus.cc:993] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:24.501240 23281 raft_consensus.cc:697] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:24.501374 23294 raft_consensus.cc:1081] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:24.503389 22140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:24.504266 22140 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.504627 23281 consensus_queue.cc:237] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.504642 22140 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.513808 22140 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:24.517024 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:24.517752 22069 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.515549 22140 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:24.517485 21963 catalog_manager.cc:5697] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.523854 23245 raft_consensus.cc:993] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.524381 23243 raft_consensus.cc:1081] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.524518 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:24.526140 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:34992
I20260709 12:26:24.526721 22733 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.527019 22733 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.527283 22069 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:24.525187 22214 raft_consensus.cc:3055] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:24.528229 22214 raft_consensus.cc:740] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:24.528851 22111 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:24.529016 22214 consensus_queue.cc:260] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:24.530349 22214 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.532507 22733 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.533820 23245 raft_consensus.cc:2804] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.534366 23245 raft_consensus.cc:697] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:24.535439 22214 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:24.535511 23245 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:24.536818 22733 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:24.537809 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:24.538151 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:24.538447 22140 raft_consensus.cc:3055] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.538699 22214 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.538832 22140 raft_consensus.cc:740] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:24.539669 22140 consensus_queue.cc:260] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.540820 22140 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.545135 22214 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.546626 22702 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:24.547184 22140 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:24.547580 23281 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.548080 23281 raft_consensus.cc:697] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:24.549021 23281 consensus_queue.cc:237] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.558089 21963 catalog_manager.cc:5697] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.561879 21967 catalog_manager.cc:5697] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.853195 23245 raft_consensus.cc:993] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.853981 23243 raft_consensus.cc:1081] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:24.856036 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:34992
I20260709 12:26:24.856495 22733 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:24.856830 22733 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.916247 22733 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.939344 22146 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:24.941995 23232 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:24.975644 22069 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:24.977586 23232 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:24.980721 22733 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:24.982548 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:24.983193 22063 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.982601 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:24.986112 22146 raft_consensus.cc:3055] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:24.986397 22146 raft_consensus.cc:740] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:24.987108 22146 consensus_queue.cc:260] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:24.988075 22146 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.988940 22139 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:24.995558 23232 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:25.000559 22146 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:25.003607 22063 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:25.023380 22702 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:25.026459 23313 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.027110 23313 raft_consensus.cc:697] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:26:25.157573 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 131900us
W20260709 12:26:25.269554 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 239773us
I20260709 12:26:25.028223 23313 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:25.304299 22217 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.310873 22217 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.313959 22217 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:25.316560 23318 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:25.322190 23315 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:25.331238 22217 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.334553 23325 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:25.343708 22146 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.345958 23325 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:25.412510 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.622200 22070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:25.622918 22070 raft_consensus.cc:606] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:25.632357 22070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:25.633019 22070 raft_consensus.cc:606] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:25.646409 23332 raft_consensus.cc:993] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:25.646883 23332 raft_consensus.cc:993] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:25.647040 23335 raft_consensus.cc:1081] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:25.647279 23332 raft_consensus.cc:1081] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:25.650146 22137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59944
I20260709 12:26:25.650270 22141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59944
I20260709 12:26:25.651008 22137 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.651147 22141 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.651557 22137 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.651714 22141 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.668645 22141 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:25.669152 22137 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:25.670964 22137 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:25.671080 22141 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:25.679024 22066 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:25.683351 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:25.683992 22066 raft_consensus.cc:3055] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.685456 22066 raft_consensus.cc:740] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:25.689347 22066 consensus_queue.cc:260] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:25.690438 22066 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.696770 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:25.697686 22070 raft_consensus.cc:3055] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:25.698117 22070 raft_consensus.cc:740] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:25.702740 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:25.703348 22736 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.705024 22066 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:25.705901 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:25.706696 22141 raft_consensus.cc:606] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:25.710235 23317 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:25.698925 22070 consensus_queue.cc:260] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:25.719671 22070 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.734565 23245 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:25.743966 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:25.744930 23245 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.745550 23245 raft_consensus.cc:697] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:25.746510 23245 consensus_queue.cc:237] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:25.755594 22139 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:25.760673 22736 raft_consensus.cc:2468] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:25.769923 22139 raft_consensus.cc:606] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:25.771085 22111 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:25.771313 22731 raft_consensus.cc:1240] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.771993 23243 raft_consensus.cc:2804] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:25.772485 23243 raft_consensus.cc:697] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:25.773465 23243 consensus_queue.cc:237] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:25.774514 22066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:25.775148 22066 raft_consensus.cc:606] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:25.779412 22070 raft_consensus.cc:2468] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:25.791496 22063 raft_consensus.cc:1275] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.791769 22071 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.799847 23232 consensus_queue.cc:1048] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:25.800151 23313 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:25.800837 21966 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.804080 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:25.805922 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:25.806746 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.858392 22146 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:25.862046 23314 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:25.900341 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:25.902230 22213 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.964352 23319 raft_consensus.cc:993] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:25.964954 23319 raft_consensus.cc:1081] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:25.967553 21967 catalog_manager.cc:5697] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:25.981539 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 55395.4us
W20260709 12:26:25.982061 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 52540.2us
I20260709 12:26:25.988746 21967 catalog_manager.cc:5697] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:25.995244 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:25.995882 22217 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:25.999006 22217 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.011039 23251 raft_consensus.cc:993] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:26.014389 22213 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:26.015904 23251 raft_consensus.cc:1081] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:26.020124 22217 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:26.031057 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:26.031822 22065 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.041500 22065 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:26.042613 22185 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:26.042819 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:26:26.043524 23292 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:26.044080 23292 raft_consensus.cc:697] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:26.044924 23292 consensus_queue.cc:237] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:26.043509 22214 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.052713 22217 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:26.054960 22214 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.054234 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:26.063215 22139 raft_consensus.cc:3055] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.063581 22139 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:26.064203 22139 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:26.065212 22139 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.079653 22139 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:26.072788 22214 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:26.084239 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:26.084798 22065 raft_consensus.cc:3055] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.085094 22065 raft_consensus.cc:740] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:26.085390 22214 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:26.085819 22065 consensus_queue.cc:260] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:26.086969 22065 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.089488 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:26.090049 22733 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.106496 22733 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:26.107873 22185 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:26.108676 23292 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:26.109248 23292 raft_consensus.cc:697] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:26.109426 22065 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:26.110150 23292 consensus_queue.cc:237] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:26.170218 21966 catalog_manager.cc:5697] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.171969 21966 catalog_manager.cc:5697] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.182802 22217 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:26.192853 22139 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:26.194437 22185 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c609d086e32e4033b7376f770a2790a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.195947 22065 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:26.197258 23292 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.198643 23321 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.206609 23292 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.208027 22139 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.208451 22065 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.213338 22071 raft_consensus.cc:1275] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.214763 23284 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.235066 22217 raft_consensus.cc:1275] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.230506 21965 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.239099 23319 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.241251 22139 consensus_queue.cc:237] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:26.246255 22733 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.248010 23319 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:26.259198 22111 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb9f575e2f52433abc7aeff041ddb880. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.264393 22071 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.267938 22217 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.267750 23243 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.281800 23243 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.285095 22065 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.293051 23284 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.295440 23319 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.299183 22065 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.316982 22146 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:26.336444 21966 catalog_manager.cc:5697] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.347892 22219 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.347035 22217 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.351826 22063 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.358680 23319 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.359866 23284 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:26.365741 22111 consensus_peers.cc:597] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b958cd7e995415696872e37e9c3062b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.367476 23243 raft_consensus.cc:993] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:26.367903 23243 raft_consensus.cc:1081] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:26.369299 22733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:34992
I20260709 12:26:26.369901 22733 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.370327 22733 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.374712 23243 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.376454 22217 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.397141 22733 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:26.401027 22065 consensus_queue.cc:237] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:26.403365 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:26.403978 22217 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.403856 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:26.404558 22146 raft_consensus.cc:3055] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.404876 22146 raft_consensus.cc:740] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:26.406791 22146 consensus_queue.cc:260] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:26.407833 22146 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.410625 22733 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:26.412325 22217 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:26.413542 22702 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:26.414294 23314 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:26.414757 23314 raft_consensus.cc:697] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:26.415606 23314 consensus_queue.cc:237] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:26.420630 22139 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.422519 22217 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:26.424240 23251 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.417358 22063 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
W20260709 12:26:26.425117 22036 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bed3f011bde43719e0a7ce10da0401a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:26.426795 23334 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.406176 21966 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.428475 22146 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:26.437222 21965 catalog_manager.cc:5697] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.480595 23251 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.483173 22217 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.484331 22140 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:26.509421 22731 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.514196 21963 catalog_manager.cc:5697] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index -1 to 2, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.517773 23339 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:26.553658 22071 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.555064 23264 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:26:26.576655 21998 debug-util.cc:398] Leaking SignalData structure 0x7b0800095080 after lost signal to thread 20876
W20260709 12:26:26.577807 21998 debug-util.cc:398] Leaking SignalData structure 0x7b080003d2c0 after lost signal to thread 22002
W20260709 12:26:26.579026 21998 debug-util.cc:398] Leaking SignalData structure 0x7b080034f700 after lost signal to thread 22095
W20260709 12:26:26.580139 21998 debug-util.cc:398] Leaking SignalData structure 0x7b0800332ac0 after lost signal to thread 22170
W20260709 12:26:26.581233 21998 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7a20 after lost signal to thread 22244
W20260709 12:26:26.582389 21998 debug-util.cc:398] Leaking SignalData structure 0x7b0800320b00 after lost signal to thread 22761
I20260709 12:26:26.587538 22140 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.588979 23264 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.607115 22071 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.608441 23321 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.772902 23376 ts_tablet_manager.cc:933] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:26.776597 23376 tablet_copy_client.cc:323] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:26.778473 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet cb9f575e2f52433abc7aeff041ddb880 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:26.779069 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet cb9f575e2f52433abc7aeff041ddb880 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-cb9f575e2f52433abc7aeff041ddb880
I20260709 12:26:26.790059 22156 tablet_copy_source_session.cc:215] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:26.808274 23376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f575e2f52433abc7aeff041ddb880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:26.838587 23376 tablet_copy_client.cc:806] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:26.839326 23376 tablet_copy_client.cc:670] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:26.872443 22214 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.873335 23376 tablet_copy_client.cc:538] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:26.874014 22140 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.874487 23378 ts_tablet_manager.cc:933] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:26.876364 23314 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.878999 23314 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.883592 23376 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:26.939285 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.961421 23378 tablet_copy_client.cc:323] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:27.056407 22229 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet c609d086e32e4033b7376f770a2790a6 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:27.056996 22229 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet c609d086e32e4033b7376f770a2790a6 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-c609d086e32e4033b7376f770a2790a6
I20260709 12:26:27.061362 23383 ts_tablet_manager.cc:933] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:27.093524 23383 tablet_copy_client.cc:323] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.65:40323
I20260709 12:26:27.095790 22081 tablet_copy_service.cc:140] P c9a50b2f586448c49281a6618c40a1f7: Received BeginTabletCopySession request for tablet 2bed3f011bde43719e0a7ce10da0401a from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:48062)
I20260709 12:26:27.096446 22081 tablet_copy_service.cc:161] P c9a50b2f586448c49281a6618c40a1f7: Beginning new tablet copy session on tablet 2bed3f011bde43719e0a7ce10da0401a from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:48062: session id = ed678a3f9e3d4e0ba5801f1663548796-2bed3f011bde43719e0a7ce10da0401a
I20260709 12:26:27.110755 22081 tablet_copy_source_session.cc:215] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.113822 22063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:27.114456 22063 raft_consensus.cc:606] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:27.116590 23383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bed3f011bde43719e0a7ce10da0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.147258 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "821557b36d67456997b35682a066dbc9"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:27.147924 22142 raft_consensus.cc:606] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:27.184473 22229 tablet_copy_source_session.cc:215] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.193240 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:27.194181 22214 raft_consensus.cc:606] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:27.204975 23378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c609d086e32e4033b7376f770a2790a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.209924 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:27.210625 22214 raft_consensus.cc:606] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:27.212335 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:27.214167 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:26:27.214152 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 47400.3us
I20260709 12:26:27.215166 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:27.226140 23382 ts_tablet_manager.cc:933] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:27.244504 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 71739.1us
I20260709 12:26:27.292172 23383 tablet_copy_client.cc:806] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.292783 23383 tablet_copy_client.cc:670] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.313267 23383 tablet_copy_client.cc:538] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.323079 23376 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.324191 23376 tablet_bootstrap.cc:492] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:27.325594 23382 tablet_copy_client.cc:323] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:27.331014 23378 tablet_copy_client.cc:806] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.331643 23378 tablet_copy_client.cc:670] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.332310 23292 raft_consensus.cc:993] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:27.332808 23292 raft_consensus.cc:1081] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:27.333649 23251 raft_consensus.cc:993] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:27.334161 23251 raft_consensus.cc:1081] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:27.337741 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:26:27.338340 22214 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.338719 22214 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.341284 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet 3b958cd7e995415696872e37e9c3062b from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:27.341835 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet 3b958cd7e995415696872e37e9c3062b from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-3b958cd7e995415696872e37e9c3062b
I20260709 12:26:27.325031 23376 ts_tablet_manager.cc:1403] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.442s	user 0.026s	sys 0.010s
I20260709 12:26:27.347370 23376 raft_consensus.cc:359] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.350332 22156 tablet_copy_source_session.cc:215] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:27.348285 23376 raft_consensus.cc:740] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:27.364820 23382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b958cd7e995415696872e37e9c3062b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:27.371798 23378 tablet_copy_client.cc:538] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.364665 22214 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.376092 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:27.378021 22063 raft_consensus.cc:3055] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:27.378402 22063 raft_consensus.cc:740] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:27.379334 22063 consensus_queue.cc:260] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.380816 22063 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.361773 23376 consensus_queue.cc:260] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.359373 23383 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:27.395205 22214 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:27.416457 22140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:27.417104 22140 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.417578 22140 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.437341 23376 ts_tablet_manager.cc:1434] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 12:26:27.441041 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-cb9f575e2f52433abc7aeff041ddb880 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:27.441524 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-cb9f575e2f52433abc7aeff041ddb880 on tablet cb9f575e2f52433abc7aeff041ddb880 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:27.444860 22140 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.457269 22140 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:27.462823 22063 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:27.464182 22185 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:27.465066 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:27.465842 22142 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.475935 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:27.476593 22217 raft_consensus.cc:3055] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:27.477874 22217 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:27.479611 22217 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.481050 22217 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.481276 22142 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:27.483544 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:27.484122 22063 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.487610 22217 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:27.471040 23320 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.491369 22063 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:27.508402 22111 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:27.511166 23320 raft_consensus.cc:697] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:27.520315 23320 consensus_queue.cc:237] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.518528 23378 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:27.517378 23396 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:27.536058 23243 raft_consensus.cc:993] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:27.536572 23243 raft_consensus.cc:1081] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:27.537788 23396 raft_consensus.cc:697] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:27.538718 23396 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.545493 23321 raft_consensus.cc:993] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:27.546057 23321 raft_consensus.cc:1081] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:27.575942 23382 tablet_copy_client.cc:806] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:27.581714 23383 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.582662 23383 tablet_bootstrap.cc:492] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:27.583348 23383 ts_tablet_manager.cc:1403] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.225s	user 0.021s	sys 0.003s
I20260709 12:26:27.590449 23383 raft_consensus.cc:359] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.591298 23383 raft_consensus.cc:740] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:27.576963 23382 tablet_copy_client.cc:670] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:27.621667 23382 tablet_copy_client.cc:538] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:27.591933 23383 consensus_queue.cc:260] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
W20260709 12:26:27.622695 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 110852us
I20260709 12:26:27.636104 22063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "821557b36d67456997b35682a066dbc9"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:54728
I20260709 12:26:27.636668 22063 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.636998 22063 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.636932 22731 raft_consensus.cc:1217] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:27.642628 22142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:27.643190 22142 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:27.643510 22142 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.656689 21965 catalog_manager.cc:5697] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:27.664960 22142 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.668433 22063 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.671092 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:27.671365 23383 ts_tablet_manager.cc:1434] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.000s
I20260709 12:26:27.671689 22140 raft_consensus.cc:3055] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:27.672006 22140 raft_consensus.cc:740] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:27.672780 22140 consensus_queue.cc:260] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.673820 22140 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.678303 22142 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:27.682950 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:27.683573 22217 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.686115 22081 tablet_copy_service.cc:342] P c9a50b2f586448c49281a6618c40a1f7: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2bed3f011bde43719e0a7ce10da0401a received from {username='slave'} at 127.0.0.1:48062
I20260709 12:26:27.686584 22081 tablet_copy_service.cc:434] P c9a50b2f586448c49281a6618c40a1f7: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2bed3f011bde43719e0a7ce10da0401a on tablet 2bed3f011bde43719e0a7ce10da0401a with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:27.691448 22217 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:27.692785 22063 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:27.693442 22036 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:27.692749 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:27.695004 22219 raft_consensus.cc:3055] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:27.691886 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:27.695885 22071 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.695298 22219 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:27.698257 22219 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.704898 22140 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:27.702049 23394 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.706743 23394 raft_consensus.cc:697] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:27.706017 21963 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.708729 22219 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.711840 23394 consensus_queue.cc:237] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.807106 22071 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:27.808692 23382 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:27.811551 22219 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:27.836709 21966 catalog_manager.cc:5697] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.838733 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:27.843523 23245 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.845947 23245 raft_consensus.cc:697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:27.846907 23245 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:27.871464 23378 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.872494 23378 tablet_bootstrap.cc:492] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:27.889276 23378 ts_tablet_manager.cc:1403] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.377s	user 0.022s	sys 0.009s
I20260709 12:26:27.892922 23378 raft_consensus.cc:359] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.893872 23378 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:27.894709 23378 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.908691 23382 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:27.909698 23382 tablet_bootstrap.cc:492] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:27.910481 23382 ts_tablet_manager.cc:1403] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.008s
I20260709 12:26:27.913897 23382 raft_consensus.cc:359] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.914779 23382 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:27.915426 23382 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:27.918236 23382 ts_tablet_manager.cc:1434] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:26:27.920523 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-3b958cd7e995415696872e37e9c3062b received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:27.920956 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-3b958cd7e995415696872e37e9c3062b on tablet 3b958cd7e995415696872e37e9c3062b with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:27.927419 23378 ts_tablet_manager.cc:1434] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:26:27.928638 22733 raft_consensus.cc:1217] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:27.929996 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-c609d086e32e4033b7376f770a2790a6 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:27.930506 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-c609d086e32e4033b7376f770a2790a6 on tablet c609d086e32e4033b7376f770a2790a6 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:27.935024 21963 catalog_manager.cc:5697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:27.950204 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:27.950832 22142 raft_consensus.cc:606] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:26:27.960130 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:27.960690 22142 raft_consensus.cc:606] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Received request to transfer leadership
W20260709 12:26:27.961797 21952 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c609d086e32e4033b7376f770a2790a6 already in progress [suppressed 6 similar messages]
I20260709 12:26:27.973214 22733 raft_consensus.cc:1217] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:27.975180 22219 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:27.977128 23317 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:28.000134 22142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:28.000842 22142 raft_consensus.cc:606] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Received request to transfer leadership
W20260709 12:26:28.005726 22017 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:26:28.006147 22017 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c609d086e32e4033b7376f770a2790a6 already in progress
W20260709 12:26:28.006451 22017 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c609d086e32e4033b7376f770a2790a6 already in progress
I20260709 12:26:28.008955 23245 raft_consensus.cc:993] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:28.009526 23245 raft_consensus.cc:1081] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:28.013374 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:28.056015 22217 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.056444 22217 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.063882 22217 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:28.080641 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:28.081512 22071 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.082633 22217 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:28.082751 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:28.093080 22071 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:28.100154 22063 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:28.106052 23245 consensus_queue.cc:1059] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:28.117642 22185 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:28.118655 23401 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.119246 22140 raft_consensus.cc:3055] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:28.119660 22140 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:28.119192 23401 raft_consensus.cc:697] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:28.121912 22733 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Advancing to term 3
I20260709 12:26:28.121994 23401 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:28.120424 22140 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:28.126098 22140 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.130219 22733 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:28.132444 22071 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:26:28.134370 22140 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:28.147944 21965 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 4, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.157720 22071 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.163586 22140 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.165970 23264 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.177776 23401 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.189770 23396 raft_consensus.cc:1064] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:28.194389 23396 consensus_queue.cc:237] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:28.207659 22142 raft_consensus.cc:1275] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.209805 23251 consensus_queue.cc:1048] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.267486 22217 raft_consensus.cc:1275] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.269120 23394 consensus_queue.cc:1048] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.290560 22063 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.296593 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.317667 23402 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:28.405925 23295 raft_consensus.cc:1064] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:28.408454 23295 consensus_queue.cc:237] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:28.422399 22733 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.426059 22217 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.429562 22071 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.428967 22140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:28.430240 22140 raft_consensus.cc:606] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:28.447072 22217 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.449857 23402 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:28.444804 22213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:28.451041 22213 raft_consensus.cc:606] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:28.453984 22071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:28.454568 22071 raft_consensus.cc:606] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:28.456115 23402 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.458351 23402 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:28.461383 23319 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.463526 22213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:28.464083 22213 raft_consensus.cc:606] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:28.465322 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:28.466298 22140 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.467027 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:28.467653 23295 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.468883 22733 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.469295 22217 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:28.470116 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:28.470770 23251 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:28.472306 23251 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:28.491559 23396 raft_consensus.cc:993] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:28.492067 23396 raft_consensus.cc:1081] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:28.574409 23251 raft_consensus.cc:993] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:28.574831 23251 raft_consensus.cc:1081] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:28.576642 22217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:26:28.577221 22217 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.577548 22217 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.579903 22063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:54728
I20260709 12:26:28.580559 22063 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.580955 22063 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.585019 22217 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:28.586359 22736 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Advancing to term 4
I20260709 12:26:28.591964 23295 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.596673 22065 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:28.603729 23320 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:28.607306 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:28.607903 22070 raft_consensus.cc:3055] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.608217 22070 raft_consensus.cc:740] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:28.608915 22070 consensus_queue.cc:260] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:28.609934 22070 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.618307 22070 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:28.619551 22185 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:28.607828 22217 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:28.620453 23320 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:28.621747 23320 raft_consensus.cc:697] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:28.623198 22736 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:28.626557 23264 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:28.629043 22733 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.633217 22217 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.622723 23320 consensus_queue.cc:237] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:28.656209 22142 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.674605 22063 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:28.678004 22063 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:28.678692 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:28.679046 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:28.733609 22217 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.753307 22142 raft_consensus.cc:3055] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.757310 22142 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:28.758229 22142 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:28.760463 22142 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.763142 22217 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:28.767532 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:28.785620 22216 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:28.785660 22140 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.768652 22143 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:28.777453 23421 raft_consensus.cc:993] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:28.791189 23320 raft_consensus.cc:1081] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:28.792425 23320 raft_consensus.cc:1064] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:28.823139 22140 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:28.822954 21965 catalog_manager.cc:5697] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:28.845502 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 69948us
I20260709 12:26:28.847129 22036 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:28.848100 23295 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:28.848621 23295 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:28.849702 23295 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:28.854342 21963 catalog_manager.cc:5697] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.868592 22142 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:28.875778 23320 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:28.876698 23319 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.891152 22736 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:28.893009 23441 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:28.908138 22063 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:28.909829 23320 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:28.916294 23423 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.916818 22736 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.925333 22070 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.953676 22733 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.953003 22063 consensus_queue.cc:237] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:28.958304 22213 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:28.961112 21966 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:28.968582 22142 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:28.969307 22142 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:28.969713 22142 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.987835 22140 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:28.996321 22733 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:28.997606 22213 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:28.999852 23436 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:28.999217 21965 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.002246 23436 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:29.005440 22070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:29.006093 22070 raft_consensus.cc:606] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:29.017133 22070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:29.017783 22070 raft_consensus.cc:606] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:29.019321 22217 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:29.024240 23251 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.035791 22070 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:29.037353 23423 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:29.045364 22733 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:29.049679 22065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:29.047703 22213 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.050267 22065 raft_consensus.cc:606] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:29.052735 23442 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.056990 23320 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:29.057403 22733 raft_consensus.cc:2955] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:26:29.065449 22017 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:26:29.065863 22017 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 3b958cd7e995415696872e37e9c3062b already in progress
W20260709 12:26:29.066144 22017 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 3b958cd7e995415696872e37e9c3062b already in progress
I20260709 12:26:29.066258 22731 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.058399 22065 raft_consensus.cc:2955] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.076395 21967 catalog_manager.cc:5697] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.082595 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c609d086e32e4033b7376f770a2790a6 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:29.089807 22142 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:29.091949 22142 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:29.097383 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2bed3f011bde43719e0a7ce10da0401a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:29.097039 22063 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.179028 23423 raft_consensus.cc:993] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:29.179710 23441 raft_consensus.cc:1081] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:29.207583 21965 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: config changed from index 6 to 7, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.242542 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:29.243302 22217 raft_consensus.cc:3055] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.243665 22217 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:29.244725 22217 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:29.248549 22217 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.277103 22137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:29.277570 22140 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.277940 22137 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.278461 22137 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.279783 22217 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:29.286048 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:29.286690 22736 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.294114 22137 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:29.294667 22736 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:29.296507 22137 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:29.300320 22143 raft_consensus.cc:1275] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.308661 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:29.308986 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 209642us
I20260709 12:26:29.309373 22065 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.310688 23442 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:29.315711 22111 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:29.316543 23319 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.317137 23319 raft_consensus.cc:697] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:29.318192 23319 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:29.326370 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:29.327044 22217 raft_consensus.cc:3055] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.327380 22217 raft_consensus.cc:740] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:26:29.402666 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 84973.6us
I20260709 12:26:29.329741 22217 consensus_queue.cc:260] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:29.423413 22065 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
W20260709 12:26:29.501134 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 75887us
I20260709 12:26:29.531121 22065 raft_consensus.cc:1275] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:29.546900 22213 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:29.568181 22731 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 LEARNER]: Advancing to term 2
I20260709 12:26:29.614856 23394 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:26:29.618064 23460 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:29.675902 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:29.677294 23461 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:29.677992 23461 raft_consensus.cc:697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:29.678539 22217 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.679473 23461 consensus_queue.cc:237] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:29.699528 22731 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:29.709685 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:29.712139 22131 tablet_service.cc:1558] Processing DeleteTablet for tablet c609d086e32e4033b7376f770a2790a6 with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59926
I20260709 12:26:29.701272 21966 catalog_manager.cc:5697] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, VOTER 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) evicted. New cstate: current_term: 1 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:29.725279 22217 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:29.730302 22145 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:29.751961 23451 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:29.772058 22141 consensus_queue.cc:237] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:29.778909 23394 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:29.780826 22731 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:29.833741 23453 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:26:29.835450 23295 raft_consensus.cc:993] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:29.836074 23295 raft_consensus.cc:1081] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:29.841790 22133 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bed3f011bde43719e0a7ce10da0401a with delete_type TABLET_DATA_TOMBSTONED (TS 85f0d4cf04de40aa9e25849fb2380466 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59926
W20260709 12:26:29.867733 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.875303 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:26:29.876099 22214 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.876482 22214 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.882689 23473 tablet_replica.cc:333] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:29.895730 22736 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.908746 22063 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:29.916996 22214 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:29.961899 23402 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:30.050791 22214 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:30.053237 23453 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.054029 23453 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:30.056962 23453 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:30.058032 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 84763.9us
I20260709 12:26:30.078708 22219 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:30.058641 21966 catalog_manager.cc:5697] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:30.084574 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:30.085276 22065 raft_consensus.cc:3055] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:30.085620 22065 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:30.086057 23461 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:30.086424 22065 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:30.087560 22065 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.122916 23462 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:30.136945 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:30.137684 22137 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.155602 23473 raft_consensus.cc:2243] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.158299 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:30.168824 22065 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:30.146505 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:30.189702 23473 raft_consensus.cc:2272] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.211782 23402 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:30.260615 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 90004.8us
I20260709 12:26:30.280588 22219 raft_consensus.cc:1275] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.283766 22111 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:30.284847 22111 raft_consensus.cc:2686] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:30.290956 23319 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:30.293987 23473 ts_tablet_manager.cc:1916] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.292825 23396 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:30.303517 22137 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:30.304680 22736 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:30.272065 23402 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:30.312191 23402 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:30.325563 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:30.338788 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:30.346107 22111 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:30.346907 23319 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:30.338717 22185 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:30.361756 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 46604.4us
I20260709 12:26:30.391405 22066 raft_consensus.cc:1275] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:30.393456 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 138985us
I20260709 12:26:30.399183 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:30.418990 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 56457.2us
I20260709 12:26:30.428727 23442 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:30.430370 23442 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:30.431352 23442 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:30.435549 21965 catalog_manager.cc:5697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:26:30.463291 21952 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb9f575e2f52433abc7aeff041ddb880 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:26:30.485301 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 127141us
I20260709 12:26:30.499459 21966 catalog_manager.cc:5697] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New cstate: current_term: 1 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:30.505084 23473 ts_tablet_manager.cc:1929] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:26:30.511181 23473 log.cc:1199] T c609d086e32e4033b7376f770a2790a6 P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/c609d086e32e4033b7376f770a2790a6
I20260709 12:26:30.530149 22205 tablet_service.cc:1558] Processing DeleteTablet for tablet cb9f575e2f52433abc7aeff041ddb880 with delete_type TABLET_DATA_TOMBSTONED (TS be238c1de63840f9bb041e2f9ba58d2b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37702
I20260709 12:26:30.532666 23453 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:30.539269 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet c609d086e32e4033b7376f770a2790a6 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:30.539455 23473 tablet_replica.cc:333] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:26:30.546447 23473 raft_consensus.cc:2243] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.548059 23496 tablet_replica.cc:333] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:26:30.549995 21963 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 3, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.551965 23473 raft_consensus.cc:2272] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.559945 23496 raft_consensus.cc:2243] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:30.565718 23473 ts_tablet_manager.cc:1916] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.567811 23496 raft_consensus.cc:2272] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:30.570772 22065 raft_consensus.cc:2955] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:30.597401 23496 ts_tablet_manager.cc:1916] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:30.626839 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:30.627592 22214 raft_consensus.cc:606] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:30.632022 23473 ts_tablet_manager.cc:1929] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:30.632532 23473 log.cc:1199] T 2bed3f011bde43719e0a7ce10da0401a P 85f0d4cf04de40aa9e25849fb2380466: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/wals/2bed3f011bde43719e0a7ce10da0401a
I20260709 12:26:30.634064 21952 catalog_manager.cc:5028] TS 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): tablet 2bed3f011bde43719e0a7ce10da0401a (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:30.637934 22146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:30.638527 22146 raft_consensus.cc:606] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:30.647728 22214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:30.648320 22214 raft_consensus.cc:606] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:30.653362 22065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3caebc0658346798308160a170ffc71"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:30.653966 22065 raft_consensus.cc:606] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:30.655467 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:30.657142 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:30.658129 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.665889 23496 ts_tablet_manager.cc:1929] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:30.666437 23496 log.cc:1199] T cb9f575e2f52433abc7aeff041ddb880 P be238c1de63840f9bb041e2f9ba58d2b: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/wals/cb9f575e2f52433abc7aeff041ddb880
I20260709 12:26:30.668994 23396 raft_consensus.cc:993] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:30.669533 23396 raft_consensus.cc:1081] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:30.671151 21953 catalog_manager.cc:5028] TS be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): tablet cb9f575e2f52433abc7aeff041ddb880 (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:30.674559 23468 raft_consensus.cc:993] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:30.675275 23468 raft_consensus.cc:1081] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:30.676951 22146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3caebc0658346798308160a170ffc71"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59944
I20260709 12:26:30.677129 22065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:54728
I20260709 12:26:30.677526 22146 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.677788 22065 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.677933 22146 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.678259 22065 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.685647 22065 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:30.692701 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:30.693360 22143 raft_consensus.cc:3055] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.693740 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:30.693831 22143 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:30.694352 22214 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.694890 22143 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:30.696214 22143 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.693300 22065 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:30.708956 22143 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:30.722016 22035 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:30.725162 23468 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.729302 23468 raft_consensus.cc:697] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:30.730298 23468 consensus_queue.cc:237] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:30.731321 22146 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:30.734047 22146 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:30.735328 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:30.735908 22065 raft_consensus.cc:3055] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.736174 22065 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:30.737452 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:30.736876 22065 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:30.739840 22065 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.744730 22214 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:30.745991 22731 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.751573 23457 raft_consensus.cc:993] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:30.753410 23457 raft_consensus.cc:1081] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:30.757685 22731 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:30.761039 22111 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:30.763000 23402 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.763518 23402 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:30.764460 23402 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:30.751663 22065 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:30.770609 22143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:30.771235 22143 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.771636 22143 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.780723 22143 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:30.782742 22143 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:30.790693 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:30.791376 22065 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.793131 21963 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.798867 21966 catalog_manager.cc:5697] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.795728 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:30.805917 22214 raft_consensus.cc:3055] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.806305 22214 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:30.807708 22214 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:30.817607 22214 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.825222 22214 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:30.826185 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:30.826550 22065 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:30.827234 23456 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.828604 23456 raft_consensus.cc:697] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:30.831552 23456 consensus_queue.cc:237] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:30.848017 21966 catalog_manager.cc:5697] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:30.871465 23442 raft_consensus.cc:993] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:30.872027 23442 raft_consensus.cc:1081] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer ed678a3f9e3d4e0ba5801f1663548796 to start an election
I20260709 12:26:30.873668 22066 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:30.886216 22731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
 from {username='slave'} at 127.0.0.1:35006
I20260709 12:26:30.886832 22731 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:30.887215 22731 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.891979 23459 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:26:30.900022 22731 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:30.903226 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:30.903832 22065 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.917259 22065 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:30.925725 22065 raft_consensus.cc:1240] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:30.940390 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:30.950902 22146 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:30.948827 23449 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.951928 23449 raft_consensus.cc:697] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:30.952806 23449 consensus_queue.cc:237] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:30.956367 23423 consensus_queue.cc:1059] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:26:30.957508 23442 raft_consensus.cc:3055] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.957896 23442 raft_consensus.cc:740] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:30.958853 23442 consensus_queue.cc:260] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:30.960057 23442 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.960505 23457 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:30.965850 22732 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Advancing to term 3
I20260709 12:26:30.986652 22732 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:30.987659 22731 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:30.990188 23490 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:31.053303 23502 log.cc:927] Time spent T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:31.059523 23457 raft_consensus.cc:1064] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
W20260709 12:26:31.129015 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 72303us
I20260709 12:26:31.187942 23457 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:31.194473 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 128587us
I20260709 12:26:31.209690 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:31.216811 21963 catalog_manager.cc:5697] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.236927 22219 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:31.238293 22143 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.252537 22146 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:31.262126 22063 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:31.265225 23489 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:31.272923 22063 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.273293 23490 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:31.287464 23317 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:31.290293 22219 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.296618 23436 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:31.301430 23436 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:31.308259 22731 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:31.307354 23442 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.316442 23457 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:31.323498 22731 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.356640 22217 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.358695 22063 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:31.351118 22065 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.361285 23396 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:31.362758 23463 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.379278 21963 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 2 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.383369 22736 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:31.389925 23463 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:26:31.429879 22065 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:31.435491 22217 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:31.439659 23508 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:26:31.446489 23507 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:31.519098 22146 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.535754 22217 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:31.544538 22731 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:31.546476 23490 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:31.548044 22146 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:31.565376 23423 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:31.580861 23442 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.583503 22737 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.603000 22146 raft_consensus.cc:2955] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.634284 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b958cd7e995415696872e37e9c3062b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:31.643918 21966 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 5 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:31.662151 22058 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b958cd7e995415696872e37e9c3062b with delete_type TABLET_DATA_TOMBSTONED (TS c9a50b2f586448c49281a6618c40a1f7 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:54716
I20260709 12:26:31.678810 23523 tablet_replica.cc:333] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:26:31.679986 23523 raft_consensus.cc:2243] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:31.681070 23523 raft_consensus.cc:2272] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:31.684831 23523 ts_tablet_manager.cc:1916] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:31.708427 23523 ts_tablet_manager.cc:1929] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:26:31.709041 23523 log.cc:1199] T 3b958cd7e995415696872e37e9c3062b P c9a50b2f586448c49281a6618c40a1f7: Deleting WAL directory at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/wals/3b958cd7e995415696872e37e9c3062b
I20260709 12:26:31.711048 21953 catalog_manager.cc:5028] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): tablet 3b958cd7e995415696872e37e9c3062b (table test-workload [id=0d008da09cf34f64b0f635bebbe74e2c]) successfully deleted
I20260709 12:26:31.708446 22146 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:31.725831 22214 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:31.727593 23463 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:31.728011 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.729737 22065 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:31.732270 23463 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:31.735033 22111 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf83ee90e33b4083aebda67b32ca1149. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:31.754074 23396 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.766444 22214 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.755429 22066 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.804554 21967 catalog_manager.cc:5697] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 4, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.807754 22146 consensus_queue.cc:237] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:31.821667 22214 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:31.826912 23463 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:31.830356 22066 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:31.830735 22111 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d935d1f5ca454cf6b73d0e33d7a7f51a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:31.838600 23463 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.842033 23456 raft_consensus.cc:2955] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.872457 22137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:31.873229 22137 raft_consensus.cc:606] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:31.877112 22218 raft_consensus.cc:2955] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.888428 22214 consensus_queue.cc:237] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:31.897946 22137 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:31.898622 22137 raft_consensus.cc:606] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:31.901852 22066 raft_consensus.cc:2955] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.902168 22146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:31.934644 22146 raft_consensus.cc:606] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Received request to transfer leadership to TS c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:31.913136 21965 catalog_manager.cc:5697] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.913885 22137 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:31.943249 23442 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.907780 22065 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:31.906924 22185 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66ecbcd398b0449b86b36309434ca3d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:31.947352 23442 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.958434 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:31.960289 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:31.964294 23459 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.974427 22143 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.976107 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.968598 22066 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:31.986779 22218 consensus_queue.cc:237] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.000984 21965 catalog_manager.cc:5697] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.027714 22065 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:32.028786 22143 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:32.029115 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99368f219dd84b6994a569b62a8579d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.030033 23442 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.031842 23442 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.054520 23490 raft_consensus.cc:2955] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:32.064150 22067 raft_consensus.cc:2955] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:32.078330 22146 raft_consensus.cc:2955] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:26:32.119424 21966 catalog_manager.cc:5697] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index -1 to 3, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.250259 23463 raft_consensus.cc:993] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:32.250928 23463 raft_consensus.cc:1081] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:32.265120 22218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:32.265717 22218 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.266074 22218 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.277098 22218 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:32.280730 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:32.281387 22067 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.290246 23533 ts_tablet_manager.cc:933] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:32.299544 23533 tablet_copy_client.cc:323] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:32.300279 22218 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:32.301702 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet bf83ee90e33b4083aebda67b32ca1149 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:32.302343 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet bf83ee90e33b4083aebda67b32ca1149 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-bf83ee90e33b4083aebda67b32ca1149
I20260709 12:26:32.303086 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:32.303740 22146 raft_consensus.cc:3055] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:32.304059 22146 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:32.304797 22146 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:32.305929 22146 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.295344 22067 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:32.308756 22185 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:32.309514 23442 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:32.309989 23442 raft_consensus.cc:697] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:32.310845 23442 consensus_queue.cc:237] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:32.315349 22156 tablet_copy_source_session.cc:215] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:26:32.317296 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 72196.2us
I20260709 12:26:32.321635 23533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf83ee90e33b4083aebda67b32ca1149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.312922 22146 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:32.327780 23535 ts_tablet_manager.cc:933] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:32.346167 23456 raft_consensus.cc:993] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:32.346787 23317 raft_consensus.cc:1081] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:32.349568 23535 tablet_copy_client.cc:323] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:26:32.351263 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet d935d1f5ca454cf6b73d0e33d7a7f51a from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:26:32.351792 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet d935d1f5ca454cf6b73d0e33d7a7f51a from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-d935d1f5ca454cf6b73d0e33d7a7f51a
I20260709 12:26:32.357643 22066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:54728
I20260709 12:26:32.358223 22066 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.358572 22066 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.360324 22156 tablet_copy_source_session.cc:215] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:32.365407 22066 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:32.366079 23535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d935d1f5ca454cf6b73d0e33d7a7f51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.368564 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:32.369199 22146 raft_consensus.cc:3055] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:32.369498 22146 raft_consensus.cc:740] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:32.368347 22066 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:32.370339 22146 consensus_queue.cc:260] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:32.371404 22146 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.369374 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:32.372822 22736 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.379592 22736 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:32.380703 22036 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:32.381565 23534 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:32.383569 23534 raft_consensus.cc:697] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:32.384490 23534 consensus_queue.cc:237] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:32.389678 22146 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:32.396026 23533 tablet_copy_client.cc:806] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:32.396770 23533 tablet_copy_client.cc:670] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:32.413239 23533 tablet_copy_client.cc:538] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:32.417621 23541 ts_tablet_manager.cc:933] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:32.416529 21966 catalog_manager.cc:5697] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.432904 23533 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:32.432274 21965 catalog_manager.cc:5697] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:32.437181 23541 tablet_copy_client.cc:323] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:32.439656 22229 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 99368f219dd84b6994a569b62a8579d0 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:32.440280 23402 raft_consensus.cc:993] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:32.440244 22229 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 99368f219dd84b6994a569b62a8579d0 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-99368f219dd84b6994a569b62a8579d0
I20260709 12:26:32.440883 23402 raft_consensus.cc:1081] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:32.443487 22214 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37716
I20260709 12:26:32.444031 22214 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.444403 22214 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.450141 23535 tablet_copy_client.cc:806] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:32.450785 23535 tablet_copy_client.cc:670] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:32.452026 22214 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:32.454649 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:32.455199 22066 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.461980 22066 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:32.463228 22185 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:32.464103 23442 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:32.464614 23442 raft_consensus.cc:697] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:32.465483 23442 consensus_queue.cc:237] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:32.469586 23535 tablet_copy_client.cc:538] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:32.477718 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:32.478353 22146 raft_consensus.cc:3055] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:32.478643 22146 raft_consensus.cc:740] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:32.479405 22146 consensus_queue.cc:260] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:32.480436 22146 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.484820 22229 tablet_copy_source_session.cc:215] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:32.492177 22214 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:32.486726 23544 ts_tablet_manager.cc:933] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:32.498950 23541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99368f219dd84b6994a569b62a8579d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.491364 22146 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:32.502080 21966 catalog_manager.cc:5697] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.510911 23535 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:32.513751 23544 tablet_copy_client.cc:323] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:26:32.515743 22229 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 66ecbcd398b0449b86b36309434ca3d1 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:26:32.516278 22229 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 66ecbcd398b0449b86b36309434ca3d1 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-66ecbcd398b0449b86b36309434ca3d1
I20260709 12:26:32.519589 23541 tablet_copy_client.cc:806] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:32.520176 23541 tablet_copy_client.cc:670] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:32.526719 23541 tablet_copy_client.cc:538] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:32.529469 23533 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:32.531477 23533 tablet_bootstrap.cc:492] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:32.532253 23533 ts_tablet_manager.cc:1403] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.031s
I20260709 12:26:32.535509 23533 raft_consensus.cc:359] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.536321 23533 raft_consensus.cc:740] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:32.536962 23533 consensus_queue.cc:260] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.539840 23541 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:32.552222 22229 tablet_copy_source_session.cc:215] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:32.554250 23533 ts_tablet_manager.cc:1434] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.007s
I20260709 12:26:32.558197 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-bf83ee90e33b4083aebda67b32ca1149 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:32.558674 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-bf83ee90e33b4083aebda67b32ca1149 on tablet bf83ee90e33b4083aebda67b32ca1149 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:32.560390 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ecbcd398b0449b86b36309434ca3d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:32.592226 23541 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:32.593314 23541 tablet_bootstrap.cc:492] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:32.594189 23541 ts_tablet_manager.cc:1403] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.055s	user 0.030s	sys 0.004s
I20260709 12:26:32.596362 23544 tablet_copy_client.cc:806] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:32.597062 23544 tablet_copy_client.cc:670] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:32.602741 23544 tablet_copy_client.cc:538] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:32.614197 23544 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:26:32.623626 23535 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:32.624614 23535 tablet_bootstrap.cc:492] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:32.625339 23541 raft_consensus.cc:359] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.626410 23541 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:32.627122 23541 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.625339 23535 ts_tablet_manager.cc:1403] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.115s	user 0.024s	sys 0.005s
I20260709 12:26:32.629873 23541 ts_tablet_manager.cc:1434] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:26:32.631677 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-99368f219dd84b6994a569b62a8579d0 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:32.632164 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-99368f219dd84b6994a569b62a8579d0 on tablet 99368f219dd84b6994a569b62a8579d0 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:32.631872 23535 raft_consensus.cc:359] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.632743 23535 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:32.633443 23535 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.649523 23535 ts_tablet_manager.cc:1434] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:26:32.654839 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-d935d1f5ca454cf6b73d0e33d7a7f51a received from {username='slave'} at 127.0.0.1:56596
I20260709 12:26:32.655337 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-d935d1f5ca454cf6b73d0e33d7a7f51a on tablet d935d1f5ca454cf6b73d0e33d7a7f51a with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:32.673556 22736 raft_consensus.cc:1217] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:26:32.674237 23544 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:32.675540 23544 tablet_bootstrap.cc:492] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:26:32.676282 23544 ts_tablet_manager.cc:1403] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.011s
I20260709 12:26:32.686203 23544 raft_consensus.cc:359] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.687155 23544 raft_consensus.cc:740] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:26:32.687922 23544 consensus_queue.cc:260] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:32.690307 23544 ts_tablet_manager.cc:1434] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:26:32.696938 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-66ecbcd398b0449b86b36309434ca3d1 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:26:32.697494 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-66ecbcd398b0449b86b36309434ca3d1 on tablet 66ecbcd398b0449b86b36309434ca3d1 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:32.811658 22737 raft_consensus.cc:1217] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:32.877395 22736 raft_consensus.cc:1217] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:32.887501 22063 raft_consensus.cc:1275] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:32.888900 23442 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.901826 22146 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:32.903891 23442 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.921245 22137 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:32.927783 23534 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:32.939356 22063 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:32.945151 23442 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:32.960273 22146 raft_consensus.cc:1275] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:32.971174 22736 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:32.979745 23451 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:26:33.005872 23459 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 12:26:33.039528 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 77076us
I20260709 12:26:33.106263 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.154466 22736 raft_consensus.cc:1217] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 12:26:33.206249 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 137495us
W20260709 12:26:33.248674 23563 log.cc:927] Time spent T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.127s	user 0.013s	sys 0.015s
W20260709 12:26:33.307483 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 101796us
W20260709 12:26:33.344952 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 64417.7us
W20260709 12:26:33.351332 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 69096.8us
I20260709 12:26:33.387131 23554 raft_consensus.cc:1064] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:33.390096 23554 consensus_queue.cc:237] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.405212 23564 raft_consensus.cc:1064] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
W20260709 12:26:33.413108 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 59486.5us
I20260709 12:26:33.413549 22736 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.414055 22063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:33.414620 22063 raft_consensus.cc:606] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:33.415556 23576 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:33.419920 22218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:33.420459 22218 raft_consensus.cc:606] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Received request to transfer leadership to TS c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:33.408500 23564 consensus_queue.cc:237] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.424307 22218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:33.424852 22218 raft_consensus.cc:606] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:33.426362 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:33.427996 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:33.428694 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:33.441488 22063 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.449015 22146 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.452128 23576 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:33.459393 23442 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:33.463383 23442 raft_consensus.cc:993] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:33.464401 23565 raft_consensus.cc:1081] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:33.474421 23561 raft_consensus.cc:1064] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:33.481148 23561 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.489025 23442 raft_consensus.cc:2955] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:33.513139 22137 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:33.513831 22137 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.514284 22137 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.519109 22066 raft_consensus.cc:2955] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:33.519295 22736 raft_consensus.cc:2955] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:33.539983 23578 raft_consensus.cc:993] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: : Instructing follower be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:33.540619 23578 raft_consensus.cc:1081] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Signalling peer be238c1de63840f9bb041e2f9ba58d2b to start an election
I20260709 12:26:33.543545 22218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:37718
I20260709 12:26:33.544270 22218 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.544651 22218 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.554652 22137 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:33.557724 22216 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.560693 23576 raft_consensus.cc:993] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:33.562048 22063 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.563017 23577 raft_consensus.cc:1081] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Signalling peer c9a50b2f586448c49281a6618c40a1f7 to start an election
I20260709 12:26:33.566061 22216 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:33.572224 22737 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:33.572754 22063 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:33.576871 22737 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:33.575062 22137 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:33.588104 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:33.588675 22063 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.592087 21965 catalog_manager.cc:5697] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.600065 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:33.602142 22216 raft_consensus.cc:3055] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.602533 22216 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:33.603344 22216 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:33.604661 22216 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.611405 22063 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:33.611394 22066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:54730
I20260709 12:26:33.613912 22066 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.614264 22066 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.618227 23564 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:33.620483 22216 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:33.621053 23564 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:33.622663 23456 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:33.568783 22218 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.625726 23456 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.630196 22218 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:33.628831 22111 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:33.631583 23456 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:33.632248 23456 raft_consensus.cc:697] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:33.635684 23456 consensus_queue.cc:237] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:33.639562 22066 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.641953 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:33.642524 22067 raft_consensus.cc:3055] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.642807 22067 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:33.643867 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:33.644663 22736 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.643869 23579 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:33.645283 22067 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.646579 22067 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.647517 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:33.648070 22214 raft_consensus.cc:3055] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.648357 22214 raft_consensus.cc:740] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:33.644116 23564 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:26:33.651748 22214 consensus_queue.cc:260] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.653043 22214 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.653107 22736 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:33.656711 22067 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:33.659523 22066 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:33.662427 23576 raft_consensus.cc:1064] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:26:33.663332 22214 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:33.660117 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:33.664731 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:33.665030 22736 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.665863 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:33.667461 22143 raft_consensus.cc:2955] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:33.679278 23584 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.679898 23584 raft_consensus.cc:697] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:33.680768 23584 consensus_queue.cc:237] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.680878 23576 consensus_queue.cc:237] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:33.682544 23554 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.693264 23554 raft_consensus.cc:697] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:33.699680 23554 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:33.766970 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 48706.7us
I20260709 12:26:33.783396 22736 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
W20260709 12:26:33.925796 23594 log.cc:927] Time spent T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 12:26:33.927213 23595 log.cc:927] Time spent T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:26:33.929352 23598 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:26:33.930651 23592 log.cc:927] Time spent T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:26:33.963792 23561 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:34.005765 22731 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:34.013043 23577 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:34.101400 23597 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.322s	user 0.002s	sys 0.003s
W20260709 12:26:34.724498 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 782781us
I20260709 12:26:34.924206 23570 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:34.925117 23570 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:34.928577 23570 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:34.935179 23570 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:34.935856 23570 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.111001 23570 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:35.111945 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 386330us
I20260709 12:26:35.124014 23564 raft_consensus.cc:2955] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:35.153558 22146 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:35.155085 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 856) took 1111 ms. Trace:
I20260709 12:26:35.161497 23570 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.155565 22146 rpcz_store.cc:276] 0709 12:26:34.044204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.152866 (+1108662us) service_pool.cc:224] Handling call
0709 12:26:35.153223 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.154817 (+  1594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.155030 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:35.260803 23618 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.261431 23618 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.261814 23578 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.262326 23578 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.263639 23618 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.264169 23618 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.264369 23578 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.264607 23618 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.266880 23618 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:35.273837 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 157399us
I20260709 12:26:35.274933 23585 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.253346 23617 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.274459 23559 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.259793 23570 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.282235 23559 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.275965 23585 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.278059 23618 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.287577 23620 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.292511 23620 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.294920 23620 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.289456 23559 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:35.297979 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.349s	user 0.008s	sys 0.013s
I20260709 12:26:35.289812 23618 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:35.298794 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.009s	sys 0.014s
I20260709 12:26:35.300540 23618 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.291208 23585 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.286329 23614 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.302353 23614 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.303735 23506 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.304481 23614 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.280534 23617 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.307072 23617 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.280849 23619 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.308022 23619 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.304545 23506 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:35.321269 23506 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.287235 23616 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.322597 23619 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.350385 23620 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.359431 23614 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.359669 23615 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.361879 23559 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.362032 23585 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.367017 23619 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:35.381915 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 102181us
I20260709 12:26:35.383147 22069 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:35.368131 23620 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.378595 23570 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.390666 23623 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.385722 23506 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.385567 23628 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.393556 23624 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.355278 23616 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.380553 23559 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.385741 23615 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.424081 23559 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.424697 23622 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.381140 23614 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.389688 23585 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.389451 23619 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.425390 23622 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.427624 23620 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.428153 23612 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.429257 23616 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.417567 23506 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.430235 23614 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.430660 23631 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.427563 23628 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.437635 23622 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.424096 23615 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.437922 23506 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.438282 23628 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.424770 23559 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.434281 23616 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.415361 23623 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.435005 23618 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.441910 23554 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.442166 23585 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.438978 23570 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.447487 23616 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.438421 23615 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.443308 23631 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.440181 23628 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.433912 23612 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.464600 23623 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.465404 23623 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.466044 23623 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.449331 23618 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.471326 23612 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.463264 23628 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.472332 23618 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.477957 23628 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.480199 23625 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.490795 23638 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.491008 23636 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.491684 23638 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.490808 23634 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.493552 23634 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.496532 23634 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.491775 23636 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.497459 23638 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.480912 23625 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.482349 23612 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.501765 23628 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.504843 23622 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.504204 23636 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.474102 23615 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.520689 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.529313 23633 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.529870 23632 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.433475 23624 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.517576 23614 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.526602 23625 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.514792 23623 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.534384 22067 raft_consensus.cc:2468] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:35.517663 23620 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.536849 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.519495 23638 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.519486 23634 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.525800 23640 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.534201 23614 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.537969 22067 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:35.528070 23631 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.542601 23534 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.530359 23632 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.551050 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.534246 23626 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.519968 23628 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.519591 23612 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.530963 23622 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.539072 23616 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.543298 23620 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.534554 23633 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.544827 23638 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.547245 23631 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.738142 23631 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.738590 23632 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.646029 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.541782 23640 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.741083 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.742136 22216 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:35.644502 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:35.743484 22733 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:35.749953 21965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48108 (request call id 304) took 2212 ms. Trace:
I20260709 12:26:35.749864 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.751897 22069 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:35.754881 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.554874 23619 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.756800 22067 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:35.444895 23559 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.759660 23648 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.760197 23648 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.760697 23559 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.758173 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.762324 23648 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.762748 23648 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.763105 23648 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.764634 23648 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.765007 23648 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.655220 23637 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.546458 23634 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.564908 23635 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.678707 22734 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:35.565153 23641 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.566538 23618 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.678929 23629 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.690464 23623 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.769209 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.740147 23632 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.770205 23648 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.770709 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.771127 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.771587 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.794909 22219 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:35.795475 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.771948 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.772567 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.772917 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.556420 23534 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.755985 23614 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.750732 23645 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.797006 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.794788 22217 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:35.805939 23646 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.806185 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.768890 23643 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.781570 23636 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.796628 22220 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:35.781808 23615 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.818630 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.818630 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.806588 23646 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.560768 23626 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.777415 23618 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.819391 22146 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:35.823390 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.773304 23637 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.808122 23402 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.844671 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.845803 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:35.845901 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 54536.4us
I20260709 12:26:35.847482 22702 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:35.807806 22215 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:35.808300 23624 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.810150 23644 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.803839 23625 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.799271 23623 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.838399 23559 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.852072 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.834013 23616 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.804181 23632 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.752053 21965 rpcz_store.cc:276] 0709 12:26:33.529996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.530133 (+   137us) service_pool.cc:224] Handling call
0709 12:26:33.546468 (+ 16335us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b540032f354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23953090 00007f1e239f1f3a 00007f1e297a7e9c 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:33.563733 (+ 17265us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400040790. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c5640 00007f1e2979c846 00007f1e298a690e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:35.742336 (+2178603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:33.597096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:33.597691 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:33.597724 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:26:33.597742 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:33.598060 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:33.598146 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:33.598174 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:33.598369 (+   195us) tablet.cc:701] Row locks acquired
0709 12:26:33.598391 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:26:33.598535 (+   144us) write_op.cc:270] Start()
0709 12:26:33.598651 (+   116us) write_op.cc:276] Timestamp: P: 1783599993598489 usec, L: 0
0709 12:26:33.598677 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:26:33.599371 (+   694us) log.cc:844] Serialized 595 byte log entry
0709 12:26:35.162212 (+1562841us) op_driver.cc:464] REPLICATION: finished
0709 12:26:35.318553 (+156341us) write_op.cc:301] APPLY: starting
0709 12:26:35.318649 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:35.318772 (+   123us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:35.318916 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:35.319205 (+   289us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:35.319406 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:35.319459 (+    53us) write_op.cc:312] APPLY: finished
0709 12:26:35.319701 (+   242us) log.cc:844] Serialized 23 byte log entry
0709 12:26:35.377601 (+ 57900us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:35.378759 (+  1158us) write_op.cc:454] Released schema lock
0709 12:26:35.381105 (+  2346us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:35.414282 (+ 33177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:35.415366 (+  1084us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":65547904,"child_traces":[["op",{"apply.queue_time_us":156044,"apply.run_cpu_time_us":12907,"apply.run_wall_time_us":76503,"num_ops":1,"prepare.queue_time_us":1433,"prepare.run_cpu_time_us":134205,"prepare.run_wall_time_us":284154,"raft.queue_time_us":90346,"replication_time_us":1563339,"spinlock_wait_cycles":2636326144,"thread_start_us":500265,"threads_started":5,"wal-append.queue_time_us":419081,"wal-append.run_cpu_time_us":28510,"wal-append.run_wall_time_us":1070834}]]}
I20260709 12:26:35.858763 22702 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:35.854172 23585 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.836588 23636 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.858407 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:35.881354 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.882309 22143 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:35.857071 23614 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:35.862145 23650 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.801234 23629 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.860786 23559 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.850332 23402 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.796631 23635 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.863992 23631 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.834599 23645 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.968175 23647 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.840436 23643 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.898361 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:35.967913 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.859201 23625 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.799049 23641 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:35.890506 23657 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.974540 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.990126 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.881153 23616 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:35.989341 23657 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.968000 23648 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:35.991114 23622 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.890367 23655 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.967820 23623 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.860734 23644 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:36.026490 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 98985.2us
I20260709 12:26:35.999442 22735 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:36.019616 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.021159 23610 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.022487 23646 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.023697 23640 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.029085 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:35.913765 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:35.891667 23638 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.934911 23637 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:35.931666 23628 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:35.892040 23585 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.037544 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.024384 23534 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.038872 23633 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.039048 23654 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:35.455425 23578 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:35.888949 23614 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.039639 23651 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.040236 23626 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.009263 23631 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.002518 23634 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.009682 23657 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.044625 23648 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:36.044184 23643 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.038442 23402 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.043370 22144 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:36.046449 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.047106 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:36.050752 23653 log.cc:927] Time spent T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:26:35.997844 23656 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.038918 22215 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:36.057847 23660 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.057835 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.047264 23612 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.043233 22702 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:36.054858 23618 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.055964 23559 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.056195 23637 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:35.993001 23650 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.049803 23610 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.033880 23655 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.053305 23578 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.025270 23647 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.258862 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.126107 22220 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:36.247825 21965 catalog_manager.cc:5697] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.072588 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.200436 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.272280 22143 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:36.256377 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.153368 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:36.272330 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 229170us
I20260709 12:26:36.161489 22733 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:36.274160 22702 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:36.173309 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.226027 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.292116 22702 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:36.252345 23564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.005s	sys 0.012s
I20260709 12:26:36.222168 22070 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:36.061944 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.317131 22065 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.141110 23635 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.203135 23616 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.168375 23644 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.263518 23632 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.173353 23641 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.314942 22139 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:36.204289 23585 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.174234 23614 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.281659 23615 raft_consensus.cc:2804] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.140657 23652 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.059171 23631 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.140290 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.408354 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.140866 23659 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.063441 23648 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.222199 23617 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:26:36.357115 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.152681 23629 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.175316 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.174854 23625 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.356591 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.202487 23570 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.244227 23657 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.404964 22731 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:36.317452 22730 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:36.314934 23612 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:36.315886 23564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.006s	sys 0.018s
I20260709 12:26:36.320506 22184 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:36.351881 23647 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.409509 23615 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.241245 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.414248 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.356048 23633 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.414276 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.355954 23611 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.276541 23637 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.354645 23643 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.165066 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.339443 23655 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.343322 23650 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.296350 23656 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.420706 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.058825 23654 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.481029 22143 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
W20260709 12:26:36.483778 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 163331us
I20260709 12:26:36.321425 23623 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.483163 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.118245 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.481657 22220 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:36.063083 23651 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.488039 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.545660 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.545753 23554 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.547082 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.548334 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.489192 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.498013 22144 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:36.549163 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.549543 22138 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:36.452184 23632 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:36.550077 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.550704 22144 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:36.550591 23632 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.483408 23612 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.475358 23661 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.511380 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.496018 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.504408 23633 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.476763 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.496714 23615 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.514822 22064 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:36.515727 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.540416 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:36.541432 22758 debug-util.cc:398] Leaking SignalData structure 0x7b08002ddf80 after lost signal to thread 20876
I20260709 12:26:36.608940 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:36.313481 23660 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.578624 22184 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:36.608098 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.509554 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.670347 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.670480 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.671075 22734 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:36.516304 23611 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.672183 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.609566 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.551324 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.673781 23611 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.674168 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.607270 22035 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:36.675575 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 68430.3us
I20260709 12:26:36.578954 23612 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.680773 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.681219 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.681491 22071 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
W20260709 12:26:36.681886 22758 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf4a0 after lost signal to thread 22002
I20260709 12:26:36.682385 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:36.683200 22758 debug-util.cc:398] Leaking SignalData structure 0x7b08000de7a0 after lost signal to thread 22095
W20260709 12:26:36.683511 22758 debug-util.cc:398] Leaking SignalData structure 0x7b080030c800 after lost signal to thread 22096
I20260709 12:26:36.683768 23554 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:36.684557 22758 debug-util.cc:398] Leaking SignalData structure 0x7b0800365e20 after lost signal to thread 22170
I20260709 12:26:36.675519 22212 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:36.500059 23664 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.519455 23656 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.550712 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.692185 22736 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:36.424185 23652 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.664618 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.665118 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.513484 23643 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:36.667843 22220 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
W20260709 12:26:36.667853 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 89298.7us
I20260709 12:26:36.668835 23618 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.461194 23659 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:36.687532 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 109704us
W20260709 12:26:36.685705 22758 debug-util.cc:398] Leaking SignalData structure 0x7b080022b480 after lost signal to thread 22244
I20260709 12:26:36.552152 23610 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:36.664299 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 162833us
I20260709 12:26:36.694238 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.699173 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:36.676147 22035 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:36.708014 22035 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:36.688786 23627 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.702297 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:36.685904 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.704180 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.690245 23620 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.691592 23664 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:36.704619 23660 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.675154 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.690415 23578 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.717461 22736 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:36.689303 23637 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.704514 23570 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:36.754681 22701 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:36.584636 23661 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:36.753389 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 50354.8us
I20260709 12:26:36.699761 23644 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.712906 23627 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:36.700253 23618 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:36.764711 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:36.761730 23615 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:36.789984 22736 raft_consensus.cc:2955] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:36.717793 23648 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.742990 23610 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.771500 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.741256 23614 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.772914 22731 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
W20260709 12:26:36.795265 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 96140.1us
I20260709 12:26:36.778185 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.778986 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.779572 23644 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:36.782401 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.784834 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.788111 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.792161 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.753854 23664 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.788932 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48062 (request call id 184) took 1143 ms. Trace:
I20260709 12:26:36.770275 23620 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.719622 23666 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.805557 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.810842 22733 raft_consensus.cc:1240] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.771852 23570 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.802397 22067 rpcz_store.cc:276] 0709 12:26:35.645528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.645702 (+   174us) service_pool.cc:224] Handling call
0709 12:26:36.788747 (+1143045us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54003e71d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:36.788847 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38079360}
I20260709 12:26:36.773682 23627 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.811673 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.792610 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.829305 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.829944 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.831420 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.794826 23610 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:36.838228 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.773736 23618 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.823386 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:36.840404 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.874846 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.884864 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.885236 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.885514 22138 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:36.885826 22144 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:36.886551 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.886618 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.886713 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.887245 22144 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:36.887203 22138 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:36.888042 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.888412 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 867) took 1027 ms. Trace:
I20260709 12:26:36.888803 22146 rpcz_store.cc:276] 0709 12:26:35.861120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.861267 (+   147us) service_pool.cc:224] Handling call
0709 12:26:35.861512 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.026965 (+165453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.026992 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.027027 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:36.027054 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.888176 (+861122us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400276854. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:36.888220 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.888329 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380129024}
I20260709 12:26:36.889477 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.890532 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.891040 22063 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:36.879729 23615 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.891701 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.892179 23632 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.893792 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:36.894155 23668 log.cc:927] Time spent T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:26:36.795486 23614 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:36.894744 22702 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:36.896335 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.896679 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.896934 22216 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:36.897284 22219 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:36.894950 23614 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.878518 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:36.880630 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.045s	sys 0.037s
I20260709 12:26:36.883580 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.805353 23657 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.877759 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:36.897887 23636 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.882963 23654 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.901913 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.838824 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.911751 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.912075 22064 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:36.902899 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.902820 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:36.882287 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 58991.3us
I20260709 12:26:36.828280 23570 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:36.807868 23666 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:36.906277 22067 raft_consensus.cc:2955] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:36.840862 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:36.804397 23644 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.910343 22066 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:36.875950 23610 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.807667 22062 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:36.805100 23620 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:36.916585 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 75822.6us
I20260709 12:26:36.932798 22111 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:36.934275 22111 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:36.900961 23641 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.937048 22737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 377) took 1390 ms. Trace:
I20260709 12:26:36.922029 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.911049 23619 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:36.924546 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:36.826038 23660 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:26:36.935353 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.924846 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 239) took 1039 ms. Trace:
I20260709 12:26:36.945602 22216 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:36.945503 22141 rpcz_store.cc:276] 0709 12:26:35.885231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.972947 (+ 87716us) service_pool.cc:224] Handling call
0709 12:26:35.973272 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.992508 (+ 19236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.992536 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:35.992572 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:35.992597 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.924644 (+932047us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54001419d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:36.924682 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.924789 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43779968}
I20260709 12:26:36.909950 23667 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.955188 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.939779 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.891487 23554 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:26:36.937420 22737 rpcz_store.cc:276] 0709 12:26:35.532503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.533017 (+   514us) service_pool.cc:224] Handling call
0709 12:26:35.538443 (+  5426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.503722 (+965279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.503768 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.503826 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:36.503871 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.923037 (+419166us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540070f154. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:36.923074 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.923179 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219006208}
I20260709 12:26:36.947762 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.948905 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.959851 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.937580 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 866) took 1071 ms. Trace:
I20260709 12:26:36.925570 23654 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.920701 23570 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.942346 23317 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.965309 23661 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.936394 23633 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:36.967366 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.899554 23645 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.962460 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.960448 22142 rpcz_store.cc:276] 0709 12:26:35.853710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.853825 (+   115us) service_pool.cc:224] Handling call
0709 12:26:35.854887 (+  1062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.989422 (+134535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.989456 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:35.989502 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:35.989531 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.925237 (+935706us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002b6bd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:36.925277 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.925382 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308888448}
I20260709 12:26:36.960037 22213 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:36.938460 23620 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.969766 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:36.973694 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 139791us
I20260709 12:26:36.959391 23667 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:36.925527 23651 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:36.922466 23666 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.949810 23579 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.950451 23619 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:36.936225 23641 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:36.960011 23628 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.971660 23647 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:36.977553 23667 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.984850 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1490) took 1178 ms. Trace:
I20260709 12:26:36.988412 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:36.985036 23659 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:36.983405 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:36.970993 23578 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:26:36.986055 23619 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.975282 23637 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:36.988999 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:36.988232 23641 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:37.018167 22702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.67:39245 timed out after 1.537s (SENT) [suppressed 1 similar messages]
I20260709 12:26:37.015874 23647 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.025084 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:37.028824 22036 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:37.019165 22184 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:37.031383 22184 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:37.022274 23645 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.033842 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.037588 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.023233 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.030652 23635 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.041787 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.044016 23673 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.022394 23652 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.041330 23645 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:37.044220 23669 log.cc:927] Time spent T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:26:37.028379 22212 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:37.034924 23611 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.051036 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:37.051414 23672 log.cc:927] Time spent T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:26:37.030957 23612 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.053372 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.054215 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59932 (request call id 872) took 1082 ms. Trace:
I20260709 12:26:37.054229 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.055512 22735 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.036631 23643 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.025569 23637 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.064213 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.066016 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.067483 21967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40564 (request call id 198) took 3508 ms. Trace:
I20260709 12:26:37.034305 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:37.047569 22065 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:37.054703 22137 rpcz_store.cc:276] 0709 12:26:35.972285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.053047 (+1080762us) service_pool.cc:224] Handling call
0709 12:26:37.054152 (+  1105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:37.058357 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.042760 23635 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.076644 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.074282 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.076428 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.077520 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.077746 22702 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:37.014957 22211 rpcz_store.cc:276] 0709 12:26:35.806920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.807122 (+   202us) service_pool.cc:224] Handling call
0709 12:26:35.850892 (+ 43770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.049136 (+198244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.051752 (+  2616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.053143 (+  1391us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:36.056416 (+  3273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.984610 (+928194us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400313654. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:36.984649 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.984765 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438064384}
I20260709 12:26:37.079306 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.044924 22215 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:37.080389 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.080593 22702 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:37.088997 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:37.061514 23628 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:37.090492 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.077243 23643 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.091161 22217 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:37.092377 22702 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:37.092487 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.097378 23628 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.067848 21967 rpcz_store.cc:276] 0709 12:26:33.558869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.559105 (+   236us) service_pool.cc:224] Handling call
0709 12:26:33.572824 (+ 13719us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b5400040790. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c50b2 00007f1e2983e759 00007f1e297d6a76 00007f1e297a7d58 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc
0709 12:26:37.067422 (+3494598us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5218,"reported_tablets":1,"spinlock_wait_cycles":12679040}
I20260709 12:26:37.098501 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:37.081499 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.078150 22220 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:37.082865 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.049539 23652 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.047463 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.076967 23635 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.057313 23611 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.094074 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.095660 23627 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.073827 22184 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:37.100597 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.105079 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.112495 22702 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:37.087231 23638 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.122282 23647 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.123052 23628 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.101774 23652 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:37.098027 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.119863 23644 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.148340 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:37.137576 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 64584.9us
I20260709 12:26:37.021585 23674 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:26:37.144233 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.099948 23629 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.099756 23643 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.125872 23634 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.149412 23644 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.136147 23611 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.161106 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.101920 23623 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.166755 22070 raft_consensus.cc:2393] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:37.144115 23650 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.138578 23638 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.167687 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.150851 23652 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.142117 23662 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.176599 22736 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:37.152766 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.146258 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.182127 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.183053 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.168865 23634 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:37.160116 23643 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.164409 23629 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.186537 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54728 (request call id 1759) took 1004 ms. Trace:
W20260709 12:26:37.177649 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 50618.6us
I20260709 12:26:37.187103 22069 rpcz_store.cc:276] 0709 12:26:36.181813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.181968 (+   155us) service_pool.cc:224] Handling call
0709 12:26:36.198179 (+ 16211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.735606 (+537427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.735647 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.735699 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:36.735751 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.186212 (+450461us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540026f554. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:37.186268 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.186448 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235485056}
I20260709 12:26:37.176221 23650 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.194289 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.194438 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.177989 23638 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.192056 22217 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:37.202261 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1782) took 1002 ms. Trace:
I20260709 12:26:37.203064 22185 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.202847 22214 rpcz_store.cc:276] 0709 12:26:36.199937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.201124 (+1001187us) service_pool.cc:224] Handling call
0709 12:26:37.201585 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.201821 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:37.201862 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.201919 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:37.201967 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.202047 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.202185 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:37.204224 22185 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.205058 22185 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.205749 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1784) took 1005 ms. Trace:
I20260709 12:26:37.206502 22214 rpcz_store.cc:276] 0709 12:26:36.200476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.204343 (+1003867us) service_pool.cc:224] Handling call
0709 12:26:37.204958 (+   615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.205202 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:37.205243 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.205302 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:37.205350 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.205440 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.205674 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:37.209131 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 180358us
I20260709 12:26:37.210183 22214 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:37.187187 23634 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.211798 22185 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.186419 23629 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.210819 22036 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:37.216188 22036 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:37.222488 22036 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.187342 22212 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:37.180239 23662 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:37.226895 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1783) took 1026 ms. Trace:
I20260709 12:26:37.225461 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.210021 23554 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.199571 23650 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.193526 23631 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.233340 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.212728 23670 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.210861 23644 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.238721 23570 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.240044 23661 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:37.241523 23683 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.247042 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.224004 23628 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.219889 23633 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.253787 22036 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:37.253517 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.254527 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.276345 22736 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:37.231835 22220 rpcz_store.cc:276] 0709 12:26:36.200190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.201597 (+1001407us) service_pool.cc:224] Handling call
0709 12:26:37.226260 (+ 24663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.226490 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:37.226527 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.226586 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:37.226631 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.226702 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.226826 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:37.276640 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.233336 23659 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.233724 23612 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.233608 23662 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.267822 23620 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:37.274240 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 255332us
I20260709 12:26:37.229213 23673 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.257773 23637 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.286134 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:37.286924 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.288162 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.274210 23628 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.280628 23647 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.323673 22701 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.289893 22220 raft_consensus.cc:2955] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:37.328119 22701 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.324390 23675 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.324985 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:37.293762 22734 raft_consensus.cc:1240] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.330390 22701 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.275422 23661 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.336509 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.339288 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.283402 23645 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.285445 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.326771 23628 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.342080 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1503) took 1164 ms. Trace:
I20260709 12:26:37.333817 23636 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.344646 23673 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.331346 23623 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.327188 23647 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:37.338210 23657 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.279601 23664 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.330173 23627 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.337028 23675 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.346994 22219 rpcz_store.cc:276] 0709 12:26:36.177376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.897823 (+720447us) service_pool.cc:224] Handling call
0709 12:26:37.339145 (+441322us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:37.342034 (+  2889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10921728}
I20260709 12:26:37.345206 23637 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:37.333900 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:37.340632 23677 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:26:37.353758 22218 raft_consensus.cc:1240] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.354866 23673 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.333071 23670 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:37.297207 23619 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.348240 23636 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.374619 23637 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:37.386755 23680 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:26:37.358243 23647 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:37.395929 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 61347.4us
I20260709 12:26:37.358767 23657 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.367784 23675 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.398979 23671 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:37.399307 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:37.413830 23656 consensus_meta.cc:287] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.712s	user 0.005s	sys 0.007s
I20260709 12:26:37.399406 23650 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.401530 23637 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.402045 23614 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.348150 23667 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.360327 23679 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.405367 23657 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.405781 23638 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.406773 23652 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.408250 23620 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.403054 23636 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.409768 23570 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:37.413067 23618 consensus_meta.cc:287] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
I20260709 12:26:37.418658 22701 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:37.419713 22736 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:37.417593 23656 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:37.399437 22758 debug-util.cc:398] Leaking SignalData structure 0x7b080031afc0 after lost signal to thread 22761
I20260709 12:26:37.425946 22066 raft_consensus.cc:1240] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.372113 23666 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.438264 23673 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.440279 22737 raft_consensus.cc:1240] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.440757 22138 raft_consensus.cc:1240] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.459323 23625 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:37.457705 22735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34992 (request call id 388) took 1039 ms. Trace:
I20260709 12:26:37.457696 22733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34992 (request call id 386) took 1055 ms. Trace:
I20260709 12:26:37.464448 22111 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:37.443847 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.462113 22735 rpcz_store.cc:276] 0709 12:26:36.417834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.418012 (+   178us) service_pool.cc:224] Handling call
0709 12:26:36.480712 (+ 62700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.056004 (+575292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.455878 (+399874us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b540053b6d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:37.457505 (+  1627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321359616}
I20260709 12:26:37.462890 22733 rpcz_store.cc:276] 0709 12:26:36.402820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.402952 (+   132us) service_pool.cc:224] Handling call
0709 12:26:36.403290 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.825019 (+421729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.457435 (+632416us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54005352d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:37.457632 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936696064}
I20260709 12:26:37.444346 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.451103 22731 raft_consensus.cc:1240] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.465870 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:37.473215 21965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48106 (request call id 273) took 1267 ms. Trace:
I20260709 12:26:37.475016 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.475693 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:37.476042 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.473615 21965 rpcz_store.cc:276] 0709 12:26:36.184809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.185008 (+   199us) service_pool.cc:224] Handling call
0709 12:26:37.452210 (+1267202us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:36.286428 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:36.287444 (+  1016us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:36.287495 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:26:36.287522 (+    27us) tablet.cc:662] Decoding operations
0709 12:26:36.287975 (+   453us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:36.288074 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:36.288118 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:36.288406 (+   288us) tablet.cc:701] Row locks acquired
0709 12:26:36.288435 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:26:36.288632 (+   197us) write_op.cc:270] Start()
0709 12:26:36.288793 (+   161us) write_op.cc:276] Timestamp: P: 1783599996288569 usec, L: 0
0709 12:26:36.288824 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:26:36.502364 (+213540us) log.cc:844] Serialized 538 byte log entry
0709 12:26:36.896093 (+393729us) op_driver.cc:464] REPLICATION: finished
0709 12:26:37.060688 (+164595us) write_op.cc:301] APPLY: starting
0709 12:26:37.060770 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:37.060863 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:37.060970 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:37.061210 (+   240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:37.061352 (+   142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:37.061400 (+    48us) write_op.cc:312] APPLY: finished
0709 12:26:37.121791 (+ 60391us) log.cc:844] Serialized 23 byte log entry
0709 12:26:37.121996 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.122079 (+    83us) write_op.cc:454] Released schema lock
0709 12:26:37.122122 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:37.122461 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.122508 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":164358,"apply.run_cpu_time_us":2038,"apply.run_wall_time_us":61763,"num_ops":1,"prepare.queue_time_us":8915,"prepare.run_cpu_time_us":28556,"prepare.run_wall_time_us":428409,"raft.queue_time_us":718,"raft.run_cpu_time_us":43208,"raft.run_wall_time_us":80017,"replication_time_us":607108,"thread_start_us":270260,"threads_started":3,"wal-append.queue_time_us":257208}]]}
I20260709 12:26:37.480705 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.484333 22036 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.434602 23679 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:37.487918 22063 raft_consensus.cc:1240] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.489248 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:37.488884 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.489311 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.461102 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1499) took 1285 ms. Trace:
I20260709 12:26:37.488687 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.491279 22215 rpcz_store.cc:276] 0709 12:26:36.175933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.093429 (+917496us) service_pool.cc:224] Handling call
0709 12:26:37.109705 (+ 16276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.146121 (+ 36416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:37.151335 (+  5214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.160036 (+  8701us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:37.168189 (+  8153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.173316 (+  5127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.460908 (+287592us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b54000352d0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:37.461032 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14040320}
I20260709 12:26:37.492570 23659 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:37.492775 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:37.493041 23659 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.493276 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.426050 23670 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.463395 23645 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.460378 23638 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.452423 23650 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.482468 23579 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.481971 23654 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:37.529776 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44521.3us
I20260709 12:26:37.496958 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.494073 23663 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.536147 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.487233 23637 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.515766 23534 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:37.550031 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 69388.3us
I20260709 12:26:37.550503 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:37.551147 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:37.494645 23664 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.430245 23671 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.453112 23629 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.500715 23616 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.486232 23625 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.494486 23679 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.551985 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:37.578423 22111 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.553493 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:37.561339 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 54740.8us
I20260709 12:26:37.580451 22036 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.562516 23686 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.452839 23618 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.507241 22729 raft_consensus.cc:1240] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.572897 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:37.585258 22218 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.589612 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.590456 22139 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:37.550400 23534 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.575274 22730 raft_consensus.cc:1240] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.527113 23579 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.563803 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:37.563345 23661 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.592136 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:37.604012 22139 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.592537 22066 raft_consensus.cc:1240] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.592475 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.593365 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.605791 22142 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:37.583019 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:37.607144 22111 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.596153 23317 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.617185 22219 raft_consensus.cc:1240] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.617884 22214 raft_consensus.cc:1240] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.597762 23654 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.583977 23686 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.599712 23534 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.614408 23317 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.622913 23578 consensus_queue.cc:1059] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:37.623055 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.632176 23662 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.610028 22211 raft_consensus.cc:1240] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.612037 23579 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.640448 23317 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.583287 23663 consensus_queue.cc:1059] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:26:37.620857 22728 raft_consensus.cc:1240] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.649025 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:37.634263 23619 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.612293 23627 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.634045 23686 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.640605 23655 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:37.654372 23654 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.621598 23635 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.653626 23614 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.684965 23666 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.689028 23670 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.690557 23625 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.690410 23643 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.660161 23667 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.661677 23652 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.700290 22214 raft_consensus.cc:1240] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.701241 22139 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:37.654906 23634 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.708178 22218 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:37.711453 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:37.706331 22702 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.672614 23611 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.687912 23655 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.693457 23656 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.699465 23618 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.728240 22218 raft_consensus.cc:1240] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.729328 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:37.730325 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:37.731513 23629 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.732041 23671 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:37.709084 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1497) took 1577 ms. Trace:
W20260709 12:26:37.719902 23641 consensus_meta.cc:287] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.692s	user 0.006s	sys 0.005s
I20260709 12:26:37.737674 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:37.745677 22702 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.721012 23655 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:37.744177 23629 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.702435 23636 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.752408 23636 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.754081 22729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34992 (request call id 390) took 1269 ms. Trace:
I20260709 12:26:37.754256 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:37.754525 22729 rpcz_store.cc:276] 0709 12:26:36.484865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.792475 (+307610us) service_pool.cc:224] Handling call
0709 12:26:36.901302 (+108827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.598021 (+696719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.753807 (+155786us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b540069fd54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:37.754024 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318581632}
W20260709 12:26:37.757050 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 391523us
W20260709 12:26:37.772488 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 265763us
I20260709 12:26:37.780277 22185 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:37.792906 22185 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.795624 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:37.802028 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 212346us
I20260709 12:26:37.803157 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.810807 22035 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.812354 22035 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:37.747879 23641 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.816636 21963 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48096 (request call id 301) took 4215 ms. Trace:
I20260709 12:26:37.822736 22035 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:37.817968 22736 raft_consensus.cc:1240] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:37.818095 23683 raft_consensus.cc:3055] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:37.828332 23683 raft_consensus.cc:740] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:37.828455 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:37.821050 23627 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.819478 23684 raft_consensus.cc:3055] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:37.820116 23643 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.791929 23644 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:37.790992 23636 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.823248 21963 rpcz_store.cc:276] 0709 12:26:33.592748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.592870 (+   122us) service_pool.cc:224] Handling call
0709 12:26:37.808141 (+4215271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164460,"reported_tablets":1}
I20260709 12:26:37.810683 23631 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.829553 23627 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.917717 23627 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.829401 23683 consensus_queue.cc:260] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.911839 23617 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:37.912053 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:37.742106 22211 rpcz_store.cc:276] 0709 12:26:36.125408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.101914 (+976506us) service_pool.cc:224] Handling call
0709 12:26:37.563340 (+461426us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:37.583679 (+ 20339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.669454 (+ 85775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.702646 (+ 33192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11188096}
I20260709 12:26:37.793879 23674 consensus_queue.cc:1059] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:26:37.825064 23663 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.951071 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1543) took 1721 ms. Trace:
I20260709 12:26:37.951210 23635 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:37.847193 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:37.846283 23684 raft_consensus.cc:740] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:37.953960 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1797) took 1477 ms. Trace:
W20260709 12:26:37.955519 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 348430us
I20260709 12:26:37.866999 23636 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.932404 23660 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.971850 22220 rpcz_store.cc:276] 0709 12:26:36.476866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.277222 (+800356us) service_pool.cc:224] Handling call
0709 12:26:37.289587 (+ 12365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.289780 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:26:37.522077 (+232297us) log.cc:844] Serialized 14 byte log entry
0709 12:26:37.953653 (+431576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.953702 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:37.953739 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.953814 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.953907 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31967,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":3294,"thread_start_us":431175,"threads_started":2,"wal-append.queue_time_us":256480}
I20260709 12:26:37.931376 23656 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.955363 23671 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.951519 23634 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.977375 23662 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:37.969251 23683 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:37.977691 23610 consensus_meta.cc:287] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 1.035s	user 0.004s	sys 0.009s
I20260709 12:26:37.975049 23636 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.950389 23631 consensus_queue.cc:1059] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:26:37.935422 23644 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:37.975745 23660 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:37.951646 22138 rpcz_store.cc:276] 0709 12:26:36.229873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.894153 (+664280us) service_pool.cc:224] Handling call
0709 12:26:36.894591 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.457100 (+562509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.949123 (+492023us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400188b54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:37.950991 (+  1868us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252138240}
I20260709 12:26:37.981220 23656 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.017102 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:37.998083 23687 consensus_queue.cc:1059] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:26:37.824218 22035 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:37.994840 23616 consensus_queue.cc:1059] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:26:38.014159 23660 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:38.034132 23647 consensus_meta.cc:287] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
W20260709 12:26:38.048919 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 224780us
I20260709 12:26:38.049738 23692 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:38.050516 22035 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:38.007022 23610 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:38.050545 23692 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.063216 23692 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.064594 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:38.065618 22729 raft_consensus.cc:2393] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:38.069044 23631 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:38.069602 23631 raft_consensus.cc:697] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.070480 23631 consensus_queue.cc:237] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:37.994782 23579 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.064801 23692 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.049041 23614 consensus_queue.cc:1059] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:26:38.077010 22062 raft_consensus.cc:1240] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:26:38.058708 23663 raft_consensus.cc:3055] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.046427 23625 consensus_queue.cc:1059] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:26:38.053125 23647 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.082556 23663 raft_consensus.cc:740] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:38.093072 23657 consensus_meta.cc:287] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.001s
I20260709 12:26:38.082965 23641 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.058490 23684 consensus_queue.cc:260] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.091732 23655 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.098773 23610 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.099777 23534 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.100953 23655 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.101845 23534 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.106491 23579 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.112913 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:38.113262 23625 raft_consensus.cc:3055] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.094395 23663 consensus_queue.cc:260] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:38.126255 23628 consensus_meta.cc:287] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.004s
I20260709 12:26:38.126797 23628 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.127305 22731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 385) took 1063 ms. Trace:
I20260709 12:26:38.127724 22731 rpcz_store.cc:276] 0709 12:26:37.064141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.065128 (+   987us) service_pool.cc:224] Handling call
0709 12:26:37.446192 (+381064us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800034598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:37.446388 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.470905 (+ 24517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.127067 (+656162us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b540046b4d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:38.127248 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14470784}
I20260709 12:26:38.128257 22069 raft_consensus.cc:2393] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:38.114949 23655 raft_consensus.cc:3055] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.115293 23625 raft_consensus.cc:740] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:38.123520 23684 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.094430 23657 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:38.134054 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 147029us
I20260709 12:26:38.130242 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:38.134732 23655 raft_consensus.cc:740] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:38.137521 23663 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.135527 22728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 388) took 1070 ms. Trace:
I20260709 12:26:38.154621 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:38.152058 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:38.142840 23644 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.131235 23683 consensus_queue.cc:1059] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:26:38.164448 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:38.148458 22729 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.171591 23683 raft_consensus.cc:3055] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.172619 23655 consensus_queue.cc:260] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.173367 22063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 198) took 1261 ms. Trace:
I20260709 12:26:38.175846 22063 rpcz_store.cc:276] 0709 12:26:36.902252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.914512 (+ 12260us) service_pool.cc:224] Handling call
0709 12:26:36.914767 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.488304 (+573537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.163324 (+675020us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400283054. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:38.163581 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317729152}
I20260709 12:26:38.176792 22142 raft_consensus.cc:1240] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:38.177388 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.156620 22728 rpcz_store.cc:276] 0709 12:26:37.064924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.177699 (+112775us) service_pool.cc:224] Handling call
0709 12:26:37.213530 (+ 35831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.680421 (+466891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.105081 (+424660us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400130bd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:38.133721 (+ 28640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878710016}
I20260709 12:26:38.184334 23534 consensus_queue.cc:1059] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:38.185506 23534 raft_consensus.cc:3055] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.185873 23534 raft_consensus.cc:740] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.186689 23534 consensus_queue.cc:260] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.187937 23534 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.163892 23656 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.192319 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:38.148658 23627 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.193216 23625 consensus_queue.cc:260] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:38.195303 23659 consensus_meta.cc:287] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.004s
W20260709 12:26:38.198648 23317 consensus_meta.cc:287] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.002s
I20260709 12:26:38.175813 23683 raft_consensus.cc:740] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:38.210052 22034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.015s	sys 0.027s
I20260709 12:26:38.199522 22138 raft_consensus.cc:1240] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:38.223382 22034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.015s	sys 0.027s
I20260709 12:26:38.226323 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.226971 22070 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.225044 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:38.230708 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:38.231550 22217 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.013s	sys 0.021s
I20260709 12:26:38.238466 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.239187 22066 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.239488 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:38.239918 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:38.207980 23655 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:38.236871 22217 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.014s	sys 0.021s
W20260709 12:26:38.221180 23686 consensus_meta.cc:287] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.526s	user 0.003s	sys 0.011s
I20260709 12:26:38.240931 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.241447 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.242508 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.220615 23625 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.244699 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:38.245083 22184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.027s	sys 0.086s
I20260709 12:26:38.248164 22067 raft_consensus.cc:2393] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:38.231366 23647 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:38.254802 22184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.027s	sys 0.086s
W20260709 12:26:38.255141 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 620238us
W20260709 12:26:38.255901 22735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.013s	sys 0.030s
W20260709 12:26:38.256292 22735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.014s	sys 0.031s
I20260709 12:26:38.250104 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1781) took 2050 ms. Trace:
I20260709 12:26:38.258183 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.258396 22217 rpcz_store.cc:276] 0709 12:26:36.199687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.178868 (+979181us) service_pool.cc:224] Handling call
0709 12:26:37.191758 (+ 12890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.191945 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:37.363688 (+171743us) log.cc:844] Serialized 14 byte log entry
0709 12:26:38.249668 (+885980us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:38.249719 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:38.249758 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.249928 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:38.250044 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1816,"thread_start_us":877303,"threads_started":1}
I20260709 12:26:38.211684 23317 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.264056 22066 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:38.208654 23659 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.253494 23683 consensus_queue.cc:260] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.248744 23686 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.275836 23683 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.271066 22219 raft_consensus.cc:1240] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:38.250273 22070 raft_consensus.cc:2468] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:38.271024 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:38.278735 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.272537 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.249902 23618 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:38.281406 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.282083 22213 raft_consensus.cc:1240] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:38.284143 22143 raft_consensus.cc:2393] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
W20260709 12:26:38.283804 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 490943us
I20260709 12:26:38.276932 23686 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.290827 22185 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.289588 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.289644 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.294728 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:38.294696 22185 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.296255 22185 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.277112 23659 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.298440 22185 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.298946 23699 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.290037 23684 consensus_queue.cc:1059] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:26:38.306133 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.307811 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.303478 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.309441 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.310463 22063 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:38.281271 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.299780 22702 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.290728 23657 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.335393 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:38.333222 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 282973us
I20260709 12:26:38.344954 23684 raft_consensus.cc:3055] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.344871 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.364248 22035 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:38.333668 23647 consensus_queue.cc:1059] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:38.349519 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:38.299937 23675 consensus_meta.cc:287] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.004s
I20260709 12:26:38.295253 23620 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.353206 23579 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:38.354266 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 55905.9us
I20260709 12:26:38.354940 23699 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.285038 23700 consensus_queue.cc:1059] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:26:38.341624 23623 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.271857 23641 consensus_queue.cc:1059] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:26:38.335381 22111 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:38.381137 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 46995.6us
I20260709 12:26:38.382948 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:38.383536 23636 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.384263 22111 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:38.385136 23687 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.298916 23649 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.317262 23656 consensus_queue.cc:1059] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:26:38.289294 23663 consensus_queue.cc:1059] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:26:38.376230 22035 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:38.378878 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.386567 22064 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:38.388100 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.377981 23675 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.390074 23704 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:38.406749 22214 raft_consensus.cc:1240] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:38.407023 22185 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.407652 23634 raft_consensus.cc:3055] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:38.408775 23644 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.409206 23706 consensus_queue.cc:1059] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.342402 23686 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:26:38.410941 23705 raft_consensus.cc:3055] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.367451 23692 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.401743 23579 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.365370 23684 raft_consensus.cc:740] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.385633 23636 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.450909 22216 raft_consensus.cc:2393] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:38.451205 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.438288 23704 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:38.452752 23707 raft_consensus.cc:3055] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:38.443930 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.445785 22141 raft_consensus.cc:1240] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:38.461686 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 77483.8us
I20260709 12:26:38.446076 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:38.463858 22111 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:38.447158 23679 consensus_meta.cc:287] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.847s	user 0.006s	sys 0.007s
I20260709 12:26:38.449023 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.452862 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.453519 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:38.460638 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:38.443794 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 104072us
I20260709 12:26:38.473456 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.474261 22140 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.447448 23705 raft_consensus.cc:740] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.482091 22732 raft_consensus.cc:1240] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:38.483507 22732 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:38.480463 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.476132 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.486034 22702 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:38.437826 23700 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.454358 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:38.455092 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:38.456796 22737 raft_consensus.cc:1240] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:38.458412 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.473387 23687 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:38.441300 23634 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:38.503237 23634 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.504521 23634 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.465010 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:38.506556 22111 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.506886 23703 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:38.507421 23703 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:38.507817 23703 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.446148 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:38.443461 23620 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.452785 23704 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.487528 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.456140 23663 raft_consensus.cc:3055] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.487534 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.489578 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.487010 22732 raft_consensus.cc:1240] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:38.521772 23616 consensus_queue.cc:1059] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:38.493309 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.460443 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.461912 23707 raft_consensus.cc:740] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.488483 22729 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
W20260709 12:26:38.441376 23698 log.cc:927] Time spent T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:26:38.501601 23687 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:38.476191 23317 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.508565 23706 consensus_queue.cc:1059] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:26:38.497107 23656 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:38.524480 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:38.525997 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:38.474570 23679 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.538010 23705 consensus_queue.cc:260] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.490484 23658 consensus_queue.cc:1059] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:26:38.543766 23705 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.545892 23675 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.546968 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:38.516888 23684 consensus_queue.cc:260] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.523211 23663 raft_consensus.cc:740] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.551594 23663 consensus_queue.cc:260] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.528664 22137 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:38.519518 23696 consensus_queue.cc:1059] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:26:38.530157 23644 consensus_queue.cc:1059] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:38.498937 22702 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:38.533488 22735 raft_consensus.cc:1240] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:26:38.555418 23702 raft_consensus.cc:3055] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.555871 23702 raft_consensus.cc:740] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:38.556298 23645 raft_consensus.cc:2804] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:38.498572 23641 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:38.509675 22733 raft_consensus.cc:2393] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:38.556836 23702 consensus_queue.cc:260] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.557614 23636 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.522959 23664 consensus_queue.cc:1059] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:26:38.558266 23641 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.556862 23645 raft_consensus.cc:697] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:38.537467 22065 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:38.520736 23710 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:38.566352 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 67493.9us
I20260709 12:26:38.542255 22737 raft_consensus.cc:2393] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:38.562552 22036 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:38.565553 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 57918.4us
I20260709 12:26:38.515595 23683 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:38.568019 22702 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:38.539705 23687 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.574558 22140 raft_consensus.cc:2410] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:26:38.576683 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:38.580479 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.580597 23694 raft_consensus.cc:3055] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.581038 23694 raft_consensus.cc:740] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.579396 23623 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:38.581959 23694 consensus_queue.cc:260] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.582576 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:38.575349 23683 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.583809 22035 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:38.583999 23659 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.584750 23659 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.570673 23656 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:38.582675 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.585901 22220 raft_consensus.cc:2393] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 2: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:38.571982 23692 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:38.588212 23623 raft_consensus.cc:697] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:38.561272 23645 consensus_queue.cc:237] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.560876 23707 consensus_queue.cc:260] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.552232 22732 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:38.609745 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:38.610677 22729 raft_consensus.cc:2393] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:38.612736 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.613601 22217 raft_consensus.cc:2393] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 2: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:38.614988 22184 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.596124 23661 raft_consensus.cc:3055] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:38.617393 23661 raft_consensus.cc:740] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:38.618475 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:38.619361 22729 raft_consensus.cc:2393] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:38.618664 23661 consensus_queue.cc:260] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.620687 23661 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.625084 22729 raft_consensus.cc:1240] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:38.628186 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.628962 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:38.629825 22733 raft_consensus.cc:2393] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:38.632232 22184 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.633610 23650 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.634821 23650 consensus_queue.cc:1059] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:38.635655 23617 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.636834 22184 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:38.643420 22070 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:38.645532 22702 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:38.597797 23660 consensus_meta.cc:287] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.541s	user 0.003s	sys 0.010s
I20260709 12:26:38.601504 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:38.603331 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.590746 23623 consensus_queue.cc:237] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.604712 22036 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:38.605492 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:38.600327 23656 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:38.647327 22703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.647183 23617 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.648597 22702 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:38.658561 22702 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:38.650638 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.650914 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 46283.9us
I20260709 12:26:38.652259 23709 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:38.655109 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.661763 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:38.663719 22702 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:38.666383 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.666391 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.665517 23629 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.669845 23712 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.670153 23629 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.601815 23692 raft_consensus.cc:697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.651582 23694 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.675460 23711 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.666066 23657 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:38.676030 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:38.588037 23688 consensus_queue.cc:1175] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "85f0d4cf04de40aa9e25849fb2380466" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:26:38.675216 23666 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.650902 23633 consensus_queue.cc:1059] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:26:38.679078 23673 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:38.679507 23637 consensus_queue.cc:1059] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.673674 23317 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:38.709926 23712 raft_consensus.cc:3055] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:38.710117 23317 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:38.710377 23712 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.710654 23317 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.678248 22111 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.684064 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:38.712028 22063 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:38.650169 23655 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:38.688627 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.654847 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:38.657146 23660 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:38.719316 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 133748us
W20260709 12:26:38.720600 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.720947 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:38.721932 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.722688 22146 raft_consensus.cc:2393] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:38.694829 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.697270 23683 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.697570 23692 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.698065 23620 raft_consensus.cc:3055] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:38.712524 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.727108 22111 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:38.728927 22729 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:38.718283 23710 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.729411 23686 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:38.729832 23686 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:38.730240 23686 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.725224 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.731287 22214 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.720954 22035 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:38.730705 23625 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.700039 23657 raft_consensus.cc:697] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:38.740513 22035 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:38.741514 23683 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.730911 23620 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:38.744810 23620 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.719621 23711 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.749977 22146 raft_consensus.cc:1240] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:38.725492 23655 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.750638 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:38.751268 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:38.752440 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:39.018311 23616 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.775492 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.019876 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.020390 22220 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.946846 23711 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:39.021651 23652 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:39.022259 23652 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:39.017771 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 289500us
I20260709 12:26:39.024492 23652 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:38.739007 23641 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.025409 23648 raft_consensus.cc:3055] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:39.025826 22702 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.026962 22220 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:39.027880 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.028393 22220 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.028590 23709 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:39.029512 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 278307us
I20260709 12:26:38.746799 23666 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.036406 22220 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:38.711211 23712 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.037901 23712 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.038895 23616 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.725972 23673 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.045977 23673 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.047716 23627 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.051496 22702 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:39.052577 23656 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.053104 23656 raft_consensus.cc:697] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:39.056195 23707 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.058739 22036 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:39.059507 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:38.953363 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 194724us
I20260709 12:26:38.954107 22214 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:39.061530 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.025831 23648 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.062999 22214 raft_consensus.cc:1240] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.063653 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:38.953917 23704 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.957463 23317 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.066372 23317 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.734544 23716 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.066785 23704 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:39.067909 23631 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:39.062990 23648 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.960814 23718 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:38.965050 22731 raft_consensus.cc:1240] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:39.069557 22035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.069300 23718 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.976352 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:39.071617 23718 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:39.071426 23671 consensus_queue.cc:1059] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:38.978133 23611 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:38.978436 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:39.072311 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:39.072535 22139 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:39.072651 22220 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:38.979018 23693 raft_consensus.cc:3055] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:38.979632 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:39.074333 23693 raft_consensus.cc:740] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.074688 22142 raft_consensus.cc:2393] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 2: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:39.075094 22138 raft_consensus.cc:1240] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.075227 23693 consensus_queue.cc:260] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.076380 23693 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.077484 23656 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.982249 23695 raft_consensus.cc:3055] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.078788 23695 raft_consensus.cc:740] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.079782 23695 consensus_queue.cc:260] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.080428 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.081522 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.082399 22211 raft_consensus.cc:2393] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:39.082589 23654 raft_consensus.cc:3055] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.082897 22702 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:39.085816 22214 raft_consensus.cc:1240] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:38.984587 22062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 987) took 1557 ms. Trace:
I20260709 12:26:39.086414 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:39.086694 22062 rpcz_store.cc:276] 0709 12:26:37.427265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.428683 (+  1418us) service_pool.cc:224] Handling call
0709 12:26:37.458825 (+ 30142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.077532 (+618707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.984136 (+906604us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54000c8d54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:38.984497 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419081472}
I20260709 12:26:39.087406 22138 raft_consensus.cc:2393] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:39.087721 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.088049 23709 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.088244 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.088928 23709 raft_consensus.cc:697] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:39.089116 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:38.808459 23657 consensus_queue.cc:237] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:38.987226 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:38.991056 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:39.094245 22138 raft_consensus.cc:1240] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.094340 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.094951 23663 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.992367 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 163) took 1576 ms. Trace:
I20260709 12:26:38.993074 22218 raft_consensus.cc:1240] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:26:38.998107 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.002722 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:39.004374 23697 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:39.007972 22736 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.012619 23679 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.013393 23649 raft_consensus.cc:3055] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.013665 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:39.014175 23658 raft_consensus.cc:3055] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.118266 23658 raft_consensus.cc:740] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.015141 23687 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:38.944785 23655 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:38.963232 23686 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.016332 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.121484 22070 raft_consensus.cc:2393] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:39.018224 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:38.747323 23620 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.059587 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.068557 23631 raft_consensus.cc:697] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:38.966562 22733 raft_consensus.cc:1240] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.077913 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:38.981266 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.124747 22036 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:38.959611 22067 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:38.985538 23628 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.091938 22142 raft_consensus.cc:1240] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.092346 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:39.135943 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 43670.2us
I20260709 12:26:39.092727 22702 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:39.137563 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 44913.2us
I20260709 12:26:39.137801 23684 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.138558 22702 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:39.130724 22064 raft_consensus.cc:2393] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:39.093009 22185 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.097604 22065 raft_consensus.cc:2393] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:39.095944 22216 rpcz_store.cc:276] 0709 12:26:37.415853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.528306 (+112453us) service_pool.cc:224] Handling call
0709 12:26:37.828250 (+299944us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:38.992130 (+1163880us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400035cd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:38.992277 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447533696}
W20260709 12:26:39.140949 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 49173.8us
I20260709 12:26:39.141513 23628 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.141732 22185 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.142091 23614 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.142948 23661 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.143072 22185 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.143632 23661 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.143863 23631 consensus_queue.cc:237] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.144436 22036 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:39.145325 23699 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.119935 23649 raft_consensus.cc:740] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.127789 23686 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.103356 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:39.146986 22111 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.104218 22144 raft_consensus.cc:1240] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.105419 23695 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.108645 23610 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:39.082942 23654 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.111127 23690 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:39.117414 23702 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.118868 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56596 (request call id 273) took 1348 ms. Trace:
W20260709 12:26:39.101560 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 982) took 1823 ms (client timeout 2159 ms). Trace:
I20260709 12:26:39.130353 22141 raft_consensus.cc:1240] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:39.169502 22069 rpcz_store.cc:269] 0709 12:26:37.278500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.279916 (+  1416us) service_pool.cc:224] Handling call
0709 12:26:39.101377 (+1821461us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400283554. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:39.101504 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932621568}
I20260709 12:26:39.131230 22066 raft_consensus.cc:2393] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:39.090843 22737 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:39.131639 23658 consensus_queue.cc:260] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.133798 23648 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.141582 23667 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.949728 23703 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.097868 22213 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:39.148950 22146 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:39.182915 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.150182 22702 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.150769 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.185787 22065 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.187012 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.157567 23611 consensus_queue.cc:1059] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:26:39.191238 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 891) took 1026 ms. Trace:
I20260709 12:26:39.146658 23649 consensus_queue.cc:260] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.136633 22215 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.193419 23656 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.147071 23686 consensus_queue.cc:1059] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:26:39.197386 23686 raft_consensus.cc:3055] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.197763 23686 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.198652 23686 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.200197 23686 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.178061 23704 consensus_queue.cc:1059] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:26:39.153198 23662 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.202164 23704 raft_consensus.cc:3055] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:39.202276 23662 raft_consensus.cc:697] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:39.202567 23704 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.128592 22138 raft_consensus.cc:1275] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:39.153319 23655 consensus_queue.cc:1059] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:39.144506 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:39.155961 22184 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.203670 23704 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.203722 23662 consensus_queue.cc:237] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:39.204955 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 49097.6us
I20260709 12:26:39.129703 23687 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.154142 23610 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.157728 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.207449 22070 raft_consensus.cc:1240] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:26:39.207587 23610 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.203693 23655 consensus_queue.cc:1243] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer ed678a3f9e3d4e0ba5801f1663548796 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:26:39.208890 22142 raft_consensus.cc:1240] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.152786 23673 consensus_queue.cc:1059] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:26:39.175987 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.209903 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.156682 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.090041 23709 consensus_queue.cc:237] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.159096 23679 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.187716 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:39.188261 22185 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:39.188619 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:39.168860 22143 rpcz_store.cc:276] 0709 12:26:37.753744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.753972 (+   228us) service_pool.cc:224] Handling call
0709 12:26:39.102213 (+1348241us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b540018a454. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:39.102339 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1203602688}
I20260709 12:26:39.217011 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.151825 22036 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:39.192929 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.194775 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:39.218400 22066 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:39.191623 22144 rpcz_store.cc:276] 0709 12:26:38.164419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.753653 (+589234us) service_pool.cc:224] Handling call
0709 12:26:39.104002 (+350349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.148045 (+ 44043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.191049 (+ 43004us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540018a450. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:39.191180 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805043072}
I20260709 12:26:39.152724 23718 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.187971 23620 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.205801 23671 raft_consensus.cc:2764] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:39.211843 22220 raft_consensus.cc:2393] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 2: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:39.178731 22217 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:39.202631 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:39.180815 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:39.223564 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 71818.2us
I20260709 12:26:39.216658 22068 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:39.225791 22070 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.226437 22185 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.205042 23704 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.229532 22063 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:39.222394 23679 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:39.230352 22065 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:39.232506 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.233906 22068 raft_consensus.cc:1240] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.235230 22146 raft_consensus.cc:1240] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.233966 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.238723 22185 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.239775 22185 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:39.213552 23317 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.240590 22185 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.235949 22066 raft_consensus.cc:1240] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.228327 22137 raft_consensus.cc:1240] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.243144 23670 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.225255 23658 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.251907 22184 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:39.180132 23690 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.246361 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.246593 22111 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:39.249059 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 150736us
I20260709 12:26:39.262468 22701 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:39.250146 23661 raft_consensus.cc:3055] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.223157 23649 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.228391 23706 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.228565 23699 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.256080 22036 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.234792 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:39.244184 23650 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.216249 23534 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:26:39.268016 22701 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:39.243741 23655 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.244433 23679 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.228685 23673 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.229099 23611 consensus_queue.cc:1059] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:26:39.273152 23716 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.245890 23675 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.278273 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:39.329834 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 51658us
I20260709 12:26:39.332419 23660 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.334614 22702 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:39.278085 22070 raft_consensus.cc:1240] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:39.279888 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.258373 23693 consensus_queue.cc:1059] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:26:39.264727 23671 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.270018 23644 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.271350 23317 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:39.338887 22069 raft_consensus.cc:1240] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.275586 23699 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:39.338984 23317 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:39.339465 23699 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.339756 23317 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.265884 23661 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.253541 23620 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.298020 22067 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:39.300172 22066 raft_consensus.cc:1240] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.272213 23617 consensus_queue.cc:1059] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:26:39.301059 22215 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:39.288322 23578 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.293740 23570 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.304610 23656 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.286270 23731 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:39.313442 22138 raft_consensus.cc:2393] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:39.318324 22062 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:39.287184 23712 consensus_queue.cc:1059] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:26:39.321014 23690 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.337653 23636 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:39.341610 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:39.343365 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:39.349417 23617 consensus_queue.cc:1243] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer c9a50b2f586448c49281a6618c40a1f7 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:39.346395 23534 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.326558 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.386891 23554 consensus_queue.cc:1059] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:39.387375 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 60922us
I20260709 12:26:39.388155 23718 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:39.388643 23718 raft_consensus.cc:697] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.389513 23718 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:39.391798 23726 log.cc:927] Time spent T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:26:39.379343 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.348248 23633 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.346005 23675 raft_consensus.cc:697] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.395696 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:39.352214 23661 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.399348 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.402302 22064 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.404382 23317 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.352268 23731 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.412820 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.415624 23317 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.402405 23636 raft_consensus.cc:697] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:39.416568 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.394109 23675 consensus_queue.cc:237] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.432089 22146 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:26:39.436867 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.444397 23721 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:39.449600 22062 raft_consensus.cc:1240] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.451527 22062 raft_consensus.cc:1240] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.446018 23661 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:39.457947 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.428571 23703 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.455703 22062 raft_consensus.cc:1240] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.472549 22069 raft_consensus.cc:1240] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:39.485771 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.421965 23699 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.494194 22064 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:39.495361 22070 raft_consensus.cc:1240] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.475455 23647 raft_consensus.cc:3055] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.501597 23647 raft_consensus.cc:740] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:39.502959 23647 consensus_queue.cc:260] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.515412 23671 raft_consensus.cc:3055] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.516090 23671 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.561685 23654 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.563212 23673 raft_consensus.cc:3055] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.571483 22069 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:39.574364 23636 consensus_queue.cc:237] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.605082 23654 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.536209 23671 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.587001 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.589689 23673 raft_consensus.cc:740] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:39.601886 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.612433 22737 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:39.616855 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.618018 22215 raft_consensus.cc:2393] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:26:39.613400 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.652663 23699 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:39.653712 23730 log.cc:927] Time spent T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:26:39.645848 23679 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.671015 23679 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.669351 23731 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:39.711308 22065 raft_consensus.cc:1240] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:39.713721 22068 raft_consensus.cc:1240] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.715519 22066 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:39.718320 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:39.719489 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 452877us
I20260709 12:26:39.721261 22219 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:39.615801 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.725751 23631 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:39.726389 22737 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:39.726967 23631 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:39.717973 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 103497us
W20260709 12:26:39.672561 23684 consensus_meta.cc:287] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 12:26:39.765439 23718 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:39.766659 23718 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.769623 23731 consensus_queue.cc:1059] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:39.770164 22140 raft_consensus.cc:1240] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.765540 23648 consensus_queue.cc:1059] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:26:39.736555 23534 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:26:39.779816 22215 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:39.780663 23675 consensus_queue.cc:1059] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:39.782527 23699 raft_consensus.cc:3055] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.783133 23699 raft_consensus.cc:740] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.771286 23731 raft_consensus.cc:3055] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:26:39.782543 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 496115us
I20260709 12:26:39.794137 23686 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.794533 22215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
new_leader_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:60218
I20260709 12:26:39.795199 23686 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.800145 22215 raft_consensus.cc:606] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Received request to transfer leadership to TS 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:39.795710 23703 consensus_queue.cc:1059] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:39.800017 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.786868 23731 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.784996 23699 consensus_queue.cc:260] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.807288 23660 consensus_queue.cc:1059] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:39.815656 23647 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.823072 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54728 (request call id 1800) took 1152 ms. Trace:
I20260709 12:26:39.799315 23631 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:39.825634 22065 rpcz_store.cc:276] 0709 12:26:38.670914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.241464 (+570550us) service_pool.cc:224] Handling call
0709 12:26:39.270905 (+ 29441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:39.712677 (+441772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.822647 (+109970us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400283554. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:39.822957 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010575232}
I20260709 12:26:39.836552 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:39.837865 22735 raft_consensus.cc:2393] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:39.838052 23731 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.839885 23731 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.842724 23687 raft_consensus.cc:3055] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.843247 23687 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.843348 22063 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:39.848361 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:39.850354 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 46336.4us
I20260709 12:26:39.863160 22111 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:39.864897 22733 raft_consensus.cc:1240] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.865443 23703 consensus_queue.cc:1059] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:39.866726 23702 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.867455 23702 raft_consensus.cc:697] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.868834 23702 consensus_queue.cc:237] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.823921 23718 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:39.869724 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 44256.4us
I20260709 12:26:39.851612 23699 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.852017 22067 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:39.856451 23611 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.873055 23703 raft_consensus.cc:3055] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.873520 23703 raft_consensus.cc:740] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:39.874779 23703 consensus_queue.cc:260] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.875439 23629 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:39.876549 23703 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.856838 22071 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:39.881341 22036 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:39.884505 22140 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:39.887774 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.887353 23673 consensus_queue.cc:260] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.888852 23534 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:39.889614 22146 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:39.873091 23611 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.892872 23534 raft_consensus.cc:697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:39.891532 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:39.891642 23671 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:39.890786 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.844606 23687 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:39.869644 23686 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:39.897243 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:39.889025 23673 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.857638 22185 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:39.913697 22064 raft_consensus.cc:1275] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:39.914036 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:39.921561 22066 raft_consensus.cc:2393] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:39.932776 22219 raft_consensus.cc:1275] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:39.936743 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.938782 23656 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:39.939597 22213 raft_consensus.cc:1240] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:26:39.940361 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.941923 23656 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:39.942009 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.943051 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:39.943871 22211 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:39.944867 23623 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:39.945886 23721 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.945768 23657 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:39.946602 23721 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.927312 23648 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
W20260709 12:26:39.947746 23658 consensus_meta.cc:287] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.012s
I20260709 12:26:39.951063 23648 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.953400 23697 raft_consensus.cc:3055] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.953951 23697 raft_consensus.cc:740] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:39.955308 23697 consensus_queue.cc:260] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:39.945241 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 80220.3us
I20260709 12:26:39.956869 23697 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:39.967434 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 111890us
W20260709 12:26:39.968593 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44283.5us
I20260709 12:26:39.971463 23611 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:39.972174 23687 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.974197 22211 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:39.974807 22071 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1002) took 1512 ms (client timeout 1508 ms). Trace:
W20260709 12:26:39.975224 22071 rpcz_store.cc:269] 0709 12:26:38.462768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.484696 (+ 21928us) service_pool.cc:224] Handling call
0709 12:26:39.974582 (+1489886us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400398ad4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:39.974713 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2869886208}
I20260709 12:26:39.942251 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:39.975963 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:39.976725 23631 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:39.977308 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.977545 23631 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:39.923400 23686 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.976738 22218 raft_consensus.cc:2393] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 2: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:39.977573 22067 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:39.964154 23721 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:39.995764 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:39.997126 22137 raft_consensus.cc:2393] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:39.995981 23627 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:39.999876 23627 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:40.000358 23627 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:40.004329 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.005075 23704 consensus_meta.cc:287] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.767s	user 0.013s	sys 0.004s
I20260709 12:26:40.006651 22144 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:26:40.007104 22144 pending_rounds.cc:85] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 2
I20260709 12:26:40.007391 22144 pending_rounds.cc:107] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:40.007777 22144 raft_consensus.cc:2889] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:40.008793 23659 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:40.010134 22036 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:40.010623 23570 consensus_queue.cc:1048] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:40.010998 23661 consensus_queue.cc:1059] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:26:40.011700 23675 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.012938 23570 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:40.012228 22036 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:40.015578 22216 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.013522 22141 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:40.022812 23679 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.023022 22070 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.022540 23534 consensus_queue.cc:237] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.025497 23659 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.026887 23648 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:39.991997 23686 raft_consensus.cc:697] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:40.030570 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.037985 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.055361 22216 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.057262 22067 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:40.057534 23631 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.057771 23686 consensus_queue.cc:237] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:40.058458 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 70069.8us
I20260709 12:26:40.059386 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:40.060235 23611 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:40.060855 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:40.064339 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 70576.8us
W20260709 12:26:40.068328 23670 consensus_meta.cc:287] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.013s
I20260709 12:26:40.068810 23670 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.068652 23623 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:40.069880 23655 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.070945 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.071293 23667 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:26:40.082857 22219 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:26:40.055289 23675 raft_consensus.cc:697] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:40.083346 22219 pending_rounds.cc:85] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: Aborting all ops after (but not including) 4
I20260709 12:26:40.089926 22219 pending_rounds.cc:107] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:26:40.090234 22219 raft_consensus.cc:2889] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:40.095752 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 83661.5us
I20260709 12:26:40.056782 23629 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:26:40.056802 23660 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:26:40.094266 22702 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:40.060881 23611 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.087837 23623 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:26:40.113186 23317 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:40.114409 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.114718 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.093699 23655 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.119311 22111 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:40.121652 23656 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.122087 23656 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:40.130416 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.133208 22217 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.120512 23631 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:40.146889 23648 raft_consensus.cc:3055] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:40.147388 23648 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:40.148332 23648 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.128129 23656 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:40.163117 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.162559 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 70420.6us
I20260709 12:26:40.171160 22036 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:40.172127 23534 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.173722 23534 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.125856 23570 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:26:40.142457 23631 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:40.155879 23686 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.190737 23631 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.205078 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.209229 22111 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:40.211402 22111 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:40.211477 23317 consensus_queue.cc:1059] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:40.213265 23703 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.213320 23634 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:40.213577 23702 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.214078 23703 raft_consensus.cc:697] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:40.214277 23702 raft_consensus.cc:697] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:40.214771 23704 consensus_queue.cc:1059] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:40.215742 23703 consensus_queue.cc:237] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.215951 23702 consensus_queue.cc:237] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.216725 23704 raft_consensus.cc:3055] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.226670 23704 raft_consensus.cc:740] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:40.226161 23317 raft_consensus.cc:3055] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.223778 22185 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:40.158985 23670 consensus_queue.cc:1059] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:26:40.230257 23648 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.209265 23660 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:26:40.233743 23317 raft_consensus.cc:740] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:40.247925 21963 catalog_manager.cc:5697] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 4 to 5, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:40.249976 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.254799 22211 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:40.256428 23704 consensus_queue.cc:260] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.258373 23317 consensus_queue.cc:260] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.259083 23611 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:40.260072 23317 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.258365 23704 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.273447 23679 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.274205 23679 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.274789 22211 raft_consensus.cc:1240] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:40.214118 23634 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.278658 23634 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:40.279522 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 55847.3us
I20260709 12:26:40.279902 22036 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.281095 23658 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.281776 23658 raft_consensus.cc:697] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:40.282254 23647 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.283043 23658 consensus_queue.cc:237] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.285573 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.286952 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.287832 22733 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:40.189754 23675 consensus_queue.cc:237] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.291777 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.292573 22211 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:40.294164 23647 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.297924 22036 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:40.299322 23663 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.299749 23663 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.296905 22211 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:40.276648 23679 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.300102 23663 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:40.310899 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 57359us
I20260709 12:26:40.317378 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.333673 22071 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:40.305930 21963 catalog_manager.cc:5697] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to <none>, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:40.312609 22215 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:40.301491 23627 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.335491 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.336063 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.336733 22218 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:40.337076 23627 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.337466 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.341981 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:40.343487 23751 log.cc:927] Time spent T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.114s	user 0.002s	sys 0.001s
I20260709 12:26:40.344110 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:40.344940 22735 raft_consensus.cc:2393] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 5: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:40.346660 22066 raft_consensus.cc:1240] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:26:40.343793 21963 catalog_manager.cc:5697] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 2 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.360664 22070 raft_consensus.cc:1275] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:40.377645 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.380976 23317 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.384212 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.385383 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:40.387122 23656 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.388532 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.389367 21963 catalog_manager.cc:5697] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.391453 23697 consensus_queue.cc:1048] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.396981 23317 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.369715 23661 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.410451 23317 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.391098 21963 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 2 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.417128 21963 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.409982 22137 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:40.422863 21963 catalog_manager.cc:5697] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.426532 21963 catalog_manager.cc:5697] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:40.427091 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:40.428124 21963 catalog_manager.cc:5697] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.416977 23631 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:40.500702 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 62122.6us
I20260709 12:26:40.502105 23631 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.432482 23687 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.424476 23656 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:40.504732 23657 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:26:40.431756 23647 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.534049 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:40.536633 22735 raft_consensus.cc:2393] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:40.513751 23704 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:40.537568 22062 raft_consensus.cc:2393] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:40.528517 23655 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:40.515977 23570 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:26:40.588277 23317 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:40.592679 23655 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.595041 23655 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.595259 23686 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:40.595943 23686 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.598033 23686 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:40.603317 23755 log.cc:927] Time spent T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 12:26:40.605537 23661 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:40.606041 23661 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.609993 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.610823 22071 raft_consensus.cc:2393] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:40.617471 22138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:50602
I20260709 12:26:40.617828 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.618391 22138 raft_consensus.cc:606] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:40.618892 22138 raft_consensus.cc:614] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:40.620579 23763 log.cc:927] Time spent T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:26:40.620399 23686 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:40.545053 23687 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.621119 23686 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.622872 23687 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.623003 23686 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.623518 23687 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:40.624238 23687 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.566277 23629 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.639235 23317 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.629690 22214 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:40.628539 23704 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.571365 23647 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.643260 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.648895 23716 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:40.649196 23758 log.cc:927] Time spent T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.392s	user 0.000s	sys 0.002s
I20260709 12:26:40.649286 23629 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.649597 23716 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.651634 23629 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.656056 22733 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:40.661520 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.662473 22069 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:40.665501 23647 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.666776 23735 raft_consensus.cc:3055] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:40.667225 23735 raft_consensus.cc:740] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:40.668776 23704 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.672537 23317 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.679291 22702 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:40.689457 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.691803 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.652253 23716 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.692642 22146 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:40.668496 23735 consensus_queue.cc:260] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.670320 23663 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.704475 23773 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.706223 23648 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.710280 23648 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.712479 23648 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.713395 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.713410 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.714066 22214 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:40.714569 22733 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:40.715330 22068 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:40.715709 22185 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:40.716300 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.716987 22215 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:40.720223 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.720868 22062 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:40.722507 23648 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.722903 23648 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.723268 23648 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.709721 23578 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.729382 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.730094 22142 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:40.729777 23578 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.731243 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:40.731844 22069 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.732016 23578 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.743168 22702 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:40.744115 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:40.744494 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.747766 22036 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:40.749944 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.751994 23673 raft_consensus.cc:2764] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:40.752228 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:40.756035 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.756472 23687 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.756716 22211 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:40.757787 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.758407 23629 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:40.759321 22211 raft_consensus.cc:1275] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:40.760807 22218 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:40.761404 23663 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.769503 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:40.770412 22218 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.771046 23721 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.771552 23721 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.771936 23721 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.776710 22036 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:40.786986 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.791627 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.792681 22141 raft_consensus.cc:2393] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:40.794373 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:40.788807 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.797758 22142 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:40.775962 23663 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:40.748772 22137 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:40.813305 23317 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.818615 22069 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:40.789029 23673 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.835470 22702 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:40.799544 23679 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:40.795787 23627 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:26:40.836126 23697 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.861814 22137 raft_consensus.cc:1275] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:40.863977 23684 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:40.864778 23684 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.865300 23645 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.865842 23645 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.867900 23645 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.869596 23684 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.873859 23775 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:40.874488 23775 raft_consensus.cc:697] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:40.875484 23775 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.877265 23772 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.877720 23772 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:40.878085 23772 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.881733 23697 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.834998 23663 raft_consensus.cc:697] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:40.884133 23697 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.883813 23663 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.849681 23317 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.885499 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.885577 23679 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.886034 23317 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.886235 22733 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:40.887707 23317 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.887882 23679 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.887805 22185 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:40.888186 23712 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.889016 23712 raft_consensus.cc:697] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:40.890338 23735 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.890614 23679 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.890467 23712 consensus_queue.cc:237] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.891314 23679 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.894497 23534 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.895200 23679 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.895119 23534 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.896883 22111 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:26:40.908892 22219 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.023s	sys 0.006s
W20260709 12:26:40.914734 22219 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.024s	sys 0.006s
I20260709 12:26:40.918825 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.921411 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.922227 22733 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:40.924203 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.933743 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.895268 23648 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.934480 22144 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:40.933879 22068 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:40.945024 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.897610 23673 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.946628 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.946750 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.947556 22071 raft_consensus.cc:2368] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4.
I20260709 12:26:40.949397 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.950218 22065 raft_consensus.cc:2393] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:40.953514 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.954373 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.955345 22067 raft_consensus.cc:2393] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:40.956248 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:40.911128 23687 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.954344 22141 raft_consensus.cc:2393] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:40.975253 23721 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.975929 22184 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.977576 23721 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:40.977716 22184 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:40.978503 22218 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:40.978629 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:40.979183 22137 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.979054 22184 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:40.979803 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.980460 22218 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:40.981385 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:40.981472 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:40.981705 22736 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:40.983135 22218 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:40.954377 22070 raft_consensus.cc:1275] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:40.987249 22702 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:40.957245 23687 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:40.994261 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 106537us
I20260709 12:26:40.995463 23731 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:41.000316 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:41.000137 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:41.020560 23554 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:41.020670 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 62043.3us
I20260709 12:26:41.021051 23627 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.021366 23554 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.021685 23627 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.022423 22035 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:41.023736 23554 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:41.025946 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:41.023975 23578 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.026623 22733 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:40.972000 23673 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:41.037287 23702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.005s	sys 0.029s
W20260709 12:26:41.037725 23702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.005s	sys 0.029s
I20260709 12:26:40.993983 23611 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:41.049558 23578 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:40.996577 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:40.995123 23772 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.000404 23687 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.990562 23661 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:40.995959 23670 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:41.073397 23670 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:41.073763 23661 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:40.977723 23735 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:41.031855 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:40.996286 23645 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:41.075804 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:41.080281 22142 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:41.075850 22214 raft_consensus.cc:1240] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:41.077029 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:41.010492 23731 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:41.024797 23675 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:41.089676 22069 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:41.023765 23627 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.094584 22036 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:41.113819 22137 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:41.114184 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:41.073810 23670 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:41.050323 23679 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:41.099653 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:41.100504 23658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.022s	sys 0.041s
W20260709 12:26:41.085372 23703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.019s	sys 0.033s
I20260709 12:26:41.099838 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:41.119227 22035 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:41.119625 22140 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:41.085085 23645 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.030661 23631 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:26:41.088913 23611 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.095739 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:41.201447 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 82389.2us
I20260709 12:26:41.094677 23675 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.094388 23731 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:41.302575 23768 log.cc:927] Time spent T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:26:41.128851 23658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.022s	sys 0.042s
I20260709 12:26:41.303632 23675 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.314463 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:41.319604 23774 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.320361 23774 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.323020 23774 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.325632 23534 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.336694 23731 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.337834 22219 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:41.145766 23703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.019s	sys 0.033s
W20260709 12:26:41.240845 22212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.012s	sys 0.012s
I20260709 12:26:41.254354 23699 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:41.298964 23554 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.129452 23679 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.253014 23684 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:41.393673 23554 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:41.384325 22212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.175s	user 0.012s	sys 0.013s
I20260709 12:26:41.386479 23673 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.395982 23554 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:41.396693 23673 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.393664 23699 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.388031 23675 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.398715 23699 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:41.390129 23731 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.393946 23679 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.399443 23675 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.397001 23687 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.404031 23687 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.405328 22219 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:41.407635 23578 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.394243 23684 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.408994 23684 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.388743 23670 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.415050 23670 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:41.260480 23660 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.415982 23660 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.428622 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:41.429388 22140 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:41.430584 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:41.431190 22141 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.435757 23684 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.438614 23636 consensus_queue.cc:1059] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:41.440141 23772 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.420864 23679 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.440830 22141 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:41.442520 23679 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.443665 22138 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:41.444080 23660 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.457674 23648 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.214552 23627 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:41.459848 22702 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:41.458745 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:41.477259 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 43628us
I20260709 12:26:41.117954 23735 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.502097 22035 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:41.295420 23645 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.384387 23611 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.512707 22035 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:41.510294 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:41.514964 23317 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:41.515455 23317 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.515873 23317 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.478724 22211 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:41.529657 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:41.528730 22701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.024s	sys 0.017s
I20260709 12:26:41.493047 23648 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:41.533197 22701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.025s	sys 0.018s
W20260709 12:26:41.533589 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 685937us
I20260709 12:26:41.511942 23627 raft_consensus.cc:697] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:41.538422 23648 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.513410 23660 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:41.511518 23655 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:41.542217 21963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.028s	sys 0.074s
W20260709 12:26:41.523003 22215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.007s	sys 0.023s
W20260709 12:26:41.540150 23657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.026s	sys 0.028s
I20260709 12:26:41.530205 23679 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:41.539031 23627 consensus_queue.cc:237] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.551574 23679 raft_consensus.cc:697] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:41.552740 23679 consensus_queue.cc:237] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:41.555480 22185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.026s
W20260709 12:26:41.555891 22185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.007s	sys 0.026s
W20260709 12:26:41.547314 22216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.023s	sys 0.079s
W20260709 12:26:41.557423 22216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.023s	sys 0.079s
W20260709 12:26:41.557678 21963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.029s	sys 0.074s
I20260709 12:26:41.559926 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:41.559711 22064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.006s	sys 0.047s
W20260709 12:26:41.573369 22064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.006s	sys 0.047s
I20260709 12:26:41.555286 23655 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.548113 23660 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:41.550865 22215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.024s
I20260709 12:26:41.581555 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:41.581877 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 487342us
I20260709 12:26:41.522650 23687 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:26:41.575132 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:41.583117 22141 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.583026 22036 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:41.547436 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:41.584654 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:41.588619 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:41.586370 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:41.589871 23534 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:41.592404 22066 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
W20260709 12:26:41.561148 23657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.026s	sys 0.028s
I20260709 12:26:41.612329 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:41.613083 22735 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:41.610711 22183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.005s	sys 0.033s
W20260709 12:26:41.616295 22183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.005s	sys 0.033s
I20260709 12:26:41.579085 23660 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.617636 22036 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:41.622397 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:41.623217 22736 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.626528 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:41.627758 23554 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:41.628963 22185 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:41.618898 22138 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.630764 23554 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:41.630684 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:41.631310 23554 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.631613 22071 raft_consensus.cc:2368] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4.
I20260709 12:26:41.631701 23554 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.633219 22185 leader_election.cc:400] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4.
I20260709 12:26:41.633613 22185 leader_election.cc:403] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:41.634275 23658 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.622040 23671 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:41.637400 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:41.637478 23671 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.637882 23670 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:41.638230 22145 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.638593 23670 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:41.639554 22703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.023s	sys 0.019s
W20260709 12:26:41.639919 22703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.023s	sys 0.019s
W20260709 12:26:41.640627 23732 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.005s	sys 0.039s
W20260709 12:26:41.641044 23732 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.005s	sys 0.039s
I20260709 12:26:41.611230 23534 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:41.658145 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:41.655017 22219 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:41.679005 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:41.681700 22065 raft_consensus.cc:2393] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:41.640971 23670 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.624609 23675 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:41.686322 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:41.681110 23774 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:41.687978 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:41.688934 22139 raft_consensus.cc:2393] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:41.660392 23636 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.645591 23684 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.642834 23673 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:41.654662 23721 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:41.678169 23697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.039s
W20260709 12:26:41.730152 23697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.017s	sys 0.039s
I20260709 12:26:41.730649 22735 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:41.732358 22185 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:41.733119 23611 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:41.733462 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:41.733745 23611 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:41.734210 23611 raft_consensus.cc:697] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:41.735098 23611 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:41.735760 23790 log.cc:927] Time spent T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:26:41.737869 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:41.679895 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 62336.5us
I20260709 12:26:41.692624 23636 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.660663 23776 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:41.740963 23776 raft_consensus.cc:697] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:26:41.710090 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 43486.1us
I20260709 12:26:41.626084 23655 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.644986 23699 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:26:41.720494 23317 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.724078 22212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 196) took 1692 ms. Trace:
I20260709 12:26:41.728615 22145 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:41.713981 23731 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:41.659732 23534 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.693331 23631 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:41.746520 22141 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:41.746603 22036 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:41.714634 23735 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:41.770012 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:41.765828 22736 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:41.776182 23317 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.775607 22035 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:41.743119 23673 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.722702 23675 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.796156 22069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584"
dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:55044
I20260709 12:26:41.803277 22069 raft_consensus.cc:606] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:41.803686 22069 raft_consensus.cc:614] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:41.806718 22185 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:41.814651 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:41.815572 22219 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:41.829741 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:41.779198 23774 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:41.837460 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:41.781723 23716 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:41.837321 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:41.753770 23721 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.795889 23647 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:41.878057 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:41.852814 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:41.878829 22070 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:41.797384 23648 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:41.843314 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 209) took 1114 ms. Trace:
I20260709 12:26:41.879312 22213 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:41.776958 23731 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:41.825275 23671 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:41.827538 23636 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.819621 22138 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
W20260709 12:26:41.916682 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 401224us
I20260709 12:26:41.840099 23774 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.780526 23631 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:41.925005 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 118393us
I20260709 12:26:41.850567 23778 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:26:41.879864 23775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.017s	sys 0.054s
I20260709 12:26:41.956002 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:41.915863 23721 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:41.883525 23699 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:41.953833 22111 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:41.970929 22185 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:41.954967 23735 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:41.970402 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:41.849622 23716 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:41.882103 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:41.958374 22063 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
W20260709 12:26:41.962512 23712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.023s	sys 0.054s
I20260709 12:26:41.953644 23774 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:41.798206 23776 consensus_queue.cc:237] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.018606 22111 leader_election.cc:400] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4.
I20260709 12:26:42.019094 22111 leader_election.cc:403] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:42.021077 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:41.973858 23775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.017s	sys 0.057s
W20260709 12:26:41.979045 23663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.008s	sys 0.008s
I20260709 12:26:42.028600 23317 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.015574 23702 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:41.982574 23712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.023s	sys 0.054s
W20260709 12:26:42.033916 22184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.148s (SENT) [suppressed 9 similar messages]
W20260709 12:26:42.033414 23663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.008s	sys 0.009s
I20260709 12:26:42.047782 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.017426 23670 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:41.963127 23778 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.050414 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.029136 23703 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:42.054126 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:42.060592 22141 raft_consensus.cc:2393] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:42.062516 23631 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:42.065325 23703 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.065857 23703 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.065945 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.067619 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:42.067896 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:42.068492 22213 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:42.069689 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:42.029929 23797 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:42.039379 23735 raft_consensus.cc:697] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:42.065253 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:42.050802 23783 log.cc:927] Time spent T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:26:42.055756 23787 log.cc:927] Time spent T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:26:42.043246 22211 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:42.082515 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:42.050818 22138 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.089078 22071 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:42.091435 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:42.082165 22145 raft_consensus.cc:2368] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:42.097419 23802 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:42.097883 23802 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:42.071105 23712 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.097622 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.102775 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.046734 23807 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:26:42.098311 23802 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.125414 23773 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:42.126202 23773 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.098668 23673 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:42.099368 23675 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:42.074532 23670 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.129750 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.139930 23773 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:42.140661 23317 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4.
I20260709 12:26:42.002063 23699 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:42.147444 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:42.157868 22139 raft_consensus.cc:2393] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:42.148597 22145 raft_consensus.cc:2368] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4.
I20260709 12:26:42.170578 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 198) took 1919 ms. Trace:
I20260709 12:26:42.220263 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.108233 23712 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:42.216908 22216 rpcz_store.cc:276] 0709 12:26:40.251239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.251435 (+   196us) service_pool.cc:224] Handling call
0709 12:26:40.265895 (+ 14460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:40.325813 (+ 59918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:40.325854 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:40.327567 (+  1713us) log.cc:844] Serialized 26 byte log entry
0709 12:26:40.637958 (+310391us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18001c6180. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208dee07 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e235890d1 00007f1e239a4a0f
0709 12:26:41.581246 (+943288us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:41.581301 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.581382 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.166577 (+585195us) raft_consensus.cc:1685] finished
0709 12:26:42.166605 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.170504 (+  3899us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52586,"raft.queue_time_us":61402,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9097,"spinlock_wait_cycles":45640064,"thread_start_us":920056,"threads_started":1,"wal-append.queue_time_us":1471555}
I20260709 12:26:42.167596 23647 raft_consensus.cc:697] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:42.293213 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:41.754405 22212 rpcz_store.cc:276] 0709 12:26:40.032180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.037694 (+  5514us) service_pool.cc:224] Handling call
0709 12:26:40.087959 (+ 50265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:40.116999 (+ 29040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:40.118669 (+  1670us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:40.188891 (+ 70222us) log.cc:844] Serialized 26 byte log entry
0709 12:26:40.763048 (+574157us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e208df0ac 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b
0709 12:26:41.395059 (+632011us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:41.395120 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.395227 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:41.693119 (+297892us) raft_consensus.cc:1685] finished
0709 12:26:41.694947 (+  1828us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:41.723991 (+ 29044us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8013,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":7444,"spinlock_wait_cycles":56708864,"thread_start_us":1186028,"threads_started":1,"wal-append.queue_time_us":1381659}
I20260709 12:26:42.310693 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:42.313879 22141 raft_consensus.cc:2368] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
W20260709 12:26:42.318276 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 218153us
W20260709 12:26:42.282505 23554 consensus_meta.cc:287] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.005s
I20260709 12:26:42.387615 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:42.344841 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:42.389058 22214 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.394852 22213 raft_consensus.cc:1275] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:42.409386 22139 raft_consensus.cc:1275] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:42.268191 23731 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:42.413908 22141 raft_consensus.cc:1240] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:42.293066 23684 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:42.290994 23679 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:42.418951 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 385032us
I20260709 12:26:42.429086 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:42.312714 23797 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:42.513139 22735 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:42.430316 22035 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:42.525827 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 95603us
I20260709 12:26:42.528046 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.528671 22139 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:42.528597 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.412993 23675 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:42.406756 23657 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:42.408823 23805 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:42.406185 23807 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.880705 22215 rpcz_store.cc:276] 0709 12:26:40.728571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.740509 (+ 11938us) service_pool.cc:224] Handling call
0709 12:26:40.769748 (+ 29239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:40.793936 (+ 24188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:40.797215 (+  3279us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:40.805426 (+  8211us) log.cc:844] Serialized 26 byte log entry
0709 12:26:40.948994 (+143568us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b180017c1a0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e20876c0a 00007f1e29fb6219 00007f1e278bd58f 00007f1e208fc571 00007f1e208fe7c1 00007f1e208fe779 00007f1e208fe709 00007f1e208fe6d1 00007f1e208fd9cd
0709 12:26:40.957249 (+  8255us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b180017c1a0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208dee07 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e235890d1 00007f1e239a4a0f
0709 12:26:41.597130 (+639881us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:41.615939 (+ 18809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.621762 (+  5823us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:41.843059 (+221297us) raft_consensus.cc:1685] finished
0709 12:26:41.843080 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:41.843241 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6509,"raft.queue_time_us":8144,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":10960,"spinlock_wait_cycles":34059392,"thread_start_us":624613,"threads_started":1,"wal-append.queue_time_us":1035685}
I20260709 12:26:42.245062 23735 consensus_queue.cc:237] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.417037 23732 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:42.558947 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:42.521538 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:42.511487 23731 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:42.525115 23797 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.561354 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:42.410260 23554 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:42.517755 23804 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:42.530387 23673 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:42.551093 23627 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.598193 23627 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:42.598508 22184 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:42.598552 22144 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:42.542192 23775 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:42.600564 23627 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:42.600526 23775 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.574038 23732 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.605753 23732 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:42.607200 23817 log.cc:927] Time spent T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:26:42.608853 22214 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:42.518895 23684 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.558689 23803 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.614496 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1638) took 1082 ms. Trace:
I20260709 12:26:42.612037 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:42.616526 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:42.614931 22137 rpcz_store.cc:276] 0709 12:26:41.526199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.526607 (+   408us) service_pool.cc:224] Handling call
0709 12:26:41.527041 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.885127 (+358086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.885184 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.922384 (+ 37200us) log.cc:844] Serialized 26 byte log entry
0709 12:26:42.123563 (+201179us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:42.123616 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.123708 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.608590 (+484882us) raft_consensus.cc:1685] finished
0709 12:26:42.608611 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.608744 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18571,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"thread_start_us":511125,"threads_started":2,"wal-append.queue_time_us":333705}
W20260709 12:26:42.596710 23660 consensus_meta.cc:287] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.955s	user 0.011s	sys 0.000s
I20260709 12:26:42.621474 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:42.612715 23801 log.cc:927] Time spent T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 12:26:42.632660 22219 raft_consensus.cc:2393] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:42.575433 23778 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:42.551328 23675 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:42.566452 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:42.610617 23578 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:42.556807 23657 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.614327 22211 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:42.567788 23807 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.646818 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:42.557880 23679 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:42.608225 23647 consensus_queue.cc:237] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:42.611111 23804 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.633911 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:42.610914 23673 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:42.621924 23803 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.563028 23805 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:42.664211 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 136937us
I20260709 12:26:42.998513 22036 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:42.880740 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1578) took 1054 ms. Trace:
I20260709 12:26:42.887420 22702 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:43.001036 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.002624 22214 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:42.888358 22733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35006 (request call id 557) took 1302 ms. Trace:
I20260709 12:26:43.003993 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:42.995617 23703 consensus_meta.cc:287] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.929s	user 0.007s	sys 0.005s
I20260709 12:26:42.732602 23821 raft_consensus.cc:3055] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:42.674666 23578 raft_consensus.cc:697] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:43.006330 23834 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.006527 23823 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.006903 23834 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.007130 23823 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.007598 23578 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.009465 23834 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.009630 23823 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.006794 23821 raft_consensus.cc:740] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:42.998525 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:43.012583 22184 leader_election.cc:400] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:42.624882 23671 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:43.013814 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 126467us
I20260709 12:26:43.013084 22184 leader_election.cc:403] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:42.999840 22219 rpcz_store.cc:276] 0709 12:26:41.820340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.829431 (+  9091us) service_pool.cc:224] Handling call
0709 12:26:42.874584 (+1045153us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b540016a154. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:42.874765 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844019456}
I20260709 12:26:43.003274 22733 rpcz_store.cc:276] 0709 12:26:41.585897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.586081 (+   184us) service_pool.cc:224] Handling call
0709 12:26:42.888140 (+1302059us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540069fd54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:42.888269 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189572352}
I20260709 12:26:43.014853 22142 raft_consensus.cc:3055] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.023021 22184 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:42.796353 23658 consensus_meta.cc:287] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 1.162s	user 0.008s	sys 0.004s
W20260709 12:26:42.966852 22138 consensus_meta.cc:287] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.868s	user 0.011s	sys 0.000s
W20260709 12:26:42.993638 23534 consensus_meta.cc:287] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 1.212s	user 0.007s	sys 0.005s
I20260709 12:26:43.021268 22142 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:42.870421 23661 raft_consensus.cc:993] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: : Instructing follower 85f0d4cf04de40aa9e25849fb2380466 to start an election
I20260709 12:26:42.776476 23684 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:42.778558 23808 log.cc:927] Time spent T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.598s	user 0.000s	sys 0.001s
W20260709 12:26:42.774765 23820 log.cc:927] Time spent T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:26:42.690647 23796 log.cc:927] Time spent T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.519s	user 0.000s	sys 0.001s
W20260709 12:26:42.964672 23702 consensus_meta.cc:287] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.003s
I20260709 12:26:43.051350 22062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1038) took 1001 ms. Trace:
I20260709 12:26:42.638736 23731 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:42.707209 22212 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:43.051797 23821 consensus_queue.cc:260] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.075547 23732 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.052623 23679 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.025287 22214 raft_consensus.cc:1240] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:43.053768 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 55359.8us
W20260709 12:26:42.707527 23814 log.cc:927] Time spent T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
W20260709 12:26:42.692354 23811 log.cc:927] Time spent T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
W20260709 12:26:42.968884 23774 consensus_meta.cc:287] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.933s	user 0.008s	sys 0.001s
I20260709 12:26:42.643996 23778 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:43.035342 22184 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:43.057719 22219 raft_consensus.cc:1275] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:43.058375 23835 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:43.058491 22138 raft_consensus.cc:1275] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:42.884110 23687 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:42.777104 23825 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.059041 23658 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4.
I20260709 12:26:43.058957 23534 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.060236 23826 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.098851 23821 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.061014 23836 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.111812 23836 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.061133 23673 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.062435 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:43.112205 23534 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.055375 23648 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:43.109531 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 925) took 1064 ms. Trace:
I20260709 12:26:43.114197 22138 rpcz_store.cc:276] 0709 12:26:42.045209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.050319 (+  5110us) service_pool.cc:224] Handling call
0709 12:26:42.050680 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.100392 (+1049712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.109466 (+  9074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:43.115343 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.115675 23731 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.116588 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.100075 23774 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.112236 23836 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.101318 23778 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.119328 23774 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.121460 23807 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.122027 23807 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.122529 23807 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.122841 22138 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:43.123911 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.098055 23732 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.124869 22138 raft_consensus.cc:2410] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:26:43.126035 23732 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.126217 22138 raft_consensus.cc:1275] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:42.773239 23832 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.140604 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:42.778028 23712 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:42.693297 23828 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.075691 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:42.634044 23660 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.051400 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:43.080137 22700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.005s	sys 0.013s
I20260709 12:26:43.080003 23837 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.781596 23806 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.062970 22142 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:43.142261 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 66659.1us
I20260709 12:26:43.151366 22142 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.141124 23832 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.142293 22065 raft_consensus.cc:2368] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:42.780160 23657 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:43.052850 23675 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:43.084368 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.150489 22213 raft_consensus.cc:1240] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:43.086591 22141 raft_consensus.cc:1275] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:43.168715 22733 raft_consensus.cc:1240] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:43.010848 23703 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.082813 23661 raft_consensus.cc:1081] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Signalling peer 85f0d4cf04de40aa9e25849fb2380466 to start an election
W20260709 12:26:43.089037 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 72144.2us
I20260709 12:26:42.692744 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.064994 23671 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.097301 22701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.016s	sys 0.025s
I20260709 12:26:43.098670 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:43.176939 22701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.016s	sys 0.025s
I20260709 12:26:43.156041 23833 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:43.091821 23702 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:43.094352 23670 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.185954 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1569) took 2204 ms. Trace:
I20260709 12:26:43.060324 23804 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.109319 23826 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.109520 23825 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.186686 23826 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.188303 23825 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.109925 23824 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.104348 23687 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.189393 22137 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:43.190512 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.161988 23699 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:43.130781 23805 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.130607 23836 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.090538 22062 rpcz_store.cc:276] 0709 12:26:42.025538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.062096 (+ 36558us) service_pool.cc:224] Handling call
0709 12:26:42.062435 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:42.062674 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.062704 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:42.063198 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:26:42.236811 (+173613us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:42.238756 (+  1945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.282106 (+ 43350us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.648183 (+366077us) raft_consensus.cc:1685] finished
0709 12:26:42.648223 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.027054 (+378831us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":102464,"threads_started":1,"wal-append.queue_time_us":458778}
I20260709 12:26:43.175879 23832 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:43.132505 23802 consensus_meta.cc:287] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.973s	user 0.012s	sys 0.000s
I20260709 12:26:43.132833 23803 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.132908 23807 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:43.141479 22034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.014s	sys 0.026s
W20260709 12:26:43.145345 22700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.006s	sys 0.013s
I20260709 12:26:43.157246 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:43.164466 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1579) took 1336 ms. Trace:
I20260709 12:26:43.158232 22063 raft_consensus.cc:1240] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:43.147542 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.166970 22219 raft_consensus.cc:1240] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:43.160356 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.174093 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:43.160533 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:43.148556 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:43.143596 23800 log.cc:927] Time spent T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.830s	user 0.007s	sys 0.002s
W20260709 12:26:43.177222 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 78646.6us
W20260709 12:26:43.100076 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 64829.3us
W20260709 12:26:43.177287 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 660206us
I20260709 12:26:43.181005 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:43.181819 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.150931 23821 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:43.185603 23812 log.cc:927] Time spent T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.617s	user 0.004s	sys 0.000s
I20260709 12:26:43.150799 23775 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:42.915128 23645 consensus_meta.cc:287] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 1.392s	user 0.009s	sys 0.004s
I20260709 12:26:43.119350 23778 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.174806 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.128321 23797 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.191650 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:43.162276 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.131214 22218 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:43.184623 23671 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.149732 23806 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.141753 23828 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:43.311230 22034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.015s	sys 0.032s
I20260709 12:26:43.236299 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 331) took 1594 ms. Trace:
W20260709 12:26:43.312511 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.185146 23647 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.186354 22220 rpcz_store.cc:276] 0709 12:26:40.986673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.097724 (+111051us) service_pool.cc:224] Handling call
0709 12:26:41.258608 (+160884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.556596 (+297988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.556628 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.580394 (+ 23766us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.979177 (+398783us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:41.979236 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.150209 (+1170973us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400169754. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:43.150258 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.185661 (+ 35403us) raft_consensus.cc:1685] finished
0709 12:26:43.185680 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.185877 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2584,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":28206,"spinlock_wait_cycles":651415296,"thread_start_us":358267,"threads_started":1,"wal-append.queue_time_us":519466}
I20260709 12:26:43.190848 23687 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.312722 22217 rpcz_store.cc:276] 0709 12:26:41.828599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.828760 (+   161us) service_pool.cc:224] Handling call
0709 12:26:43.163568 (+1334808us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:43.163775 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.164142 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.164171 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:43.164214 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:43.164246 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.164307 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.164413 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274,"raft.queue_time_us":9365,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8961,"spinlock_wait_cycles":9440640}
I20260709 12:26:43.342186 22731 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:43.312911 22214 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:43.269927 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 256) took 2474 ms. Trace:
I20260709 12:26:43.311398 22066 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.324774 22735 raft_consensus.cc:2393] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:43.313047 22184 leader_election.cc:400] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4.
W20260709 12:26:43.497325 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 184417us
I20260709 12:26:43.338291 23671 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:43.345745 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.249356 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.457093 23774 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:43.510161 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.510942 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.510602 23774 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.511947 22730 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:43.512202 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.307337 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:43.512964 22068 raft_consensus.cc:2393] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:43.313344 22140 rpcz_store.cc:276] 0709 12:26:41.642111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.106961 (+464850us) service_pool.cc:224] Handling call
0709 12:26:42.121201 (+ 14240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:42.238105 (+116904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.238152 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:42.238213 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:42.238256 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.235972 (+997716us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5400188654. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:43.236046 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.236222 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63343,"raft.queue_time_us":465001,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":33415,"spinlock_wait_cycles":122176384}
I20260709 12:26:43.314723 23645 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.515014 23716 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:43.515957 23645 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.515959 22737 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:43.516439 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.517123 22068 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:43.518388 22737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 423) took 1089 ms. Trace:
I20260709 12:26:43.518911 22185 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:43.518842 22737 rpcz_store.cc:276] 0709 12:26:42.428985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.511257 (+ 82272us) service_pool.cc:224] Handling call
0709 12:26:42.511595 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.516625 (+1005030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.518152 (+  1527us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54007305d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:43.518303 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309339904}
I20260709 12:26:43.520274 23829 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.520675 23829 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.521071 23829 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.267508 23839 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:43.518368 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.493881 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.337421 22143 raft_consensus.cc:2393] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:43.377944 23712 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.382771 23821 raft_consensus.cc:697] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:43.197382 23675 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.270260 23836 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:43.315130 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 158014us
I20260709 12:26:43.498700 22184 leader_election.cc:400] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:43.543164 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1577) took 1729 ms. Trace:
I20260709 12:26:43.499290 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.542847 23675 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.543756 22214 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:43.345288 22734 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:43.268934 23703 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.347791 23837 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:43.342994 23554 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:43.503027 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.381002 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.484076 23832 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.505815 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.362470 23802 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.545123 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 264) took 1710 ms. Trace:
I20260709 12:26:43.550194 22070 rpcz_store.cc:276] 0709 12:26:41.834997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.951081 (+116084us) service_pool.cc:224] Handling call
0709 12:26:41.963710 (+ 12629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:42.088946 (+125236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.088979 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:42.089021 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:42.089049 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.544855 (+1455806us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000c94d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:43.544902 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.545043 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287520000}
I20260709 12:26:43.551031 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.552239 22214 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
W20260709 12:26:43.546263 22065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1036) took 1800 ms (client timeout 2134 ms). Trace:
W20260709 12:26:43.552911 22065 rpcz_store.cc:269] 0709 12:26:41.745526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.745667 (+   141us) service_pool.cc:224] Handling call
0709 12:26:43.546081 (+1800414us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003e7bd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:43.546209 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3137539456}
I20260709 12:26:43.553297 23806 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.553748 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:43.554169 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:43.554720 22065 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.555154 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.555418 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.555814 22730 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:43.556907 23673 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.557463 23673 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.558506 22036 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:43.559516 23673 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.561241 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.561439 23837 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:43.560585 23673 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.562956 22211 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:43.547065 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.418457 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.565004 23663 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:43.402727 23647 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.565573 23663 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.566069 23647 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.566599 22219 raft_consensus.cc:1240] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:43.506563 23826 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.549574 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.574144 22068 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:43.501261 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.403627 22064 rpcz_store.cc:276] 0709 12:26:40.795054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.795187 (+   133us) service_pool.cc:224] Handling call
0709 12:26:40.795465 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:40.815834 (+ 20369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:40.815882 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:40.838546 (+ 22664us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.573892 (+735346us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:41.573953 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.574065 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.268992 (+1694927us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b2400182288. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e207829c4 00007f1e20780acb 00007f1e2093bdc9 00007f1e2093ba55 00007f1e2093afb0 00007f1e235b1488 00007f1e235b1be8 00007f1e23589398 00007f1e2358476a 00007f1e23583bb6
0709 12:26:43.269618 (+   626us) raft_consensus.cc:1685] finished
0709 12:26:43.269637 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.269848 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90,"raft.queue_time_us":3597,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":15055,"spinlock_wait_cycles":14232448,"thread_start_us":659989,"threads_started":1,"wal-append.queue_time_us":1149355}
I20260709 12:26:43.342398 23660 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.524518 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.548827 23712 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.458261 23687 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.380306 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.457535 23679 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.527328 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.248979 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.594126 22062 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:43.594363 22065 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
W20260709 12:26:43.527644 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.595155 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.529580 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.595474 23679 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.378677 23804 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.597004 23804 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.597786 23679 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.582392 22215 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:43.599826 23804 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.233726 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.600577 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.601725 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.602612 22212 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:43.192102 23833 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.605866 23833 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.269104 23840 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:43.196314 23699 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:43.533247 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.533529 23774 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.533802 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:43.531119 23534 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.535656 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.535969 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.537835 23821 consensus_queue.cc:237] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.541378 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.543325 22184 leader_election.cc:403] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:43.543573 22218 rpcz_store.cc:276] 0709 12:26:41.814128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.816725 (+  2597us) service_pool.cc:224] Handling call
0709 12:26:43.543019 (+1726294us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540038b8d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:43.543110 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917440256}
I20260709 12:26:43.629103 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:43.563169 23673 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.569308 22066 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:43.560071 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:43.632936 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54728 (request call id 1831) took 1019 ms. Trace:
I20260709 12:26:43.484090 23842 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.549309 23807 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.551517 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.572353 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.546059 23832 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.572629 22035 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:43.549512 23703 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.500443 23828 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.508415 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.575788 22071 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1043) took 1160 ms. Trace:
I20260709 12:26:43.667572 22071 rpcz_store.cc:276] 0709 12:26:42.415385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.518415 (+103030us) service_pool.cc:224] Handling call
0709 12:26:42.518670 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:42.639395 (+120725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.639436 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:42.639487 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:42.639528 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.575505 (+935977us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003e76d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:43.575565 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.575723 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277125504}
I20260709 12:26:43.577234 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1836) took 1183 ms. Trace:
I20260709 12:26:43.669235 22213 rpcz_store.cc:276] 0709 12:26:42.394032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.430811 (+ 36779us) service_pool.cc:224] Handling call
0709 12:26:42.512603 (+ 81792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.168624 (+656021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.576993 (+408369us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54001cff54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:43.577180 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461670784}
I20260709 12:26:43.577533 22063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1037) took 1621 ms. Trace:
I20260709 12:26:43.671928 22063 rpcz_store.cc:276] 0709 12:26:41.955836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.039965 (+ 84129us) service_pool.cc:224] Handling call
0709 12:26:42.040405 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:43.402567 (+1362162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.577219 (+174652us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000b54d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:43.577455 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570090240}
I20260709 12:26:43.673566 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:43.580150 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.556598 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.675253 22064 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:43.580489 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:43.526015 23839 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.676146 22068 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.676484 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.677675 23839 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.582693 23317 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:43.678404 23317 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.680264 23317 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.582921 23663 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.548804 23802 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:43.559540 23836 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.583918 23712 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.585988 23826 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.586151 23687 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.586553 23660 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.681991 23660 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.584470 23702 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.683216 23687 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.683409 23702 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.685343 22069 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:43.687125 22069 raft_consensus.cc:1240] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:43.578197 23675 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:43.688906 23712 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.552556 23829 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.587400 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.588243 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:43.589709 23806 consensus_queue.cc:1048] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.590579 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:43.640821 23697 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:43.592154 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:43.706383 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 114294us
I20260709 12:26:43.707988 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:43.595206 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:43.609547 22702 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:43.709157 22065 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
W20260709 12:26:43.709559 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 100086us
I20260709 12:26:43.710351 22702 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:43.495579 23786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.006s	sys 0.005s
I20260709 12:26:43.629861 22218 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:43.631829 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 133253us
I20260709 12:26:43.628279 22067 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:43.570972 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:43.640041 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 80051.9us
I20260709 12:26:43.633348 22066 rpcz_store.cc:276] 0709 12:26:42.620148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.160287 (+540139us) service_pool.cc:224] Handling call
0709 12:26:43.632871 (+472584us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:43.652380 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 79816.5us
I20260709 12:26:43.693100 22219 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.695875 22214 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:43.590799 23843 consensus_queue.cc:1059] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:43.638767 23805 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.692992 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:43.719732 22071 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.638216 23534 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.722604 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:26:43.723192 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 152300us
I20260709 12:26:43.723217 22735 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.649972 23842 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.627879 23699 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.690431 23703 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.701499 22217 raft_consensus.cc:2393] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:43.660674 23807 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.703912 23660 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.626775 22732 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:43.638556 23774 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:43.711728 22111 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:43.656764 23804 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:43.667002 23679 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:43.715356 22068 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:43.717973 22184 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:43.698941 23702 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.725099 22185 leader_election.cc:400] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:43.802956 22185 leader_election.cc:403] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:43.803735 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 78785.1us
I20260709 12:26:43.804636 22185 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:43.728837 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:43.713708 23786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.007s	sys 0.006s
I20260709 12:26:43.732945 23706 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:26:43.733435 22213 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:26:43.811203 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 93281.9us
I20260709 12:26:43.734288 23671 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.736807 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:43.822409 22069 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.737838 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.823597 22071 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:43.820910 22735 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:43.642694 23840 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.716023 23716 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:43.716180 23828 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:43.713519 23645 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.772262 22702 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:43.718935 23806 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:43.801788 22141 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:43.801772 22218 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:43.816908 22035 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:43.702571 23829 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:43.818152 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 106510us
I20260709 12:26:43.800818 23631 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.726778 23802 consensus_queue.cc:1059] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:26:43.737957 23838 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:26:43.729308 23554 consensus_queue.cc:1048] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:26:43.815021 23697 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.809708 23679 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.742158 23684 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:26:43.816290 23774 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.835932 23716 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:43.814895 22062 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:43.822543 23803 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:43.830399 23843 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:43.822774 23797 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:43.886257 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 114141us
I20260709 12:26:43.887507 22035 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:43.887801 22702 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:43.893620 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.730341 23805 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:43.848595 22219 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:43.902199 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:43.898823 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:43.746261 23778 consensus_queue.cc:1048] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:26:43.901127 23317 consensus_queue.cc:1059] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.906260 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.906466 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.906900 22143 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:43.906600 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.907748 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.813401 23660 consensus_queue.cc:1059] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:26:43.917409 22702 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:43.963595 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 46308.2us
I20260709 12:26:43.860729 23807 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.896019 23775 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:43.842000 23806 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:43.854807 23578 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.874090 23802 raft_consensus.cc:3055] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.871701 23673 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.950093 23647 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.969906 23832 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.971705 23647 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.950354 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:43.972723 22138 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.975090 23702 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.955120 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:43.849701 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:43.977684 22146 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.856256 23534 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.981426 23534 raft_consensus.cc:3055] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:43.981940 23534 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:43.983021 23534 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:43.984498 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:43.883038 23716 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.987957 22138 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:43.907923 23773 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:43.955976 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.951732 23629 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:43.881426 23679 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.900588 23684 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.991051 23684 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.991432 23684 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.956807 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:43.884339 23774 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:43.894027 23671 consensus_queue.cc:1059] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:26:43.873601 23631 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:43.853876 23853 log.cc:927] Time spent T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:26:43.883715 23803 raft_consensus.cc:697] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:43.961423 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:43.966038 22069 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:43.870910 23842 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.966964 23841 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.967716 23806 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.968461 23802 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:43.951332 23699 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.947221 23703 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:43.900902 23843 raft_consensus.cc:697] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:43.992985 22144 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:43.957561 23840 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:43.994577 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 169858us
I20260709 12:26:44.000573 22702 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:43.861711 23712 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.002426 22146 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:43.999845 23671 consensus_queue.cc:1243] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer c9a50b2f586448c49281a6618c40a1f7 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:26:44.021260 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 208946us
I20260709 12:26:44.018782 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.024019 22146 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:44.015615 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.014868 22185 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.009095 23647 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:44.022478 23804 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:44.029251 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.036190 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:44.036532 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 134420us
I20260709 12:26:44.018087 23703 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:44.039988 22185 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.030331 23675 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.041181 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.042879 22185 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:44.048579 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.037736 22111 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:44.059478 23317 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:44.059927 23317 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:44.060295 23317 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.060061 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.038465 23629 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:44.079639 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.043244 23675 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.099468 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.102658 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.103559 22068 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:44.105013 22068 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:44.035495 23647 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.098205 23839 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.115464 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.062140 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.092456 23706 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:44.112253 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.096393 23629 raft_consensus.cc:697] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:44.098392 23807 raft_consensus.cc:2764] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:44.106338 23675 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.046942 23703 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.046770 23803 consensus_queue.cc:237] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.135643 23317 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.144789 23317 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.123775 23706 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:44.124387 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:44.149317 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 106526us
I20260709 12:26:44.152532 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.153887 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:44.154404 22219 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.156210 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.156859 22215 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 1.
I20260709 12:26:44.157804 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.157558 23629 consensus_queue.cc:237] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.159063 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.160260 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.164407 22702 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.122964 23645 consensus_queue.cc:1059] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:26:44.136770 23797 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.151060 23706 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.133392 23865 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.170212 22219 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
W20260709 12:26:44.170625 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 59912.7us
I20260709 12:26:44.173964 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.174585 22137 raft_consensus.cc:2376] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2. Re-sending same reply.
I20260709 12:26:44.108116 23843 consensus_queue.cc:237] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.176662 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.172206 23775 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:44.182632 22733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34992 (request call id 428) took 1006 ms. Trace:
I20260709 12:26:44.169911 23697 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3.
I20260709 12:26:44.184581 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.192731 22137 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:44.192354 22733 rpcz_store.cc:276] 0709 12:26:43.176107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.176221 (+   114us) service_pool.cc:224] Handling call
0709 12:26:43.177968 (+  1747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.886881 (+708913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.886912 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:43.886950 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:43.886989 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.182324 (+295335us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540046c3d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:44.182389 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.182554 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629889280}
I20260709 12:26:44.172775 23797 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.196025 22731 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:44.193826 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.198164 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.180028 23679 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.200637 23679 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.202020 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.203513 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.173513 23631 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.208853 23697 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.209600 23697 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.211028 23703 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.211992 23697 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.204351 22137 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
W20260709 12:26:44.198742 23859 log.cc:927] Time spent T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:26:44.214809 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.218320 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.218935 22137 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:44.219009 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:44.233851 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 502218us
I20260709 12:26:44.206233 23797 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.228304 23803 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:44.196312 23645 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:44.256517 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.257362 22215 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:44.259159 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.259332 23806 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.261402 23645 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.215725 23716 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.264999 23645 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.268350 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.269186 22140 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.275182 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.277784 23636 raft_consensus.cc:3055] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:44.278332 23636 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:44.279412 23636 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.289878 22212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1852) took 1101 ms. Trace:
I20260709 12:26:44.293840 23813 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.294952 23716 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.294618 23813 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.295943 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37716 (request call id 1856) took 1106 ms. Trace:
I20260709 12:26:44.296352 22217 rpcz_store.cc:276] 0709 12:26:43.189534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.410517 (+220983us) service_pool.cc:224] Handling call
0709 12:26:44.295750 (+885233us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54001fcf54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:44.295885 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252042496}
I20260709 12:26:44.297892 23813 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.298403 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.300482 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.302008 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.290488 22212 rpcz_store.cc:276] 0709 12:26:43.188408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.603471 (+415063us) service_pool.cc:224] Handling call
0709 12:26:43.603882 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.833091 (+229209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.835762 (+  2671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:43.838584 (+  2822us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:43.886262 (+ 47678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.289533 (+403271us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002c6ad4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:44.289602 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.289795 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480845568}
I20260709 12:26:44.308245 23804 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:44.308801 23804 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.308893 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:44.280926 23636 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.311136 23706 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.314584 22212 raft_consensus.cc:2368] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:44.316576 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.324100 23675 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.403903 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.386633 22070 raft_consensus.cc:1240] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:44.411509 22068 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:44.383174 22063 raft_consensus.cc:1240] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:44.406491 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.415313 22213 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:44.383472 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:44.362460 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.345885 22736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34992 (request call id 430) took 1165 ms. Trace:
I20260709 12:26:44.418260 22216 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:44.416584 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.326632 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.420229 22067 raft_consensus.cc:2393] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:44.421360 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.421213 22213 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:44.422749 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:44.418031 22736 rpcz_store.cc:276] 0709 12:26:43.180648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.180780 (+   132us) service_pool.cc:224] Handling call
0709 12:26:44.345613 (+1164833us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54007a0154. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:44.345808 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911986944}
I20260709 12:26:44.365824 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.426281 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.426810 22214 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:44.427572 22140 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:44.427596 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.428692 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.428920 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:44.420591 22217 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:44.431393 22214 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.350358 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.433776 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.435415 22185 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.435505 22140 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.435613 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:44.437136 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.431681 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.438140 22064 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:44.445778 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.449293 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.450277 22731 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:44.455788 22218 raft_consensus.cc:2393] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:44.456414 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.457259 22064 raft_consensus.cc:2393] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:44.453334 23709 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:44.324908 23805 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.344820 23687 raft_consensus.cc:3055] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:44.364409 23647 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.464406 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.474442 22067 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:44.475245 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.476245 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.477201 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.399735 23802 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.477727 23687 raft_consensus.cc:740] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:44.477849 23802 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.478164 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.448154 23706 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:44.455106 23554 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:44.465277 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.478674 23687 consensus_queue.cc:260] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.479269 23554 raft_consensus.cc:697] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:44.465797 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.480338 23554 consensus_queue.cc:237] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.479269 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.470886 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.379554 23862 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:44.429651 23803 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.479842 23687 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.484126 22214 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:44.459285 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.484947 23797 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.439036 23716 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:26:44.397836 23860 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:26:44.394277 23684 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.461285 23870 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:44.495949 23804 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.484341 22065 raft_consensus.cc:2393] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:44.507027 23803 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.510911 22214 raft_consensus.cc:1240] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:44.469867 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.449201 22702 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:44.533273 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 84183.9us
I20260709 12:26:44.512416 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:44.513711 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.514122 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:44.515267 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 56986.2us
I20260709 12:26:44.536813 22063 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:44.516153 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:44.537281 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.485350 22141 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
 from {username='slave'} at 127.0.0.1:59932
I20260709 12:26:44.538225 22141 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:44.538718 22141 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.530421 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.551157 22213 raft_consensus.cc:2368] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4.
W20260709 12:26:44.555874 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.560509 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.561048 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.561802 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:44.561229 22736 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:44.564086 22185 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:44.566555 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.554652 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:44.567864 23317 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.568212 23317 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.568531 23317 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.568694 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:44.569794 22065 raft_consensus.cc:2393] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:44.570123 22111 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.570123 22036 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:44.524224 22215 raft_consensus.cc:2376] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4. Re-sending same reply.
I20260709 12:26:44.573217 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:44.550063 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.553551 23795 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.550163 23802 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.575639 22140 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:44.577128 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.578125 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.550014 23870 raft_consensus.cc:697] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:44.565688 23675 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:44.568740 23883 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:44.595715 22036 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:44.574734 23836 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.607280 22141 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.612142 22140 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:44.579106 23866 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.581741 23828 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:44.581027 23795 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.583024 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.585880 23802 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.593936 22138 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:26:44.627111 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.627085 23317 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.610319 23679 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:44.613855 23803 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:44.622277 23795 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.632576 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:44.636869 22735 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:44.632934 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.606752 23631 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:26:44.620700 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.624030 23802 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.657533 22062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1047) took 1300 ms. Trace:
I20260709 12:26:44.658157 22062 rpcz_store.cc:276] 0709 12:26:43.356919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.594870 (+237951us) service_pool.cc:224] Handling call
0709 12:26:44.657236 (+1062366us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000cb054. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:44.657446 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481867008}
I20260709 12:26:44.659729 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.661149 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:44.664283 23684 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.668099 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.671141 22143 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:44.672344 22143 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:44.671329 23317 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.612232 23883 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.681767 23629 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:44.683586 23883 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:44.683925 23829 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:44.684648 23804 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:44.685917 22702 leader_election.cc:400] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4.
I20260709 12:26:44.686565 22702 leader_election.cc:403] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:44.687387 23776 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.642642 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:44.642773 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.691910 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:44.643029 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:44.693099 22065 raft_consensus.cc:2376] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3. Re-sending same reply.
W20260709 12:26:44.693306 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 55653.5us
I20260709 12:26:44.649394 22732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35008 (request call id 429) took 1270 ms. Trace:
I20260709 12:26:44.649896 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.651018 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.629163 23828 raft_consensus.cc:697] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:44.653306 23870 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.655530 23862 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:44.690373 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:44.715914 22219 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.643812 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.690487 22216 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:44.697839 22143 raft_consensus.cc:1240] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:44.706992 23317 consensus_queue.cc:1059] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:44.694299 22732 rpcz_store.cc:276] 0709 12:26:43.378849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.380580 (+  1731us) service_pool.cc:224] Handling call
0709 12:26:44.636164 (+1255584us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b540044c354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:44.649330 (+ 13166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146910464}
W20260709 12:26:44.713840 22035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.756484 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.725819 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:44.759408 22111 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:44.727185 22703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.755534 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:44.767093 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 52363.5us
I20260709 12:26:44.768594 22035 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.684702 23829 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.776317 23829 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.776440 23684 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:44.713323 23866 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:44.776957 23684 raft_consensus.cc:697] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:44.777729 22216 raft_consensus.cc:1240] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:44.777846 23684 consensus_queue.cc:237] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.784301 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.768657 22213 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:44.725216 23862 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.789382 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:44.796646 22733 raft_consensus.cc:2393] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:44.790474 22035 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.791143 22731 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:44.807340 23866 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.810580 23866 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:44.811535 22729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.007s	sys 0.015s
W20260709 12:26:44.811941 22729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.007s	sys 0.015s
I20260709 12:26:44.812583 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:44.813458 22213 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:44.816543 22213 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:44.801083 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.713656 23865 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:44.844615 23886 log.cc:927] Time spent T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:26:44.844858 23865 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.847074 23865 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.823447 22219 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:44.832315 22035 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:44.850382 23842 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:44.834388 22137 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:44.790473 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:44.850876 23842 raft_consensus.cc:697] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:44.851397 22138 raft_consensus.cc:2368] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4.
I20260709 12:26:44.836807 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.851858 23842 consensus_queue.cc:237] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.852886 22184 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.798576 23804 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:44.839641 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 163177us
I20260709 12:26:44.824411 23774 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:44.770502 23843 consensus_queue.cc:1059] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:26:44.842739 23807 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:44.843284 22143 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.705628 23828 consensus_queue.cc:237] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:44.862653 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 92063.8us
I20260709 12:26:44.854964 22184 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:44.839375 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 80034.8us
I20260709 12:26:44.856128 22701 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:44.899796 22184 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.901218 22184 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.901782 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.853612 23804 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:44.853902 23699 raft_consensus.cc:2764] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:26:44.856963 23534 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.907581 22184 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.910794 23317 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.918629 23317 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.919202 23317 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.910177 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.855114 23829 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:44.897241 23860 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:44.895364 22729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 571) took 1133 ms. Trace:
W20260709 12:26:44.923503 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 73414.4us
I20260709 12:26:44.900816 23826 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:44.858341 23774 raft_consensus.cc:697] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:44.937873 23774 consensus_queue.cc:237] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:44.922115 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.908350 23883 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.853133 23861 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:26:44.945395 23631 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:44.907639 23675 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.947975 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:44.914906 23804 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:44.951367 23317 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.921108 23797 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.922463 23687 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.922896 23554 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.956671 22111 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.965492 22111 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.940660 23802 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:44.970774 23317 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:44.973299 23317 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:44.973673 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 62570.7us
I20260709 12:26:44.969801 23807 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.961429 23895 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.979665 22111 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:44.980705 23317 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.981225 22111 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.983740 22111 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:45.024499 23894 log.cc:927] Time spent T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:26:44.985580 23687 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:45.029644 23687 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:45.030115 23687 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.038875 22143 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:45.040441 22035 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:45.044158 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 57747.7us
I20260709 12:26:45.045256 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:44.977420 23645 consensus_queue.cc:1059] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:45.022511 22211 raft_consensus.cc:2368] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:44.975577 23862 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.054178 23836 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:45.065519 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 87887.6us
I20260709 12:26:45.051409 23895 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:45.065932 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:45.052719 23893 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:26:45.087083 23905 raft_consensus.cc:3055] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:45.077183 23836 raft_consensus.cc:697] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:45.105939 23905 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:45.106896 23836 consensus_queue.cc:237] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.066838 23897 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.109066 23702 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:45.109571 23702 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:45.109957 23702 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.932528 22729 rpcz_store.cc:276] 0709 12:26:43.729793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.741950 (+ 12157us) service_pool.cc:224] Handling call
0709 12:26:43.821578 (+ 79628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:43.856708 (+ 35130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.856760 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:43.857563 (+   803us) log.cc:844] Serialized 26 byte log entry
0709 12:26:44.667094 (+809531us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e208df0ac 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b
0709 12:26:44.812408 (+145314us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:44.812456 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.812554 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:44.830149 (+ 17595us) raft_consensus.cc:1685] finished
0709 12:26:44.832426 (+  2277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.863455 (+ 31029us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38760,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":138,"spinlock_wait_cycles":101723520,"thread_start_us":954317,"threads_started":1,"wal-append.queue_time_us":954085}
W20260709 12:26:45.097653 23891 log.cc:927] Time spent T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:26:45.112417 22218 raft_consensus.cc:1240] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:45.100536 23795 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.114140 22734 raft_consensus.cc:2368] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:45.107276 23905 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.117595 23905 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.117908 23687 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.118881 23776 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4.
I20260709 12:26:45.120004 23687 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:45.120744 23802 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:45.104228 23862 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:45.122318 22728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 572) took 1392 ms. Trace:
I20260709 12:26:45.122700 22728 rpcz_store.cc:276] 0709 12:26:43.730109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.741740 (+ 11631us) service_pool.cc:224] Handling call
0709 12:26:45.121613 (+1379873us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b5800034598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4eee 000000000036eb39 00007f1e289381e0 00007f1e28a010c4 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:45.121798 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.121994 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.122020 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:45.122067 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:45.122097 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.122156 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.122261 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19126656}
I20260709 12:26:45.126709 23795 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:45.128276 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.128280 22737 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:45.131636 22219 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:45.098565 23832 raft_consensus.cc:3055] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:45.137120 23832 raft_consensus.cc:740] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:45.138300 23832 consensus_queue.cc:260] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.139581 23832 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.142639 23702 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.143790 22143 raft_consensus.cc:1240] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:45.097962 23806 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:45.146486 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.079278 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1587) took 1032 ms. Trace:
I20260709 12:26:45.148816 22214 raft_consensus.cc:1240] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:45.149055 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 83213.3us
I20260709 12:26:45.152281 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:45.149528 22220 rpcz_store.cc:276] 0709 12:26:44.046505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.058389 (+ 11884us) service_pool.cc:224] Handling call
0709 12:26:45.078427 (+1020038us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:45.078648 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.078850 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.078878 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:45.078935 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:45.078964 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.079025 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.079202 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8633088}
I20260709 12:26:45.149573 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:45.153553 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.154903 22219 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.153999 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.159893 22215 raft_consensus.cc:1240] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:45.160879 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 275) took 1844 ms. Trace:
I20260709 12:26:45.161315 22066 rpcz_store.cc:276] 0709 12:26:43.316924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.723348 (+406424us) service_pool.cc:224] Handling call
0709 12:26:44.661302 (+937954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.661473 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.661498 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:44.661538 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:44.661572 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.661632 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.160690 (+499058us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54000cb050. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:45.160812 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156377472}
I20260709 12:26:45.165560 23803 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:45.166199 23803 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.166926 22219 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:45.144919 23702 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:45.171268 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.172969 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:45.175915 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.182575 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.182575 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.183638 22219 raft_consensus.cc:2393] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:45.170554 23897 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.197110 22036 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.199273 22036 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.068506 22701 leader_election.cc:400] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4.
I20260709 12:26:45.201706 22036 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:45.202803 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 135887us
I20260709 12:26:45.206200 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:45.185520 22218 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:26:45.179306 23806 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:45.182968 23839 consensus_queue.cc:1059] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:45.188169 23804 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.175261 23687 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.195070 23866 raft_consensus.cc:3055] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:45.195508 23803 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.216491 22218 pending_rounds.cc:85] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: Aborting all ops after (but not including) 2
I20260709 12:26:45.218189 22140 raft_consensus.cc:1240] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:26:45.208638 23647 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.068248 23895 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:45.229825 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:45.227602 22144 raft_consensus.cc:1240] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:45.233554 22063 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.225502 23663 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.235035 23776 consensus_queue.cc:1059] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:45.235965 23776 raft_consensus.cc:3055] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:45.236316 23776 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:45.237540 23804 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:45.229542 23866 raft_consensus.cc:740] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:45.240172 23803 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:45.233739 22036 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.222029 23806 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:45.241477 23806 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.244094 22218 pending_rounds.cc:107] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:45.244473 22218 raft_consensus.cc:2889] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.245522 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:45.245952 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.248499 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:45.250166 22069 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.253538 22066 raft_consensus.cc:1240] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:45.230765 22111 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:45.225782 23861 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.259173 22064 raft_consensus.cc:1275] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:45.258781 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:45.262816 23687 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:45.263528 23687 raft_consensus.cc:697] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:45.264324 23684 raft_consensus.cc:2804] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:45.261255 23663 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.265830 23802 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:45.268110 23833 consensus_queue.cc:1059] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:45.264742 23684 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:45.269413 23684 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.271391 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:45.272224 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.272827 22211 raft_consensus.cc:3055] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:45.273123 22211 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:45.273802 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.274698 22220 raft_consensus.cc:2393] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:45.257403 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.278211 22036 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:45.284417 22036 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:45.285157 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:45.287828 23663 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:45.288403 23631 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.288228 23870 consensus_queue.cc:1059] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.289155 23870 raft_consensus.cc:3055] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:45.289326 23663 raft_consensus.cc:697] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:45.289615 23870 raft_consensus.cc:740] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:45.244297 23895 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.233299 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:45.290378 23663 consensus_queue.cc:237] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.290562 23870 consensus_queue.cc:260] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.291286 22062 raft_consensus.cc:2410] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:26:45.291769 23870 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.290591 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:45.243996 23776 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.261569 23804 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.293335 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:45.293434 23797 consensus_queue.cc:1175] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "85f0d4cf04de40aa9e25849fb2380466" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:26:45.295358 23803 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:45.290398 23807 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.296303 23833 raft_consensus.cc:3055] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:45.296679 23833 raft_consensus.cc:740] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:45.297495 23833 consensus_queue.cc:260] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.298612 23833 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.233395 23702 consensus_queue.cc:1059] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 12:26:45.304082 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.306306 22218 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:45.305778 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:45.287400 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:45.310547 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.312645 23829 consensus_queue.cc:1059] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:45.317302 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:45.319291 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.331135 22217 raft_consensus.cc:2393] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:45.322428 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.325336 22036 leader_election.cc:400] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:45.332130 22036 leader_election.cc:403] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:45.286435 23802 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:45.337141 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.331929 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.339296 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:45.339857 22068 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:45.339574 22217 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.342597 22036 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:45.344812 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:45.348868 22071 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:45.350579 23879 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.350790 22185 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.351128 23879 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.352281 22069 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:45.353634 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.367848 22063 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:45.370070 22220 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:45.375182 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:45.329651 23774 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.341583 23802 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:45.384011 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:45.384692 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:45.264734 23687 consensus_queue.cc:237] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.398403 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:45.353149 23883 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.368672 23699 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.373600 23631 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:45.396488 22702 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:45.401551 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:45.436030 22144 raft_consensus.cc:2393] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:45.371821 23709 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:45.395992 22036 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.430150 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:45.402734 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:45.394826 23679 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.440028 23679 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.385975 23861 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.388612 23802 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:45.441938 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 46037.3us
I20260709 12:26:45.394578 22062 raft_consensus.cc:1240] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:45.443373 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:45.444121 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:45.486840 22144 raft_consensus.cc:2393] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:45.433673 22111 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:45.446482 22036 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:45.446668 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1674) took 1433 ms. Trace:
W20260709 12:26:45.487987 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 54401.7us
I20260709 12:26:45.379666 23629 consensus_queue.cc:1059] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:26:45.386479 23829 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:26:45.492254 23317 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:26:45.492355 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 45963us
I20260709 12:26:45.495954 23317 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.487749 22146 rpcz_store.cc:276] 0709 12:26:44.013128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.031271 (+ 18143us) service_pool.cc:224] Handling call
0709 12:26:44.042502 (+ 11231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.149704 (+107202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.149736 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:44.149775 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:44.149808 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.446462 (+1296654us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001414d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:45.446507 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.446617 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245885184}
I20260709 12:26:45.496682 22144 pending_rounds.cc:85] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 5
W20260709 12:26:45.495427 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 99018us
I20260709 12:26:45.497061 22144 pending_rounds.cc:107] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:26:45.496745 22036 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.499045 22144 raft_consensus.cc:2889] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.501989 22036 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:45.502923 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 142075us
I20260709 12:26:45.396466 23896 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:26:45.484464 23631 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.517457 22146 raft_consensus.cc:1275] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:45.509605 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.522085 22146 pending_rounds.cc:85] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 1
I20260709 12:26:45.522531 22146 pending_rounds.cc:107] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:45.522998 23317 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:45.523211 22146 raft_consensus.cc:2889] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.505472 22036 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:45.532127 22036 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:45.494483 23865 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.500622 23716 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.497603 23660 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.522084 23861 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:45.521659 23774 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.449163 23709 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.542536 23663 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:45.570389 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 79517.4us
I20260709 12:26:45.569365 22036 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:45.548677 23838 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:45.576282 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:45.576690 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.580252 22036 leader_election.cc:400] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:45.580605 22036 leader_election.cc:403] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:45.533885 23821 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:26:45.577792 23838 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.563860 23804 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:26:45.583609 23861 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:45.641426 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 52029.6us
W20260709 12:26:45.641798 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 63179.7us
I20260709 12:26:45.590665 23842 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:45.594853 23679 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:45.699990 23921 log.cc:927] Time spent T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:26:45.651736 22217 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
W20260709 12:26:45.653714 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.593278 23879 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:45.637718 23898 log.cc:927] Time spent T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:45.636018 23860 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.643078 23838 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.704690 22217 raft_consensus.cc:1275] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:45.704757 23860 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.706032 22217 raft_consensus.cc:1240] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:45.707067 23860 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:45.707253 22217 raft_consensus.cc:1240] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:26:45.709837 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.719729 22732 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:45.672938 22728 raft_consensus.cc:2410] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:45.676903 23930 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.639485 23663 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:26:45.698202 23922 log.cc:927] Time spent T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 12:26:45.670457 23918 log.cc:927] Time spent T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:26:45.652000 23862 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:45.728868 23317 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:45.736671 22731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35008 (request call id 437) took 1176 ms. Trace:
I20260709 12:26:45.747172 22220 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:26:45.729799 23832 consensus_queue.cc:1059] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:26:45.769551 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:45.716825 23679 consensus_queue.cc:1059] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:26:45.756232 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 74453.3us
I20260709 12:26:45.785655 23900 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.767985 22731 rpcz_store.cc:276] 0709 12:26:44.560101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.561580 (+  1479us) service_pool.cc:224] Handling call
0709 12:26:45.736433 (+1174853us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540053b6d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:45.736590 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231439616}
I20260709 12:26:45.796525 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:45.797319 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:45.798496 22064 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:45.799643 22137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.005s
I20260709 12:26:45.801261 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:45.714479 23684 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.803305 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:45.654172 23895 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.745756 23865 consensus_queue.cc:1059] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:26:45.806517 22036 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
W20260709 12:26:45.795073 23806 consensus_meta.cc:287] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
I20260709 12:26:45.804700 22111 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:45.800836 22137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.006s	sys 0.006s
W20260709 12:26:45.804557 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 294951us
I20260709 12:26:45.794144 23862 raft_consensus.cc:697] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:45.841324 23832 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.882336 22185 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:45.802959 23702 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:45.884164 22062 raft_consensus.cc:1240] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:45.841629 23804 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:45.883525 23833 consensus_meta.cc:287] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.011s
I20260709 12:26:45.804864 23900 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.841570 23806 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:45.912901 22145 raft_consensus.cc:1240] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:45.898437 23702 raft_consensus.cc:697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:45.903409 23804 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:45.940454 22064 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:45.944550 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:45.926112 23860 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.947077 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:45.949074 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 459465us
W20260709 12:26:45.969455 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.918706 23716 consensus_queue.cc:1059] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:26:45.981796 22217 raft_consensus.cc:1240] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:45.970077 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:45.984866 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:45.941788 23671 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.982378 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:45.944151 23870 consensus_meta.cc:287] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.001s
I20260709 12:26:45.983492 22184 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:45.965003 23930 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:45.990285 23930 raft_consensus.cc:697] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:45.965724 23860 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.949257 23709 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:45.946225 23862 consensus_queue.cc:237] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.939206 23933 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:45.948905 23775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.019s	sys 0.062s
I20260709 12:26:45.993417 22213 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:45.998908 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:46.003814 22219 raft_consensus.cc:1240] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:45.985026 23943 log.cc:927] Time spent T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:26:46.009974 22184 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:46.001591 23802 consensus_meta.cc:287] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.003s
I20260709 12:26:45.937692 23804 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:45.985662 23663 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.025063 22145 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:46.025226 23663 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:46.026019 23942 log.cc:927] Time spent T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:26:45.994164 22138 raft_consensus.cc:1275] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:45.999065 23870 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:26:46.008009 23775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.023s	sys 0.070s
I20260709 12:26:46.028772 22140 raft_consensus.cc:1240] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:45.999650 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:46.016543 23699 consensus_meta.cc:287] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.586s	user 0.004s	sys 0.008s
I20260709 12:26:46.031214 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:46.018460 23933 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:26:46.031816 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1690) took 1081 ms. Trace:
I20260709 12:26:45.993098 23860 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.037277 22137 rpcz_store.cc:276] 0709 12:26:44.950460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.950568 (+   108us) service_pool.cc:224] Handling call
0709 12:26:45.242654 (+292086us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:45.242842 (+   188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:45.243176 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.243201 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:45.243628 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:26:45.842683 (+599055us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:45.842740 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.842831 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:46.028365 (+185534us) raft_consensus.cc:1685] finished
0709 12:26:46.028382 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:46.031753 (+  3371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45405,"raft.queue_time_us":14340,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":76176,"spinlock_wait_cycles":4278144,"thread_start_us":598657,"threads_started":1,"wal-append.queue_time_us":664534}
I20260709 12:26:46.013005 23927 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:46.039093 22213 raft_consensus.cc:1275] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:46.002254 23671 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.041119 23671 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:45.991335 23930 consensus_queue.cc:237] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.041528 22728 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:46.041971 23684 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.037089 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:45.994640 22211 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.030128 23836 consensus_queue.cc:1059] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:26:46.018903 23934 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:46.046793 22213 raft_consensus.cc:1275] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:46.049945 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:46.051856 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.048473 23699 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:46.049139 23836 consensus_queue.cc:1059] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:26:46.054627 23836 raft_consensus.cc:3055] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:46.055058 23836 raft_consensus.cc:740] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:46.055977 23916 log.cc:927] Time spent T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.538s	user 0.000s	sys 0.003s
I20260709 12:26:46.056061 23836 consensus_queue.cc:260] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.029568 23802 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.065544 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:46.062202 23679 consensus_queue.cc:1048] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:46.068821 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.059854 23647 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:46.013443 23702 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.051697 23684 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:26:46.099653 22218 raft_consensus.cc:1240] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:46.098563 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.072397 23838 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:46.124424 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:46.126410 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.111629 23631 consensus_queue.cc:1059] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:26:46.128602 23940 log.cc:927] Time spent T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:26:46.136032 22069 raft_consensus.cc:1240] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:46.125110 22215 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:26:46.074683 23836 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.144001 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 300) took 1448 ms. Trace:
I20260709 12:26:46.144572 22065 rpcz_store.cc:276] 0709 12:26:44.695818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.695949 (+   131us) service_pool.cc:224] Handling call
0709 12:26:46.143131 (+1447182us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:46.143381 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:46.143587 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.143624 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:46.143678 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:46.143721 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.143792 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:46.143921 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12653824}
I20260709 12:26:46.071893 23699 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:26:46.070807 23774 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:26:46.188269 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:46.189217 23804 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:46.189635 23804 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.190100 23804 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:46.201048 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 127193us
I20260709 12:26:46.224678 23930 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:46.231089 23802 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.251371 23945 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:46.252043 23945 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:46.255260 23946 log.cc:927] Time spent T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:26:46.234946 23930 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.249972 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:46.269255 23773 raft_consensus.cc:3055] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:46.269733 23773 raft_consensus.cc:740] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:26:46.264745 23948 log.cc:927] Time spent T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:26:46.270453 23951 log.cc:927] Time spent T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:26:46.270694 23773 consensus_queue.cc:260] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.272114 23930 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.272114 23842 raft_consensus.cc:3055] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:46.273052 23842 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:46.258157 23838 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.278641 23773 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:46.280416 22734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35008 (request call id 443) took 1655 ms (client timeout 1715 ms). Trace:
W20260709 12:26:46.281032 22734 rpcz_store.cc:269] 0709 12:26:44.625384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.630930 (+  5546us) service_pool.cc:224] Handling call
0709 12:26:46.280117 (+1649187us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540046b4d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:46.280332 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941583232}
I20260709 12:26:46.283458 22212 raft_consensus.cc:1240] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:46.284385 22212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 255) took 1516 ms. Trace:
I20260709 12:26:46.290743 23945 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.261533 23961 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:46.303058 21963 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40564 (request call id 199) took 6209 ms. Trace:
I20260709 12:26:46.306759 22142 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:46.311208 22141 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.311789 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:59932 (request call id 952) took 2136 ms. Trace:
I20260709 12:26:46.312089 22141 rpcz_store.cc:276] 0709 12:26:44.175261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.453936 (+278675us) service_pool.cc:224] Handling call
0709 12:26:46.310655 (+1856719us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4c00393080. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e21cb5a20 00007f1e21cc6a29 00007f1e21cc713f 00007f1e21c8b2ab 00007f1e21cb8f3c 00007f1e21cb93fe 00007f1e21f4688b 00007f1e23945495 00007f1e2399630f 00007f1e239e0a55 00007f1e289b0cd0
0709 12:26:46.311707 (+  1052us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26296704}
I20260709 12:26:46.312023 23866 consensus_queue.cc:260] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.316344 23866 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.284822 22212 rpcz_store.cc:276] 0709 12:26:44.767951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.282725 (+1514774us) service_pool.cc:224] Handling call
0709 12:26:46.283202 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:46.284048 (+   846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.284312 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:46.319598 23957 log.cc:927] Time spent T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:46.318416 23675 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:46.329625 23802 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:46.328977 23804 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.337461 23802 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.318697 23842 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.339068 23842 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.309908 23961 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.334347 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.333467 22111 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.335417 21967 catalog_manager.cc:5697] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:26:46.335011 23675 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:46.349080 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.351509 23839 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:46.351634 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:46.353844 23949 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:46.354449 23949 raft_consensus.cc:697] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:46.355616 23949 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.355880 21967 catalog_manager.cc:5697] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.357791 21967 catalog_manager.cc:5697] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.360108 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.360586 22068 raft_consensus.cc:1275] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:46.362977 22064 raft_consensus.cc:1240] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:46.366159 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.359578 21967 catalog_manager.cc:5697] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 2, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:46.365231 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.368333 22064 raft_consensus.cc:2410] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:46.368038 21967 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.370139 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:46.369683 21967 catalog_manager.cc:5697] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 3 to 4, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 4 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:26:46.303488 21963 rpcz_store.cc:276] 0709 12:26:40.149398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.149828 (+   430us) service_pool.cc:224] Handling call
0709 12:26:46.302968 (+6153140us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:41.741794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:41.841830 (+100036us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:41.841909 (+    79us) write_op.cc:435] Acquired schema lock
0709 12:26:41.841946 (+    37us) tablet.cc:662] Decoding operations
0709 12:26:41.843054 (+  1108us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:41.843152 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:41.843181 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:26:42.016174 (+172993us) tablet.cc:701] Row locks acquired
0709 12:26:42.037752 (+ 21578us) write_op.cc:260] PREPARE: finished
0709 12:26:42.048670 (+ 10918us) write_op.cc:270] Start()
0709 12:26:42.085308 (+ 36638us) write_op.cc:276] Timestamp: P: 1783600002042886 usec, L: 0
0709 12:26:42.099219 (+ 13911us) op_driver.cc:348] REPLICATION: starting
0709 12:26:42.313033 (+213814us) log.cc:844] Serialized 3726 byte log entry
0709 12:26:43.340926 (+1027893us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e208df0ac 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b
0709 12:26:44.470591 (+1129665us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b18002fe8a0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e2742041d 00007f1e2742271a 00007f1e274226a8 00007f1e27422628 00007f1e274225e3 00007f1e274217fc 00007f1e298542f6 00007f1e2984eaa8 00007f1e239f5310
0709 12:26:44.470649 (+    58us) op_driver.cc:464] REPLICATION: finished
0709 12:26:44.571464 (+100815us) write_op.cc:301] APPLY: starting
0709 12:26:44.578222 (+  6758us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:44.613993 (+ 35771us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:44.621098 (+  7105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:44.644116 (+ 23018us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540032f354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e632a 00007f1e2396bf14 00007f1e2396bec3 00007f1e2396be38 00007f1e2396bdf3 00007f1e2396b0dc 00007f1e23994e16 00007f1e2397ccbb 00007f1e2396739d 00007f1e2396ad75
0709 12:26:44.709073 (+ 64957us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:44.709434 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:26:44.709503 (+    69us) write_op.cc:312] APPLY: finished
0709 12:26:44.709899 (+   396us) log.cc:844] Serialized 71 byte log entry
0709 12:26:44.833625 (+123726us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:44.841946 (+  8321us) write_op.cc:454] Released schema lock
0709 12:26:44.857683 (+ 15737us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:44.858098 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:44.858131 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1291,"reported_tablets":10,"spinlock_wait_cycles":5504,"child_traces":[["op",{"apply.queue_time_us":63653,"apply.run_cpu_time_us":14927,"apply.run_wall_time_us":298726,"num_ops":9,"prepare.queue_time_us":1052912,"prepare.run_cpu_time_us":27275,"prepare.run_wall_time_us":2093566,"raft.queue_time_us":79646,"raft.run_cpu_time_us":19959,"raft.run_wall_time_us":1059047,"replication_time_us":1763460,"spinlock_wait_cycles":734465920,"thread_start_us":2361988,"threads_started":5,"wal-append.queue_time_us":1257229,"wal-append.run_cpu_time_us":10631,"wal-append.run_wall_time_us":2206856}]]}
I20260709 12:26:46.372756 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.339584 23802 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.381240 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.382313 23699 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:46.382839 23699 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.383595 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:46.383929 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.384841 23699 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:46.383610 22219 raft_consensus.cc:1240] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:46.386195 23829 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:46.387270 22217 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:46.387456 23703 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:46.346227 23865 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.355631 23675 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.376576 21967 catalog_manager.cc:5697] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.390925 23684 raft_consensus.cc:3055] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:46.391515 23934 consensus_queue.cc:1059] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:46.392473 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.426875 22069 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
W20260709 12:26:46.427528 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.428572 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:46.393118 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:46.406162 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.407248 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.408917 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.410858 22111 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:46.388994 23807 raft_consensus.cc:3055] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:46.413723 22213 raft_consensus.cc:1240] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:46.390527 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.381326 23961 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.422326 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.421868 21967 catalog_manager.cc:5697] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.426771 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:46.398563 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.429136 22733 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.434441 22144 raft_consensus.cc:2393] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 2: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:46.440366 22068 raft_consensus.cc:1240] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:46.440920 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 50483.3us
I20260709 12:26:46.442840 22185 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:46.438812 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.412985 23660 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:46.413314 23841 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:46.455536 22185 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:46.458168 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.465363 22185 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:46.425822 23684 raft_consensus.cc:740] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:46.476095 23684 consensus_queue.cc:260] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.477442 23684 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.437573 23807 raft_consensus.cc:740] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:46.479214 23807 consensus_queue.cc:260] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.421383 23802 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:26:46.469184 23671 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:46.475239 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.442535 23964 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:46.487411 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.457561 23932 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:46.433980 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:46.461141 23804 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.471941 23660 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.426079 23865 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.451936 23862 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:46.502249 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:46.510937 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.513298 22185 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:46.507534 23962 log.cc:927] Time spent T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:26:46.508497 23671 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.524622 23671 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.526794 23671 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:46.508268 23699 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:46.527675 23699 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.528075 23699 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.528692 23895 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.533810 23660 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.536033 23865 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.522557 23932 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.543285 22211 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.470490 23841 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:46.549265 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 90784.9us
W20260709 12:26:46.557621 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:46.557520 22737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35006 (request call id 580) took 1614 ms (client timeout 1770 ms). Trace:
W20260709 12:26:46.558285 22737 rpcz_store.cc:269] 0709 12:26:44.942593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.947663 (+  5070us) service_pool.cc:224] Handling call
0709 12:26:46.556971 (+1609308us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54006829d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:46.557128 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392828672}
I20260709 12:26:46.554425 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.552049 22733 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:46.497717 23703 consensus_queue.cc:1059] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:26:46.579386 23776 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.595319 23841 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.581656 23860 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:46.607686 23860 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.584579 23671 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:46.606665 23932 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:46.610435 23671 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.612473 23671 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:46.609866 23860 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:46.618064 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 95451.2us
I20260709 12:26:46.631387 23699 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.632633 23663 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.634696 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.639331 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:46.646435 22211 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:46.646813 22216 raft_consensus.cc:1240] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:46.650591 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.651844 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.654475 22733 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:46.655166 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.655964 22734 raft_consensus.cc:2368] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:46.656358 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37716 (request call id 1885) took 1396 ms. Trace:
I20260709 12:26:46.657444 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:46.657255 22211 rpcz_store.cc:276] 0709 12:26:45.259626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.271945 (+ 12319us) service_pool.cc:224] Handling call
0709 12:26:45.994237 (+722292us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54001dc7a0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e2396706f 00007f1e239dff60 00007f1e239e17de 00007f1e239ed27c 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2
0709 12:26:46.542847 (+548610us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b58001c94d0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239450aa 00007f1e239c7447 00007f1e239dffe7 00007f1e239e17de 00007f1e239ed27c 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c
0709 12:26:46.656268 (+113421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736339072}
I20260709 12:26:46.658236 22732 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:46.659264 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:46.660279 22211 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:46.660547 23842 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:46.661906 22036 leader_election.cc:400] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
W20260709 12:26:46.662694 23923 log.cc:927] Time spent T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 1.145s	user 0.000s	sys 0.010s
I20260709 12:26:46.656586 22212 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:46.667124 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.666574 22212 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:46.690465 22215 raft_consensus.cc:1275] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:46.693032 23675 raft_consensus.cc:3055] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:46.699653 22216 raft_consensus.cc:1240] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:46.690454 23813 raft_consensus.cc:3055] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:46.697388 23675 raft_consensus.cc:740] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:46.727840 23813 raft_consensus.cc:740] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:46.740267 23716 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.728286 23684 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:46.740818 23813 consensus_queue.cc:260] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.741964 23813 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.741145 23684 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.745430 23913 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.746030 23913 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.746474 23699 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.747510 22729 raft_consensus.cc:2410] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:26:46.740819 23716 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.749740 23675 consensus_queue.cc:260] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.750999 23675 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.752357 23716 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:46.761960 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.755376 23684 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.758224 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.758986 23927 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:46.768635 23927 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.769639 22729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34992 (request call id 443) took 1385 ms. Trace:
I20260709 12:26:46.770102 22729 rpcz_store.cc:276] 0709 12:26:45.383862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.384457 (+   595us) service_pool.cc:224] Handling call
0709 12:26:46.769415 (+1384958us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54007a0154. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:46.769567 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3123459968}
I20260709 12:26:46.771468 23927 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.775538 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 261) took 1465 ms. Trace:
I20260709 12:26:46.775949 22211 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:26:46.779850 22070 raft_consensus.cc:1240] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:46.783756 23806 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.775987 22218 rpcz_store.cc:276] 0709 12:26:45.309802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.309942 (+   140us) service_pool.cc:224] Handling call
0709 12:26:45.310223 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:46.100197 (+789974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.775316 (+675119us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54004006d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:46.775479 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774780160}
W20260709 12:26:46.753371 23979 log.cc:927] Time spent T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:26:46.760238 22732 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:26:46.796433 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:46.797108 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.798406 23838 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:46.798956 23838 raft_consensus.cc:697] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:46.799839 23838 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.800222 23900 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:46.801332 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 310901us
W20260709 12:26:46.803655 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.806010 23945 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.806646 23945 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.808658 23945 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.809130 23895 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.809638 23895 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.809928 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.811617 23895 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.815131 23865 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:46.816282 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:46.812220 23895 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.823052 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:46.818005 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.819136 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.820602 23913 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.834510 23684 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:46.839105 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.840180 22733 raft_consensus.cc:2393] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:46.837422 23684 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.849813 22146 raft_consensus.cc:1275] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:46.852408 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.853255 22139 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:46.855283 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.857100 22701 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:46.859285 22142 raft_consensus.cc:1240] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:46.860599 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 279401us
I20260709 12:26:46.862380 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 965) took 1464 ms. Trace:
I20260709 12:26:46.862521 22733 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:46.862811 22140 rpcz_store.cc:276] 0709 12:26:45.397681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.397807 (+   126us) service_pool.cc:224] Handling call
0709 12:26:46.028524 (+630717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.030293 (+  1769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.862191 (+831898us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400141ed0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:46.862324 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449712000}
I20260709 12:26:46.863768 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:46.864424 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:46.865001 22733 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.865056 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:46.865837 22071 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.866045 22068 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:46.869519 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.869885 22143 raft_consensus.cc:1240] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:46.874347 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.875160 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:46.881143 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 64927.6us
I20260709 12:26:46.881706 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.881302 22068 raft_consensus.cc:1240] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:46.884202 22111 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:46.883008 22063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54728 (request call id 1860) took 1083 ms. Trace:
W20260709 12:26:46.884912 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.885963 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:46.887348 22220 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:46.885707 22063 rpcz_store.cc:276] 0709 12:26:45.799704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.799813 (+   109us) service_pool.cc:224] Handling call
0709 12:26:46.825081 (+1025268us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4e9c 00007f1e208c4a5b 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:46.825270 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:46.825464 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:46.837099 (+ 11635us) log.cc:844] Serialized 14 byte log entry
0709 12:26:46.882675 (+ 45576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:46.882722 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:46.882759 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.882821 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:46.882939 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11982,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":10350208,"thread_start_us":45154,"threads_started":1}
W20260709 12:26:46.888294 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.888375 22733 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:46.891356 22185 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.838827 22732 raft_consensus.cc:2376] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7. Re-sending same reply.
I20260709 12:26:46.895215 23317 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.895303 22702 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:46.894236 22140 raft_consensus.cc:1240] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:46.861001 23702 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:46.832691 23895 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.869542 23716 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:46.895982 23317 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.928365 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:46.935622 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:46.939678 22071 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:46.893991 23832 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:46.897619 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.898092 23837 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.899293 23964 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:46.893887 23927 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:46.953451 22185 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:46.898990 23716 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.932464 23909 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:46.955416 22139 raft_consensus.cc:1275] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:46.972162 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.956939 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.973886 22140 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:46.895006 23687 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:46.956269 22111 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.943573 23944 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:46.975121 23687 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.967159 23832 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:46.979890 23832 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.959208 22137 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:46.980885 22142 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:46.982093 22185 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.965015 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:46.928645 23945 consensus_queue.cc:1059] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:26:46.932541 23961 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:46.930285 23702 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:46.995724 22111 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.996647 23702 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.997278 23702 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:46.997946 23944 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:46.981953 23554 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:46.970860 23716 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.001847 23945 raft_consensus.cc:3055] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:47.002250 23945 raft_consensus.cc:740] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:47.003436 23837 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:47.003131 23945 consensus_queue.cc:260] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.006580 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:47.007812 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.982240 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:46.987584 23989 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:46.991941 23684 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:46.992411 23961 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.028795 23961 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:46.956656 23896 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.029596 23896 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:46.993080 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:46.983774 22146 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
W20260709 12:26:46.985416 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 53981.4us
I20260709 12:26:47.018297 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:46.990008 23990 log.cc:927] Time spent T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:26:47.021418 23534 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:47.018923 23554 raft_consensus.cc:697] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:47.041834 23554 consensus_queue.cc:237] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.042529 22217 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:47.010279 23687 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.044799 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:47.025453 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:47.046181 23927 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:47.046540 23927 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:47.046902 23927 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.050581 23702 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:47.051225 23702 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.036903 23660 consensus_queue.cc:1048] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:47.054006 23807 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.026319 23836 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:46.989621 23987 log.cc:927] Time spent T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:26:46.956980 23697 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:26:47.057219 23699 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:47.037415 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:47.040748 23534 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:47.057962 23631 consensus_queue.cc:1048] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:47.058537 23534 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.060084 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:47.060362 23895 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.039839 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:47.061139 23702 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:47.033406 23774 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:47.024603 23716 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.070879 23716 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:47.036233 22702 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:47.025346 23838 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:47.042196 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:47.077947 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:47.078678 22137 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:47.033764 23945 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.083168 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:47.083971 22146 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.080360 22035 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:47.085980 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:47.088290 22143 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:47.074150 23938 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.094992 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:47.097338 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:47.097566 22071 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:47.099079 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:47.032653 23896 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.102907 22213 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:47.111125 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:47.041855 23663 consensus_queue.cc:1059] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:26:47.082792 22211 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:47.113945 23843 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:47.120116 22734 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:26:47.100063 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:47.123068 22146 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:47.103767 23895 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:47.103789 23647 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:47.124229 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:47.087303 23684 consensus_queue.cc:1059] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:26:47.128826 22701 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:47.129196 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:47.130627 22733 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:47.134462 22733 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:26:47.134941 22733 pending_rounds.cc:85] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Aborting all ops after (but not including) 4
I20260709 12:26:47.135242 22733 pending_rounds.cc:107] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:26:47.135542 22733 raft_consensus.cc:2889] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:47.138484 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:47.100745 23976 consensus_queue.cc:1059] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:26:47.148984 22219 raft_consensus.cc:1240] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:47.149811 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:47.159101 22702 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:47.164325 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:47.165839 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 66451.3us
I20260709 12:26:47.168884 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:47.132099 23996 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.115164 23938 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.139779 23997 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:47.185966 23684 raft_consensus.cc:3055] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:47.187943 22729 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:47.188126 23684 raft_consensus.cc:740] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:47.203997 22216 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:47.204418 22111 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:47.180892 23776 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:47.211431 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44888.3us
I20260709 12:26:47.181102 23716 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:47.175583 23631 consensus_queue.cc:1059] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:47.181545 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:47.226862 22035 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:47.239142 23828 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.244066 23828 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.213292 23964 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:47.215364 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:47.187367 23534 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.227401 23776 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.181308 23996 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.189031 23684 consensus_queue.cc:260] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.204797 23997 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:47.267534 22215 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:47.229851 23897 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:26:47.267805 24005 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:47.230118 23663 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:26:47.278285 22070 raft_consensus.cc:1240] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:47.263573 23995 log.cc:927] Time spent T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:26:47.219295 23687 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:26:47.259832 23965 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:47.259631 23776 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.280869 23828 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.295680 22733 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:47.253818 23927 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.337251 23534 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:47.310534 23684 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:47.404238 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 143556us
I20260709 12:26:47.407732 22035 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:47.322933 23842 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:26:47.477377 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 68129.3us
I20260709 12:26:47.480104 22137 raft_consensus.cc:1275] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:47.480702 22137 pending_rounds.cc:85] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 1
I20260709 12:26:47.481005 22137 pending_rounds.cc:107] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:47.481302 22137 raft_consensus.cc:2889] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:47.472671 24003 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:47.474367 23998 log.cc:927] Time spent T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:26:47.471350 23938 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:47.474423 23841 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:47.495721 24003 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:47.509528 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:47.512250 24000 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.241s	user 0.000s	sys 0.002s
W20260709 12:26:47.515781 24009 log.cc:927] Time spent T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:26:47.404537 23997 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:47.517843 24006 log.cc:927] Time spent T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:26:47.514657 24003 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.526084 22036 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:47.502553 23841 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.522563 23996 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.534977 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:47.535748 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:47.535753 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.524227 23927 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:47.536521 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:47.537871 22064 raft_consensus.cc:1240] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:47.536607 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:47.539069 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:47.540246 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:47.542155 22065 raft_consensus.cc:2393] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:47.543001 24016 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:26:47.555214 23965 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.541153 23663 consensus_queue.cc:1059] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:26:47.557731 24012 log.cc:927] Time spent T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:26:47.563653 22063 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:47.570132 24019 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:47.585039 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:47.587342 23841 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.587944 23900 raft_consensus.cc:3055] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:47.588481 23900 raft_consensus.cc:740] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:47.566053 23663 raft_consensus.cc:3055] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:47.555871 23965 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.595531 24019 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.593071 23534 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:47.595872 23663 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:47.620733 24011 log.cc:927] Time spent T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:47.625849 23534 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.630230 23663 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.631793 23663 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.635295 23965 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:47.613816 23945 consensus_meta.cc:287] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.001s
I20260709 12:26:47.611685 23900 consensus_queue.cc:260] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.695811 23900 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.636545 24019 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.698143 23776 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.699600 22734 raft_consensus.cc:2368] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:47.713294 24019 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.718326 23996 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.718925 23996 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:47.724841 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:47.725018 23534 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:47.735849 23996 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.746675 23776 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.749675 24003 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.807379 22139 raft_consensus.cc:1240] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:47.926047 24003 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:47.926256 22145 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:26:47.938966 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:47.961573 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.987370 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:48.015489 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:48.016525 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 212463us
I20260709 12:26:48.017666 24003 consensus_queue.cc:1048] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:48.018101 24022 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.018700 24022 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:47.978010 23997 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:48.028229 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:48.032819 22111 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:48.027828 23997 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:48.073446 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.062821 23900 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
W20260709 12:26:48.095336 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.105706 24024 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.106685 24024 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.107263 24024 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.097498 23663 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.115037 24027 consensus_queue.cc:1059] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:26:48.115872 23663 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.090847 24013 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:48.110303 23900 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.119580 24022 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:48.141263 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.023s
W20260709 12:26:48.141781 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.014s	sys 0.023s
I20260709 12:26:48.165572 24021 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.163772 23813 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:48.166185 24021 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.167071 23813 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.168805 24021 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.169202 23996 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:48.143024 24005 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.182318 24022 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:48.129427 24013 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:48.194762 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 130235us
W20260709 12:26:48.196084 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 77126.8us
I20260709 12:26:48.184823 23996 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.193044 24019 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.205776 23534 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.198230 23813 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:48.204612 24024 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.209368 23965 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.247668 23965 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.249951 24013 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.250249 23965 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.225878 24019 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.252863 24019 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.221865 23534 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.239256 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1707) took 1283 ms. Trace:
W20260709 12:26:48.240136 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 43823.3us
I20260709 12:26:48.260847 22140 rpcz_store.cc:276] 0709 12:26:46.955716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.974476 (+ 18760us) service_pool.cc:224] Handling call
0709 12:26:46.974767 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.005123 (+ 30356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:47.005155 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:47.005225 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:47.005255 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.238980 (+1233725us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b54000d6bd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:48.239032 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.239191 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69326208}
I20260709 12:26:48.226531 24027 raft_consensus.cc:3055] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:48.262419 22111 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:48.236647 23806 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:48.213589 24016 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.193781 24005 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.254663 23996 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.230877 23997 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.194644 24022 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.255904 23900 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.264961 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:48.265967 23806 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.268205 23663 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.266105 23944 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.267385 24024 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:26:48.270012 24022 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.271070 23944 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:48.267328 24016 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.272121 23534 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.273687 24016 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.270874 24005 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.263633 24027 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:48.274767 23944 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:26:48.276647 24024 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.295672 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.296028 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:48.296420 22140 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
W20260709 12:26:48.297185 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 1.12112e+06us
I20260709 12:26:48.283766 24035 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.300006 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:48.301644 22111 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:48.284070 24030 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.303500 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.304769 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.304425 22066 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:48.305419 22063 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:48.305846 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48062 (request call id 331) took 1422 ms. Trace:
I20260709 12:26:48.306348 22066 rpcz_store.cc:276] 0709 12:26:46.883825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.884768 (+   943us) service_pool.cc:224] Handling call
0709 12:26:48.303302 (+1418534us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:48.305769 (+  2467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12074880}
I20260709 12:26:48.317741 22218 raft_consensus.cc:1240] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:48.317874 23697 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:48.318701 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:48.318619 23697 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.320178 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.320987 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.304405 23803 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:48.322120 23697 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:48.322103 23803 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.323127 23697 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.324036 23697 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.326020 23989 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:48.326555 23989 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.327308 23697 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.328599 23989 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.323196 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:48.299363 24027 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.329972 24027 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.318773 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.333683 22218 raft_consensus.cc:2393] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:48.335878 22734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35006 (request call id 599) took 1212 ms. Trace:
I20260709 12:26:48.336468 22734 rpcz_store.cc:276] 0709 12:26:47.123010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.127581 (+  4571us) service_pool.cc:224] Handling call
0709 12:26:48.335631 (+1208050us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54006829d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:48.335800 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052190976}
I20260709 12:26:48.295188 24024 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.341478 23829 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.352880 23988 raft_consensus.cc:3055] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:48.353432 23988 raft_consensus.cc:740] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:48.354444 23988 consensus_queue.cc:260] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.307966 24030 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:48.368638 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 67086.9us
I20260709 12:26:48.369293 24030 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.357800 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1917) took 1327 ms. Trace:
I20260709 12:26:48.370157 22219 rpcz_store.cc:276] 0709 12:26:47.030429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.030590 (+   161us) service_pool.cc:224] Handling call
0709 12:26:47.030933 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.152272 (+121339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.357453 (+1205181us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540002d0d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:48.357717 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270894464}
I20260709 12:26:48.359543 24024 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.351578 23829 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.390833 23675 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.391537 23675 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.392545 23829 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.303660 24035 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.324867 23803 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.374788 22212 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:48.375633 23897 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.414160 24030 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.446664 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.447819 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:48.451164 23832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.021s	sys 0.039s
I20260709 12:26:48.451002 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:48.451566 23832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.021s	sys 0.039s
I20260709 12:26:48.451048 22146 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
W20260709 12:26:48.453445 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 136873us
I20260709 12:26:48.454388 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.442963 23988 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.457597 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.459754 22141 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:48.444820 23944 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:48.465459 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.446072 23675 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.472877 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.458590 24037 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.444612 23897 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.466727 23938 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:48.487740 22184 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:48.488716 22035 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:48.494131 22035 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:48.495285 23534 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:48.495678 23534 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.496001 23534 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.474242 23832 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:48.497143 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.499230 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.482088 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.503297 22184 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:48.466536 23554 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:48.507704 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.498003 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.509234 22137 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:48.510195 23832 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.508737 22141 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:48.471050 23927 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:48.514398 22218 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:48.489501 23675 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.489607 24024 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:48.523590 24024 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.523509 23675 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.493089 23697 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.521721 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 59183.6us
I20260709 12:26:48.522915 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:48.528645 23697 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.529234 22185 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:48.528971 23675 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.505292 24022 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:48.530817 24022 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:48.530990 23697 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:48.531316 24022 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.532416 24024 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.533331 24024 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.533723 23826 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.533888 24024 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.534332 23826 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.535980 22731 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:48.537652 22184 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:48.533447 24041 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:48.538589 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.501760 24042 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:48.539420 23961 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.539829 23897 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.501777 23941 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.541388 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.542524 22729 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:26:48.543156 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.544344 24040 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.501876 23802 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.545324 24035 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.546527 24022 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.547091 23832 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.547694 24055 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.515657 23554 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.551697 22218 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:48.492110 24037 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.498620 23938 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.471707 23944 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.556308 23976 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.570998 24016 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:48.585919 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.577790 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.571131 23897 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.595664 23897 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.596642 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.598030 23897 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.548547 23927 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.576869 24041 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:48.598371 24037 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.598830 24041 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.599012 22111 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:48.599284 24041 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:48.574780 23803 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:48.603178 22111 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:48.591478 22217 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:48.559279 24042 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.594025 24016 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.567516 23961 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.577721 22728 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:48.604125 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.616127 22218 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:48.606266 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:48.589716 23534 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.612450 23317 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.619992 23317 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:48.620370 23317 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.620679 23317 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.585430 24035 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.612342 24008 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.595688 23826 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.585994 24055 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:48.674633 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 145489us
I20260709 12:26:48.613641 23832 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.581609 23802 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.682124 23534 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:48.670706 24045 log.cc:927] Time spent T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:26:48.689695 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 86624.4us
I20260709 12:26:48.690932 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:48.572786 23941 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.628154 24008 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.682826 24024 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.701231 23317 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.629089 23897 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:26:48.600442 23976 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.680531 23826 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:48.679903 24035 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.692632 23832 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:48.720659 23317 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.722398 22111 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:48.722977 24059 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.724830 24055 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.706485 24037 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.711998 24040 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.713322 24056 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.727353 24024 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:48.743960 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 68537.1us
I20260709 12:26:48.746115 22185 leader_election.cc:400] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:48.746630 22185 leader_election.cc:403] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:26:48.740141 23944 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.717801 24053 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:48.749722 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:48.756049 22218 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.751453 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.753715 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.756940 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1925) took 1585 ms. Trace:
I20260709 12:26:48.757522 22220 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:48.757889 22733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34992 (request call id 457) took 1617 ms. Trace:
I20260709 12:26:48.758304 22733 rpcz_store.cc:276] 0709 12:26:47.140088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.140246 (+   158us) service_pool.cc:224] Handling call
0709 12:26:47.140650 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.319767 (+179117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.757159 (+1437392us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400690354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:48.757830 (+   671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355495168}
I20260709 12:26:48.757027 22217 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:48.761658 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:48.754441 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.771587 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.771493 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.772528 22066 raft_consensus.cc:2368] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:48.757412 22213 rpcz_store.cc:276] 0709 12:26:47.171322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.171415 (+    93us) service_pool.cc:224] Handling call
0709 12:26:47.171766 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:48.298824 (+1127058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:48.298856 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:48.307874 (+  9018us) log.cc:844] Serialized 52 byte log entry
0709 12:26:48.448694 (+140820us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:48.448787 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.448979 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.756724 (+307745us) raft_consensus.cc:1685] finished
0709 12:26:48.756746 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.756886 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1119912,"raft.queue_time_us":1122660,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5983,"thread_start_us":102267,"threads_started":1,"wal-append.queue_time_us":234192}
I20260709 12:26:48.773079 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.744323 24024 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.759577 24055 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:48.782406 22063 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:48.745936 23554 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:48.738559 23832 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.741578 24059 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.736972 23826 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.789921 22218 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:48.790748 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.794584 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.766083 24053 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.821905 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.795548 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.822472 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.823040 22213 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:48.796057 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.796765 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.774883 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.798267 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.766691 24057 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.787801 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.789692 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.799655 24005 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.800729 23989 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.800967 23534 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:48.833496 22733 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:48.833528 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.834347 22068 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:48.835649 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.836942 22146 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:48.784085 24024 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:48.829577 24051 log.cc:927] Time spent T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:26:48.809594 24016 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.828017 23938 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:48.744509 24040 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.811349 23802 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.816442 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.817296 23663 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.824015 22735 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:48.797570 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.851905 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.759249 24037 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.857188 22735 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:48.827795 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.858119 22065 raft_consensus.cc:2393] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:48.836305 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.786052 24055 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.938422 23317 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.831871 22063 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:48.805126 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.808813 24035 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.839943 22068 raft_consensus.cc:1240] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:48.840992 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.842278 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.769974 24022 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.850929 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.977559 22146 raft_consensus.cc:2393] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:48.826309 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.859494 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:48.860074 22185 leader_election.cc:400] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:48.859525 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:48.978353 22185 leader_election.cc:403] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:48.856201 22111 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:26:48.978917 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 118991us
I20260709 12:26:48.832434 22215 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
W20260709 12:26:48.849758 24047 log.cc:927] Time spent T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:26:48.799321 23900 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:48.939137 23317 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.938416 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:48.956348 24055 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.957289 24037 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.937884 23663 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.958242 23832 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.837755 22729 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:48.844518 23961 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.959790 24053 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.960332 23941 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.961437 24041 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:48.963740 24027 consensus_meta.cc:287] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.005s
I20260709 12:26:48.979442 22734 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:48.977610 22064 raft_consensus.cc:2393] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
W20260709 12:26:48.979168 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 123078us
I20260709 12:26:48.830634 22217 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:48.968880 24042 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.838047 24005 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:48.978415 22220 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:48.980325 22185 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:48.987164 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.841948 23989 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:48.994016 22142 raft_consensus.cc:2393] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:48.993940 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:48.969519 24040 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:48.977340 24016 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.986552 24035 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.003808 23317 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.985957 23775 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:48.990432 23802 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.980137 23976 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:48.964416 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.034179 22066 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:49.013903 22070 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:49.015879 22111 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:49.035825 22111 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:49.036844 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:49.020783 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 218428us
I20260709 12:26:49.001435 23826 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:48.991557 23938 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:26:49.009052 24008 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.033257 22071 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:48.996680 23900 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.033496 23775 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.040288 23806 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.041679 23989 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.043344 24005 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.029312 24035 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.049301 24059 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.044919 24041 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:49.044996 24057 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:49.058653 22111 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:26:49.046651 24046 log.cc:927] Time spent T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.478s	user 0.003s	sys 0.002s
I20260709 12:26:49.048372 24037 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:49.029728 24016 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.040329 22138 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:26:49.083431 23699 raft_consensus.cc:2764] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:49.048678 23663 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.097015 22111 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:49.049384 23961 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:49.085594 24061 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:49.119187 23961 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.121587 23961 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.122126 23961 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:49.122627 23961 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.123737 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.125105 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.126240 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.126760 22139 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:49.127351 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.093472 24035 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.128508 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:49.129107 22142 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.102829 24037 raft_consensus.cc:697] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:49.131294 24037 consensus_queue.cc:237] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.047767 24063 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:49.101740 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 83923.9us
I20260709 12:26:49.133720 22137 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:49.134006 24063 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:49.134474 24063 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.134835 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.135895 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.137703 24057 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:49.138123 23699 consensus_queue.cc:1059] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:49.089148 24022 consensus_queue.cc:1059] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:26:49.098678 23806 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.139408 23806 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.139855 23806 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.098932 23989 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.140923 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.141314 23989 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.108574 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37716 (request call id 1919) took 2071 ms. Trace:
I20260709 12:26:49.142552 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.106637 23775 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.103145 23317 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:49.143380 22064 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:49.143803 23317 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.144266 23317 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.141680 22734 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:49.142264 22216 rpcz_store.cc:276] 0709 12:26:47.036899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.037040 (+   141us) service_pool.cc:224] Handling call
0709 12:26:49.108406 (+2071366us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400096ad4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:49.108515 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334878976}
I20260709 12:26:49.138334 24057 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.147578 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.148012 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.149838 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.164925 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:49.098922 22138 pending_rounds.cc:85] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 4
W20260709 12:26:49.153071 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.165517 22063 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:49.167912 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.169194 22142 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:49.165485 22068 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:49.150990 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.151873 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.164229 22064 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:49.172353 22065 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:26:49.180454 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.181182 22737 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:26:49.182703 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.183483 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:49.183647 22730 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:49.182953 24066 raft_consensus.cc:3055] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:49.182299 22063 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:49.184968 22185 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:49.185509 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.192193 23938 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:49.192800 23938 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:49.193328 23938 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.185684 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.196138 23961 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.186841 24067 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:26:49.191224 22185 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:49.200932 22217 raft_consensus.cc:1240] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:49.203685 22185 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.204687 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:49.205328 22064 raft_consensus.cc:3060] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.205197 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.207456 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.208274 22068 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:49.169039 24057 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.170936 22138 pending_rounds.cc:107] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:26:49.211102 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.214197 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.212450 22185 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.215253 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.169243 24071 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.182772 23976 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:49.216140 22185 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.221074 22185 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.217255 23317 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.216699 24042 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:49.185269 23775 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.225757 23317 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.177680 23699 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:49.226439 22701 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:49.186595 24041 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.228796 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.225663 24071 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.229785 24042 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.229880 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.233961 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.185019 24066 raft_consensus.cc:740] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:49.257910 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.309588 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:49.406165 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 309182us
I20260709 12:26:49.213335 24059 raft_consensus.cc:2804] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:49.418440 22071 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:49.295269 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.253993 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:49.250604 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.213186 23941 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:49.393296 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.495040 22065 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:49.495153 22218 raft_consensus.cc:2393] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:49.292896 22064 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:49.423306 22063 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:49.418481 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.425405 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.426978 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.428879 23938 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:49.331768 24054 log.cc:927] Time spent T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.739s	user 0.000s	sys 0.005s
I20260709 12:26:49.403837 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:49.504822 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.348263 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:49.505527 22212 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:49.506541 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:49.507099 22212 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.335955 24072 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:49.431265 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.508731 24072 raft_consensus.cc:697] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:26:49.494012 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 198822us
I20260709 12:26:49.418689 22143 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:49.497354 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.232923 23805 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.498627 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.510629 22219 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:49.452733 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:49.347615 24028 log.cc:927] Time spent T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 1.387s	user 0.002s	sys 0.015s
I20260709 12:26:49.508778 22214 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:49.512955 22141 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:49.515842 23534 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:49.526051 23534 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.325244 23803 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:49.218806 22138 raft_consensus.cc:2889] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:49.252766 23837 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:49.542757 23837 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:49.543282 23837 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.524479 22035 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.546598 22215 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:49.546705 23647 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:49.547222 23647 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:49.547595 23647 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.548010 22212 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:49.550525 24057 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.552636 24057 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.554040 24016 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.555778 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.556005 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.557268 24072 consensus_queue.cc:237] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:49.480566 22111 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.68:44299 timed out after 1.780s (SENT) [suppressed 10 similar messages]
I20260709 12:26:49.492620 24042 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.242955 23900 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.343459 23663 raft_consensus.cc:3055] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:49.294163 23716 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.562884 22213 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:49.241819 23989 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.375509 24019 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.497059 22142 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:49.254637 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.335167 23806 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.240511 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.531878 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.598460 22216 raft_consensus.cc:2393] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:49.497936 23842 raft_consensus.cc:2764] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:49.531327 23805 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.497834 24061 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.599484 23716 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.601891 24061 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.602391 23938 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.602911 23805 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.603253 23716 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:49.603657 22728 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:49.604013 24061 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.492651 24059 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:49.498724 23941 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.604671 23716 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.604851 23941 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.237000 24024 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.605402 22066 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:26:49.605810 22066 pending_rounds.cc:85] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Aborting all ops after (but not including) 6
I20260709 12:26:49.606043 22066 pending_rounds.cc:107] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:26:49.606293 22066 raft_consensus.cc:2889] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:49.607143 24024 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.607674 24019 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.608866 22145 raft_consensus.cc:1240] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:49.604667 24059 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.609754 24019 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.309019 23775 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.613286 23716 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.587658 23534 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.500583 23776 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:49.614673 23776 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.614804 23775 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.615203 23776 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.616688 23806 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.511933 23802 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:49.257226 23976 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.618767 23976 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.620398 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1934) took 1098 ms. Trace:
I20260709 12:26:49.521015 24071 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:49.621417 23941 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.624648 24059 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.625937 22217 raft_consensus.cc:1240] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:49.627700 23647 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.628225 24059 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.630366 23647 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.632181 23716 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.634969 23927 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:49.639693 24066 consensus_queue.cc:260] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.641376 24066 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.643844 21967 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48106 (request call id 274) took 7351 ms. Trace:
I20260709 12:26:47.468556 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.563915 23803 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:49.494386 23699 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:49.659266 22036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.006s	sys 0.027s
I20260709 12:26:49.585721 23663 raft_consensus.cc:740] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:49.654529 24063 consensus_meta.cc:287] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 12:26:49.637576 23776 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:49.662755 22036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.006s	sys 0.027s
W20260709 12:26:49.693674 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 609802us
I20260709 12:26:49.694432 22036 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:49.663707 23803 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.651109 21967 rpcz_store.cc:276] 0709 12:26:42.316749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.529886 (+213137us) service_pool.cc:224] Handling call
0709 12:26:44.193079 (+1663193us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540032f354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23953090 00007f1e239f1f3a 00007f1e297a7e9c 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:49.643765 (+5450686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:46.625772 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:46.626713 (+   941us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:46.626747 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:26:46.626765 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:46.638365 (+ 11600us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:46.638456 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:46.638494 (+    38us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:26:46.639279 (+   785us) tablet.cc:701] Row locks acquired
0709 12:26:46.639300 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:26:46.639464 (+   164us) write_op.cc:270] Start()
0709 12:26:46.639599 (+   135us) write_op.cc:276] Timestamp: P: 1783600006639409 usec, L: 0
0709 12:26:46.639623 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:26:46.678979 (+ 39356us) log.cc:844] Serialized 3224 byte log entry
0709 12:26:47.085645 (+406666us) op_driver.cc:464] REPLICATION: finished
0709 12:26:47.153804 (+ 68159us) write_op.cc:301] APPLY: starting
0709 12:26:47.173220 (+ 19416us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:47.185598 (+ 12378us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:47.245238 (+ 59640us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:47.248276 (+  3038us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:47.248490 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:26:47.248542 (+    52us) write_op.cc:312] APPLY: finished
0709 12:26:47.248826 (+   284us) log.cc:844] Serialized 65 byte log entry
0709 12:26:47.249010 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:47.249142 (+   132us) write_op.cc:454] Released schema lock
0709 12:26:47.249213 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:47.249594 (+   381us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:47.249628 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":304364,"reported_tablets":14,"spinlock_wait_cycles":2527684480,"child_traces":[["op",{"apply.queue_time_us":55345,"apply.run_cpu_time_us":4006,"apply.run_wall_time_us":105700,"num_ops":8,"prepare.queue_time_us":147360,"prepare.run_cpu_time_us":42873,"prepare.run_wall_time_us":123279,"raft.queue_time_us":201968,"raft.run_cpu_time_us":3572,"raft.run_wall_time_us":125688,"replication_time_us":399084,"spinlock_wait_cycles":443776,"thread_start_us":280939,"threads_started":4,"wal-append.queue_time_us":115812,"wal-append.run_cpu_time_us":21652,"wal-append.run_wall_time_us":1451789}]]}
I20260709 12:26:49.695827 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:49.701988 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 475591us
W20260709 12:26:49.688239 24055 consensus_meta.cc:287] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.008s
W20260709 12:26:49.665990 22733 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.026s
W20260709 12:26:49.726141 22733 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.006s	sys 0.026s
I20260709 12:26:49.702318 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:49.696636 23965 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:49.620801 22211 rpcz_store.cc:276] 0709 12:26:48.522044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.536574 (+ 14530us) service_pool.cc:224] Handling call
0709 12:26:49.554585 (+1018011us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:49.554809 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.620018 (+ 65209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.620059 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:49.620106 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:49.620145 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.620212 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.620333 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34514,"raft.queue_time_us":41609,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":21594,"spinlock_wait_cycles":10861440}
W20260709 12:26:49.704859 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 483856us
I20260709 12:26:49.733891 22185 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.686643 24063 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:49.735632 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.734763 22185 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.737687 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.738885 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.739624 22071 raft_consensus.cc:2393] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:49.743568 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:49.744180 22735 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.744313 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.746222 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:49.743618 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.738363 22731 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 1.
I20260709 12:26:49.747563 22217 raft_consensus.cc:2368] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3.
I20260709 12:26:49.736128 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.748500 22064 raft_consensus.cc:2393] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:49.748852 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.749122 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.750784 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.746798 22071 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.752635 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:49.756731 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.756774 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:49.760093 22219 raft_consensus.cc:2368] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3.
I20260709 12:26:49.754931 23554 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:49.736759 24022 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:26:49.735487 23775 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:26:49.840855 22185 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:49.843637 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.845230 24058 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.729108 23663 consensus_queue.cc:260] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.847043 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.848809 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.911005 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.927084 22065 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:49.705736 24055 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.926333 23832 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.932863 22140 raft_consensus.cc:2368] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:49.932552 23832 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.933426 22062 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:26:49.933630 24055 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.726490 24026 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:49.735241 23660 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:49.755100 24062 raft_consensus.cc:2804] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:49.728678 22702 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:49.935004 23832 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.935178 24062 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.935562 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:49.935737 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 207125us
I20260709 12:26:49.935943 24086 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:49.936285 22065 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.936839 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.861137 22735 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:49.942556 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.943485 22735 raft_consensus.cc:2393] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:49.869616 22071 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:49.944535 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:49.869779 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 323309us
W20260709 12:26:49.869890 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 389351us
I20260709 12:26:49.945711 22065 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
W20260709 12:26:49.946130 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.877533 24082 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.877573 24056 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:49.950891 22216 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:49.884140 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.963057 22737 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:49.886384 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.886663 23699 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.887424 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.966341 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:49.889557 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 48793.5us
I20260709 12:26:49.966921 22068 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.955585 24056 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.844259 24041 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:49.925836 22701 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:49.876794 23554 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.927879 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.860074 24042 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.936991 22702 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:49.973920 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 48188.4us
I20260709 12:26:49.927073 24058 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.935652 21965 catalog_manager.cc:5697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.935621 24062 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.934505 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.990634 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.990813 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59932 (request call id 1001) took 1219 ms. Trace:
I20260709 12:26:49.991364 22140 rpcz_store.cc:276] 0709 12:26:48.771262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.771367 (+   105us) service_pool.cc:224] Handling call
0709 12:26:49.990519 (+1219152us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000d66d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:49.990694 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668818304}
I20260709 12:26:49.991823 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.992555 22062 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
W20260709 12:26:49.897480 24035 consensus_meta.cc:287] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.763s	user 0.014s	sys 0.001s
I20260709 12:26:49.993415 24035 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.994431 22146 raft_consensus.cc:1240] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:49.995460 24035 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.875881 24066 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:49.996163 24066 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.998294 24066 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:49.949362 22036 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:49.946861 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.950347 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:49.999081 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 49917.3us
I20260709 12:26:49.999871 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.881403 22728 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:49.956130 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:49.854889 23837 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.002974 23837 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.958096 22035 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:49.961042 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.003378 22142 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:49.888666 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:49.965085 22184 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:50.004451 22144 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:49.967164 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:26:50.005010 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 52480.2us
I20260709 12:26:50.005255 23776 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:50.005748 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.005993 23965 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:50.007155 23647 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.890061 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:50.008281 24041 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:50.008730 24041 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:50.009104 24041 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.009727 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:50.010402 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:50.011404 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.967695 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:50.013216 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 45594.1us
I20260709 12:26:49.970448 24056 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:50.015641 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.015980 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.954978 24026 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:50.016745 24026 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.017632 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:50.018949 24026 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:49.958746 23663 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.022342 21965 catalog_manager.cc:5697] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:26:49.977052 23941 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:49.977227 23554 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.954458 22732 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:50.027213 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.027796 22730 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.027925 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:49.959623 23832 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:26:50.000836 22036 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:50.034179 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:50.035108 22036 leader_election.cc:400] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3.
I20260709 12:26:50.035962 22036 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:49.974474 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:49.869992 22139 raft_consensus.cc:1240] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:49.975090 24085 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.975620 24086 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:49.983464 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1000) took 1212 ms. Trace:
I20260709 12:26:49.985296 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:49.986042 24062 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:50.062716 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 88318us
I20260709 12:26:49.988046 24058 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:49.954245 24082 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:49.999154 22065 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:50.066208 22220 raft_consensus.cc:2368] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:50.000000 22071 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:49.950384 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:50.067237 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 116976us
I20260709 12:26:50.000867 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:26:50.003866 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 45843.4us
I20260709 12:26:49.939144 24063 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.007568 23647 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.042610 22068 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
W20260709 12:26:50.049111 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 70819.6us
I20260709 12:26:50.050812 22036 leader_election.cc:400] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3.
I20260709 12:26:50.073899 22036 leader_election.cc:403] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:50.051997 21965 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:50.075006 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.054605 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:50.075032 22036 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:50.038818 22185 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.057786 24026 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:50.068815 22035 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:50.072340 22702 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.079212 22216 raft_consensus.cc:2393] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:50.080840 22213 raft_consensus.cc:2393] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:26:50.083123 22035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.061017 23941 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:50.072732 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:50.068401 23675 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:50.058415 24085 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:50.126592 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 54335.6us
I20260709 12:26:50.127907 22702 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:50.048813 23965 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:50.133669 23965 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.133905 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.084960 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:50.085376 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.053896 23699 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:50.134923 23976 raft_consensus.cc:2804] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:50.084834 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:50.085987 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.059487 23826 consensus_queue.cc:1059] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:26:50.078527 24068 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:50.122061 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 49391.4us
I20260709 12:26:50.079437 24031 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:50.068681 23631 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:50.070677 23716 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:50.005069 23803 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.088371 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:50.173283 22140 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:50.087998 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:50.087615 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:50.174707 22144 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:50.134125 23965 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.087293 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.177713 22735 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.087486 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.071905 22729 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:50.151597 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.136405 24085 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.079190 24005 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3.
I20260709 12:26:50.121156 24022 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:50.076567 23647 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.195159 23776 raft_consensus.cc:3055] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:50.195672 23776 raft_consensus.cc:740] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:50.089417 24058 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:50.197453 24058 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:50.135229 23699 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.087126 23829 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:50.197872 24093 log.cc:927] Time spent T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:26:50.198365 23829 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.199928 23699 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:50.200547 22212 raft_consensus.cc:1240] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:50.200711 23829 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:50.120985 23660 consensus_queue.cc:1059] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:26:50.149220 23675 raft_consensus.cc:697] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:50.160233 24031 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:50.160578 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.207505 24062 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.209197 24082 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:50.164003 23716 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:50.220366 23716 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.210386 22730 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:50.136114 23866 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:50.180497 24040 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:50.197911 24058 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.196609 23776 consensus_queue.cc:260] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.219087 24031 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.193450 24022 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:50.245412 23776 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.230984 23775 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:50.231405 23866 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.242880 24022 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.252650 24042 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.236028 24040 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:50.306033 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 228970us
I20260709 12:26:50.071098 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.388034 22062 raft_consensus.cc:2376] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3. Re-sending same reply.
W20260709 12:26:50.389493 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 55378.6us
I20260709 12:26:50.391427 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:50.393679 22036 leader_election.cc:400] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:50.394209 22036 leader_election.cc:403] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:50.394711 23699 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:50.395232 24005 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.089061 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:50.085004 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:50.157721 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.310279 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 159745us
I20260709 12:26:50.060246 22138 rpcz_store.cc:276] 0709 12:26:48.770901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.774192 (+  3291us) service_pool.cc:224] Handling call
0709 12:26:48.832073 (+ 57881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.542451 (+710378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.983183 (+440732us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400189554. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:49.983394 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432063872}
I20260709 12:26:50.402808 23941 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:50.153432 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:50.327272 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 205651us
I20260709 12:26:50.330892 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.405055 22731 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:26:50.329468 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 201441us
I20260709 12:26:50.338496 22735 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:50.340081 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.357963 22729 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:50.358779 23647 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.365681 23803 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.253607 23866 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.266773 24079 raft_consensus.cc:3055] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:26:50.268980 24092 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.103s	user 0.003s	sys 0.000s
I20260709 12:26:50.407311 22737 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.364738 23675 consensus_queue.cc:237] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.395653 23699 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.405088 22111 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:50.410181 24056 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.490514 24066 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:50.490789 24056 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.491425 24066 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.410458 24085 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.255139 24041 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.496742 24085 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:50.497946 22736 raft_consensus.cc:1240] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.505981 24035 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:50.506898 24035 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.509975 24022 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.512584 24022 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:50.513279 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.517325 24079 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:50.518784 24079 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.520284 24079 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.520628 22140 raft_consensus.cc:1240] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.424024 22145 raft_consensus.cc:2393] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:50.461958 22702 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:50.522560 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 60807.6us
I20260709 12:26:50.523800 24058 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.524751 24040 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.525581 23776 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:50.469376 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 46598.3us
I20260709 12:26:50.527452 23776 consensus_queue.cc:1059] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:50.260103 24068 raft_consensus.cc:697] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:50.529410 23699 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:50.474550 23716 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.530658 24068 consensus_queue.cc:237] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.483039 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:50.532418 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 112211us
I20260709 12:26:50.533361 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:50.484985 23647 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:50.487751 24031 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.381062 23554 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.544019 22731 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:50.542333 22737 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:50.456802 23976 raft_consensus.cc:697] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:50.529029 24041 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.556478 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.558526 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.563630 22211 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:50.554651 24085 consensus_queue.cc:1059] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:26:50.560393 24022 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:50.564639 22035 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:50.569603 24104 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:50.572140 23965 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.574867 23965 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.575991 22071 raft_consensus.cc:2393] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:50.577440 23647 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:50.579248 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:50.582238 24005 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4.
I20260709 12:26:50.584699 23944 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:50.585249 23944 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:50.585561 24035 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:50.585661 23944 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.565521 23716 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:50.618400 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 213576us
I20260709 12:26:50.587942 24104 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.587296 24022 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:50.630406 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.633822 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.627429 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.632404 24022 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:50.647169 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 89458.1us
I20260709 12:26:50.647656 22185 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.649272 23776 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:50.650486 24031 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:50.653327 24112 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:50.654443 22737 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:50.628947 24104 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.569818 24102 consensus_queue.cc:1059] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:26:50.662286 22035 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:50.664202 23976 consensus_queue.cc:237] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.654170 23909 raft_consensus.cc:3055] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:26:50.677860 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 53962.8us
I20260709 12:26:50.658001 23776 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.698576 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.699498 22067 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:50.702390 22111 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:50.702601 23699 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:50.678097 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.709311 23965 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:50.709568 24114 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:50.710106 24114 raft_consensus.cc:697] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:50.710467 23699 raft_consensus.cc:697] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:50.711274 24114 consensus_queue.cc:237] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.712031 24031 consensus_queue.cc:1059] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:50.713515 24035 raft_consensus.cc:3055] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:50.713956 24035 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:50.715058 24035 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.713519 24112 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.700508 23944 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.718278 22702 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:50.719193 24112 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:50.719851 22702 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:50.720048 23944 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:50.720769 23775 raft_consensus.cc:2764] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:50.712218 23699 consensus_queue.cc:237] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.722283 24079 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:50.723222 24079 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:50.725378 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 70825.9us
I20260709 12:26:50.677592 23554 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:50.678249 23909 raft_consensus.cc:740] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:50.691058 23776 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.734378 23866 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:50.737905 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 131072us
I20260709 12:26:50.739246 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.740828 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:50.741734 22140 raft_consensus.cc:2393] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 5: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:50.747368 24058 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.736994 23866 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:50.750571 22185 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.752012 23554 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:50.752560 22185 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.752669 23554 raft_consensus.cc:697] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:50.753863 23554 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.754328 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:50.755283 22140 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:50.757259 22063 raft_consensus.cc:1275] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:50.757978 22068 raft_consensus.cc:1240] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.759109 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:50.759816 22144 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.760025 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.762111 22142 raft_consensus.cc:1240] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.744719 24085 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:50.751791 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:50.752171 24079 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.780556 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:50.782225 22064 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.782892 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.770901 24066 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.786134 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:50.789353 24040 raft_consensus.cc:2804] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:50.789974 24040 raft_consensus.cc:697] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:50.791006 24040 consensus_queue.cc:237] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.794600 24101 raft_consensus.cc:3055] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:50.795092 24101 raft_consensus.cc:740] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:50.795379 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:50.796365 22212 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:50.771674 23675 consensus_queue.cc:1059] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:26:50.796168 24101 consensus_queue.cc:260] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.801542 24058 raft_consensus.cc:3055] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:50.801990 24058 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:50.802138 24101 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.802590 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:50.803459 22213 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.782080 24068 consensus_queue.cc:1059] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:26:50.803489 24058 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.794371 22211 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 12:26:50.807678 22067 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.812146 23716 raft_consensus.cc:3055] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:50.812741 23716 raft_consensus.cc:740] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:26:50.817783 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 50846.1us
I20260709 12:26:50.824776 22185 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.806382 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:50.788827 24104 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:50.832501 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 111405us
W20260709 12:26:50.832808 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 129299us
W20260709 12:26:50.832437 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 134231us
W20260709 12:26:50.840478 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.847393 24068 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:50.848573 24068 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.851063 24068 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.851186 23675 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:50.852088 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:50.852747 22142 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.853329 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:50.854151 22145 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.854460 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:50.847534 24066 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:50.855684 24066 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:50.856119 24066 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.814692 23776 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.857590 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:50.858385 22737 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:50.863895 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.868162 23675 raft_consensus.cc:697] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:50.804983 23909 consensus_queue.cc:260] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.870013 23909 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.870447 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:50.871470 22068 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:50.873699 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.873893 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:50.874656 22736 raft_consensus.cc:2393] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:50.874955 22063 raft_consensus.cc:2368] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:50.874330 24022 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.875969 23965 raft_consensus.cc:3055] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:50.876448 23965 raft_consensus.cc:740] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:50.853062 24104 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.869475 23675 consensus_queue.cc:237] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.880460 24041 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:50.885736 24041 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:50.888226 24041 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.814661 23716 consensus_queue.cc:260] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:50.889340 22703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.889086 23965 consensus_queue.cc:260] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.890054 23716 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.890795 23965 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.851080 24035 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.897516 22064 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:50.897701 22142 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:50.907323 22144 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
W20260709 12:26:50.910137 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 64613.7us
I20260709 12:26:50.912871 22035 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:50.914218 22703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.913988 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.921348 22734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af"
dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
mode: GRACEFUL
new_leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
 from {username='slave'} at 127.0.0.1:35636
I20260709 12:26:50.900086 24058 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.927692 22067 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:50.925477 22736 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:50.950088 24087 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:50.950901 24087 raft_consensus.cc:697] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:50.937608 22213 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
W20260709 12:26:50.938943 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.943934 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:50.945441 22185 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:50.945931 22145 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
W20260709 12:26:50.946887 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 65000.5us
I20260709 12:26:50.953652 22737 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:50.961541 22036 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:50.909325 24041 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:50.961311 24085 raft_consensus.cc:2764] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:50.963737 24087 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:50.964941 22701 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:50.966531 22729 raft_consensus.cc:1240] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:26:50.966691 24099 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:50.967286 24022 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:50.975601 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.969810 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.977468 23660 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:50.977628 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.978307 23803 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:50.978652 22185 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:50.976828 22036 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:50.980958 22737 raft_consensus.cc:1240] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.977639 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.967387 22730 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.988765 22735 raft_consensus.cc:2368] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4.
I20260709 12:26:50.994750 24104 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:50.995571 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:50.995967 23699 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:50.996483 23699 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:50.996990 23699 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:50.997099 24122 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:50.998327 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:51.006212 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:51.026039 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 49269.7us
I20260709 12:26:50.990860 22732 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:51.050400 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:51.054227 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 59697.5us
W20260709 12:26:51.055987 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.057026 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:51.058488 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:51.058772 22733 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:51.060348 23554 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:51.061347 24056 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:51.061971 24056 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.064082 24066 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.065282 23803 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:51.006628 24122 raft_consensus.cc:697] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:51.071498 22036 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:51.076038 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 111226us
I20260709 12:26:51.075728 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:51.052448 23776 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:51.066063 23803 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.008973 24041 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.089093 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:51.086583 24040 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:51.061022 23554 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:51.088429 24117 log.cc:927] Time spent T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:26:51.084678 22701 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:51.100443 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 47344.6us
I20260709 12:26:51.085915 23965 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:51.105538 24122 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.107797 23554 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:51.110417 23803 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:51.108832 24066 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:51.122058 24123 log.cc:927] Time spent T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:26:51.125945 22062 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:51.123420 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:51.127734 22064 raft_consensus.cc:2368] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3.
I20260709 12:26:51.123925 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:51.124879 24056 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:51.133967 22735 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:51.134974 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:51.142513 24031 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.143219 24031 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:51.143851 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.155256 22734 raft_consensus.cc:606] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Received request to transfer leadership to TS be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:51.155874 22734 raft_consensus.cc:614] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:51.156663 24128 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:26:51.159041 24103 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:51.166277 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 53798.7us
I20260709 12:26:51.167510 22185 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:51.169215 23554 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:51.176381 22185 leader_election.cc:400] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:51.178874 22185 leader_election.cc:403] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:26:51.178915 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.178082 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:51.178236 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:51.179700 22212 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:51.199944 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 48554us
I20260709 12:26:51.190356 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.192229 22216 raft_consensus.cc:1275] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:51.092111 23941 consensus_queue.cc:1059] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:26:51.183182 23554 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
W20260709 12:26:51.218664 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 88311.4us
I20260709 12:26:51.225320 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:51.230036 22217 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.206127 24041 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:51.233016 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:51.233886 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:51.244092 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:51.246448 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.246282 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.248340 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.258534 22067 raft_consensus.cc:2393] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 4: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:51.225760 24103 raft_consensus.cc:697] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:51.263823 22215 raft_consensus.cc:2393] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:51.264163 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.264783 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.265425 22215 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.268167 21965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48096 (request call id 302) took 9433 ms. Trace:
I20260709 12:26:51.270115 21966 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 4 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:51.271973 21966 catalog_manager.cc:5697] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 2 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.229053 24005 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:51.274564 24005 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.276038 22220 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:51.225525 22211 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:26:51.277673 22211 raft_consensus.cc:1240] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:51.278752 22217 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:26:51.280061 22211 raft_consensus.cc:1240] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:51.280158 22217 raft_consensus.cc:1240] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:51.281533 22219 raft_consensus.cc:2393] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:51.283713 22036 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:51.284811 23663 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.265374 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:51.290292 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 110219us
I20260709 12:26:51.262300 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:51.294848 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:51.296252 22185 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:51.304989 24005 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:51.308058 24031 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:51.308769 24103 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.312844 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:51.315110 21966 catalog_manager.cc:5697] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:26:51.321518 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:51.322175 22067 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.322738 22215 raft_consensus.cc:2410] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:26:51.324642 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 68685.5us
I20260709 12:26:51.316547 21966 catalog_manager.cc:5697] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 3, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.269078 22212 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:51.326081 22211 raft_consensus.cc:1240] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:51.335446 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 50106.7us
I20260709 12:26:51.338505 22220 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:26:51.343976 22702 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:51.341312 22137 raft_consensus.cc:1275] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:51.353207 22214 raft_consensus.cc:1240] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:51.332696 23663 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.364660 22066 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:26:51.365792 22071 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:51.368520 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.340555 23675 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:51.359452 21966 catalog_manager.cc:5697] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.380646 22069 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:51.381577 22702 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:51.382236 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.382737 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:51.377923 23716 consensus_queue.cc:1059] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:26:51.384498 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:51.385249 24022 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:51.385694 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:51.386009 22737 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:51.386833 22735 raft_consensus.cc:1240] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:51.387041 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:51.387673 23976 consensus_queue.cc:1059] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:51.388216 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:51.388499 24134 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.388926 23976 raft_consensus.cc:3055] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:51.389449 23976 raft_consensus.cc:740] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:51.389273 24134 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.390370 23976 consensus_queue.cc:260] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.391825 23976 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:51.391940 24134 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:51.366931 24085 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:51.394052 24085 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.394435 22063 raft_consensus.cc:1240] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:51.394357 22702 leader_election.cc:400] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3.
I20260709 12:26:51.395120 22702 leader_election.cc:403] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:51.395340 23716 raft_consensus.cc:3055] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:51.395714 23716 raft_consensus.cc:740] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:51.396971 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:51.397425 24101 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3.
I20260709 12:26:51.398100 24101 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:51.268612 21965 rpcz_store.cc:276] 0709 12:26:41.835022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.845228 (+ 10206us) service_pool.cc:224] Handling call
0709 12:26:51.267953 (+9422725us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:50.548309 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:50.580863 (+ 32554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:50.580931 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:26:50.580965 (+    34us) tablet.cc:662] Decoding operations
0709 12:26:50.581661 (+   696us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:50.581775 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:50.581803 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:50.582331 (+   528us) tablet.cc:701] Row locks acquired
0709 12:26:50.582382 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:26:50.582613 (+   231us) write_op.cc:270] Start()
0709 12:26:50.582788 (+   175us) write_op.cc:276] Timestamp: P: 1783600010582496 usec, L: 0
0709 12:26:50.582840 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:26:50.583715 (+   875us) log.cc:844] Serialized 1303 byte log entry
0709 12:26:50.800977 (+217262us) op_driver.cc:464] REPLICATION: finished
0709 12:26:50.837936 (+ 36959us) write_op.cc:301] APPLY: starting
0709 12:26:50.838072 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:50.838255 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:50.838432 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:50.957859 (+119427us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:50.968291 (+ 10432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:26:50.968400 (+   109us) write_op.cc:312] APPLY: finished
0709 12:26:50.968912 (+   512us) log.cc:844] Serialized 35 byte log entry
0709 12:26:50.969942 (+  1030us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:50.972955 (+  3013us) write_op.cc:454] Released schema lock
0709 12:26:50.985225 (+ 12270us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:51.069372 (+ 84147us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:51.071349 (+  1977us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2905,"reported_tablets":14,"spinlock_wait_cycles":21376,"child_traces":[["op",{"apply.queue_time_us":36578,"apply.run_cpu_time_us":4096,"apply.run_wall_time_us":168034,"num_ops":3,"prepare.queue_time_us":247930,"prepare.run_cpu_time_us":38313,"prepare.run_wall_time_us":112534,"raft.queue_time_us":130942,"raft.run_cpu_time_us":10599,"raft.run_wall_time_us":57294,"replication_time_us":217954,"thread_start_us":412750,"threads_started":4,"wal-append.queue_time_us":59982}]]}
I20260709 12:26:51.398190 23699 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.400023 24132 consensus_queue.cc:1059] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:51.381978 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:51.401464 23699 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:51.402186 22213 raft_consensus.cc:1240] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:51.408855 22140 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:51.358337 23941 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.387398 23663 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:26:51.387306 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:26:51.412989 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 46352.4us
I20260709 12:26:51.396668 23716 consensus_queue.cc:260] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:51.424844 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.426870 22185 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:51.419914 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.438040 22067 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:51.422943 21966 catalog_manager.cc:5697] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:51.440151 22185 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:51.442030 22220 raft_consensus.cc:1240] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:51.452206 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:51.413741 22218 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:26:51.485641 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 45575.2us
I20260709 12:26:51.491539 23803 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:51.493153 23699 raft_consensus.cc:2764] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:51.493624 23803 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.473105 24122 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:51.495044 24122 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.496057 23803 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:51.496721 23554 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:51.488303 21966 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 4, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.489316 23776 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:26:51.497138 24122 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:51.511232 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:51.512141 22140 raft_consensus.cc:2410] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:26:51.518337 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:51.503614 21966 catalog_manager.cc:5697] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 2, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:51.518888 22732 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:51.518987 22066 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:51.520594 22063 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:51.501446 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:51.522221 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:51.533936 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.506847 24136 log.cc:927] Time spent T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:26:51.542451 22071 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:51.543071 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:51.543846 22071 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:51.497613 23675 raft_consensus.cc:697] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:51.543789 22062 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:51.504164 24082 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.524036 24102 raft_consensus.cc:3055] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:51.503039 23663 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:51.497323 23554 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:51.553773 22731 raft_consensus.cc:1275] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:51.533543 23965 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.555181 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:51.557315 22218 raft_consensus.cc:1240] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:51.501354 24056 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:26:51.525087 24041 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:26:51.537228 23803 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:26:51.555104 24102 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:26:51.588068 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 86701.6us
I20260709 12:26:51.503806 23941 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:51.599385 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.623868 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.589622 24066 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:51.642201 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.646978 22036 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:51.648911 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 139757us
I20260709 12:26:51.562258 24082 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.645821 22702 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:51.582240 22140 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:51.657879 22731 raft_consensus.cc:1240] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:51.624361 23699 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:26:51.667719 24031 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:51.684633 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:51.690507 22213 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:26:51.693238 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.653025 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:51.645362 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.698597 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:51.670945 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:51.697816 22216 raft_consensus.cc:1240] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:51.717592 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:51.718446 22213 raft_consensus.cc:2393] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 8: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:51.681898 23663 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.674089 24142 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:51.700031 23909 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:51.695914 23675 consensus_queue.cc:237] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.750190 24022 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:51.750802 24022 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.672083 24066 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.727411 23965 raft_consensus.cc:2764] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:51.698261 24031 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.732715 23776 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:26:51.749148 22730 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:51.754216 22211 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:51.732107 24121 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.753180 24134 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:51.775043 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.704943 24102 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:51.833190 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 70432.6us
I20260709 12:26:51.768321 22066 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
W20260709 12:26:51.842664 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 171827us
W20260709 12:26:51.850930 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 199348us
I20260709 12:26:51.753021 24022 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:51.744333 24122 consensus_queue.cc:1059] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:26:51.765748 24066 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:51.768541 22212 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.868321 22137 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:51.693506 23554 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:51.897044 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:51.897927 22215 raft_consensus.cc:2393] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:51.897840 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:51.907465 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:51.763984 24150 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.217s
I20260709 12:26:51.900902 24102 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.924664 24150 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:51.937777 24058 raft_consensus.cc:3055] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:51.938400 24058 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:51.939487 24058 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:51.940816 24058 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:51.941700 24143 log.cc:927] Time spent T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 12:26:51.946050 24148 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:26:51.947691 22146 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:51.948551 23976 raft_consensus.cc:3055] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:51.953593 24031 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:51.958853 24141 log.cc:927] Time spent T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.246s	user 0.005s	sys 0.007s
W20260709 12:26:51.989470 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.886569 24134 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:52.106956 22736 consensus_meta.cc:287] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.007s
I20260709 12:26:52.116411 22736 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
W20260709 12:26:52.120177 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.124279 22703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.130291 22066 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:52.124279 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.131843 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:52.106985 23976 raft_consensus.cc:740] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:52.132686 22736 raft_consensus.cc:2393] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:52.142681 24022 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.143529 24022 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:52.145377 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 257060us
I20260709 12:26:52.145619 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:52.146701 23965 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.130640 24066 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:52.147313 23965 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:52.148105 24066 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.149075 23976 consensus_queue.cc:260] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.138087 24132 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.150487 24066 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:52.150694 24132 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.124797 24082 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:52.116362 24121 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:52.157831 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.154919 22217 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:52.148043 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:52.159165 24035 consensus_meta.cc:287] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 1.264s	user 0.018s	sys 0.005s
I20260709 12:26:52.131695 23941 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:52.162497 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.175906 22702 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:52.186547 22064 raft_consensus.cc:1240] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:52.146752 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:52.133826 24104 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:52.189312 24164 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.175895 24035 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:52.175454 24087 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.197309 22736 raft_consensus.cc:1240] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:52.197880 24022 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.198717 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:52.187134 24103 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.197921 23965 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:52.201661 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 53843.8us
I20260709 12:26:52.160704 23716 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:52.204550 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:52.205441 22064 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:52.206230 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:52.210093 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 351410us
I20260709 12:26:52.201678 24103 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.196897 24087 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.195853 24164 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:52.184134 24122 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:52.236611 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 43598.1us
I20260709 12:26:52.194988 24132 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.251902 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.252849 22069 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:52.255975 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.256326 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.256723 22070 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:52.257252 22068 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:52.260479 22736 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:52.254547 22071 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:52.268784 22218 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:26:52.268360 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 404306us
I20260709 12:26:52.266499 22064 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
W20260709 12:26:52.267210 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 91404.2us
I20260709 12:26:52.273447 24035 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.280201 24162 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.280375 24035 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.282959 22145 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:52.295032 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:52.298152 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 93068.3us
I20260709 12:26:52.310215 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:52.311643 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 126507us
I20260709 12:26:52.313833 22063 raft_consensus.cc:1275] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:52.329604 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 43564us
I20260709 12:26:52.275580 24142 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:52.354298 24087 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:52.252151 24101 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:26:52.285857 24022 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.355556 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:52.356067 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:52.362697 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:52.253762 24122 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.293119 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:26:52.378489 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 44879.2us
I20260709 12:26:52.371197 24159 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.372166 24035 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:52.337728 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.373255 24169 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.266469 24156 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 12:26:52.375700 22735 raft_consensus.cc:2393] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:52.371210 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:52.258698 24104 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:52.386366 24152 log.cc:927] Time spent T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.599s	user 0.003s	sys 0.000s
I20260709 12:26:52.403810 22146 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:52.388792 22728 raft_consensus.cc:2410] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:52.348906 23909 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:26:52.393652 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:52.425480 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1781) took 1020 ms. Trace:
I20260709 12:26:52.425613 24104 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:52.394135 24132 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:26:52.427031 24164 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.426048 22142 rpcz_store.cc:276] 0709 12:26:51.405035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.405933 (+   898us) service_pool.cc:224] Handling call
0709 12:26:51.406255 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:51.406672 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:26:51.581921 (+175249us) log.cc:844] Serialized 14 byte log entry
0709 12:26:51.774554 (+192633us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:51.872802 (+ 98248us) log.cc:844] Serialized 26 byte log entry
0709 12:26:51.873062 (+   260us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:51.873122 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.873228 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:52.172763 (+299535us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:26:52.425137 (+252374us) raft_consensus.cc:1685] finished
0709 12:26:52.425257 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:52.425409 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11467,"prepare.queue_time_us":276138,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":182666,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":8502,"spinlock_wait_cycles":32610688,"thread_start_us":292664,"threads_started":3,"wal-append.queue_time_us":89345}
I20260709 12:26:52.400544 22730 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:52.386626 22212 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:26:52.428771 24122 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.409017 22035 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:52.431700 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.433462 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:52.433969 24156 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:52.434480 24156 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.434855 24156 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:52.401180 24159 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:52.440631 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.405889 24134 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:52.442062 22185 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:52.376845 24022 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:52.447391 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:52.447568 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:52.448235 22142 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:52.458330 22035 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:52.460584 22185 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:52.462203 22185 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:52.463063 23803 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:52.464689 24151 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:52.465132 24151 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:52.465342 23803 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:52.465516 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:52.465903 24157 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:52.466337 22142 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:52.466423 24157 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.467068 24157 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:52.470412 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.471969 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.472337 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:52.473136 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.473829 22211 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:52.475111 22035 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:52.437022 24159 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.405910 24169 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.478166 24104 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:52.453836 24058 consensus_queue.cc:1048] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:26:52.482741 24087 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:26:52.519477 24163 log.cc:927] Time spent T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.327s	user 0.003s	sys 0.001s
I20260709 12:26:52.483323 23675 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.521497 23675 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:52.483569 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:52.523679 22733 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:52.493739 22111 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:52.496441 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.496747 22218 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:52.503424 22702 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:52.508237 22071 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:26:52.499702 22184 leader_election.cc:336] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.539s (SENT)
I20260709 12:26:52.526340 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.466351 23803 raft_consensus.cc:697] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:26:52.535239 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.536065 22214 raft_consensus.cc:2393] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:52.465559 24151 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:52.574049 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:52.501219 24104 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.577694 22735 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:52.578605 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.597470 22064 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:52.519527 24087 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:52.583981 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 84311.7us
I20260709 12:26:52.537899 24031 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:52.593057 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.537693 22219 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:52.574229 23909 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:26:52.596458 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:52.604216 22184 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.607s (SENT)
I20260709 12:26:52.605113 24087 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.603129 24104 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.606237 24146 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:52.606413 24031 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:52.657428 24031 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:52.665904 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:52.669757 24177 log.cc:927] Time spent T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 12:26:52.675165 22065 raft_consensus.cc:1240] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:52.676410 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:52.603678 24103 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.602710 24171 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:52.613972 22062 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:52.637432 22733 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:52.637256 23803 consensus_queue.cc:237] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:52.626705 24146 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.641041 24158 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
W20260709 12:26:52.641853 24168 log.cc:927] Time spent T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:26:52.644763 22068 raft_consensus.cc:1240] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:52.645263 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.595798 24121 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:26:52.646021 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.647992 24169 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.648703 23976 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:52.626261 24167 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.650152 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:52.652254 22036 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:52.652534 22212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37716 (request call id 1976) took 1040 ms. Trace:
W20260709 12:26:52.684846 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 59014.8us
W20260709 12:26:52.685391 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 147841us
I20260709 12:26:52.687428 22065 raft_consensus.cc:2393] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
W20260709 12:26:52.694602 22184 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.755s (SENT)
I20260709 12:26:52.717742 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:52.720257 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.738746 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.740247 24150 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:52.719393 24171 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.745721 24171 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.748656 22732 raft_consensus.cc:1275] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:26:52.783167 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.784162 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.755645 22184 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:52.734915 22212 rpcz_store.cc:276] 0709 12:26:51.612663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.619485 (+  6822us) service_pool.cc:224] Handling call
0709 12:26:52.652319 (+1032834us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b540038c7d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:52.652448 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148738944}
I20260709 12:26:52.758409 24167 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:52.769407 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 117225us
I20260709 12:26:52.809901 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:52.721997 24146 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:52.779284 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.761659 24164 raft_consensus.cc:2764] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:52.726979 23675 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:52.790197 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.717140 23941 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 12:26:52.773705 24177 log.cc:927] Time spent T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:52.793015 22185 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:52.818158 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.719098 24156 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:52.818254 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.818532 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.822211 22218 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:52.826282 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:52.827406 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:52.787420 24158 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.836079 22702 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:52.839349 24031 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:52.840015 24162 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:52.840507 24162 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.840907 24162 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.834789 22185 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:52.849686 22071 raft_consensus.cc:2368] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5.
I20260709 12:26:52.829011 24058 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:52.869495 24150 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:52.869390 22702 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:52.870085 24150 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.870482 24175 raft_consensus.cc:2804] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:52.871065 24175 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.871490 24175 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:52.842032 24158 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:52.833956 22062 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:52.874054 24158 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:52.874681 24031 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:52.875828 24022 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:52.877504 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:52.878647 22213 raft_consensus.cc:2393] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:52.834152 23675 raft_consensus.cc:2764] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:52.848771 24164 consensus_queue.cc:1059] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 12:26:52.910983 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 92741.1us
I20260709 12:26:52.995416 22143 raft_consensus.cc:1240] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:53.029561 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 135693us
W20260709 12:26:53.035043 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 290568us
W20260709 12:26:53.037393 24200 log.cc:927] Time spent T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
I20260709 12:26:53.041801 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.042701 22137 raft_consensus.cc:2368] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:53.043594 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:52.861794 23941 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.893406 22185 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:53.045907 22137 raft_consensus.cc:2410] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:52.997941 24167 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:52.917876 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 223308us
I20260709 12:26:52.870519 24150 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:52.970326 24182 log.cc:927] Time spent T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:26:53.030725 22036 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
W20260709 12:26:52.996924 24142 consensus_meta.cc:287] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.003s
W20260709 12:26:53.090119 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 196829us
I20260709 12:26:53.091415 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:52.951148 24178 log.cc:927] Time spent T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Append to log took a long time: real 0.438s	user 0.006s	sys 0.000s
W20260709 12:26:53.095383 22184 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.786s (SENT)
I20260709 12:26:53.045962 24031 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:53.096657 22184 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:53.001627 24156 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.096827 24142 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:53.101037 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 70427.4us
I20260709 12:26:53.102631 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:53.107061 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.104604 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.108255 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:53.108480 22137 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:52.883550 24157 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:53.110888 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.112471 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:53.095819 24082 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:53.114897 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.108868 22065 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:53.115595 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:53.000619 24087 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.123216 22143 raft_consensus.cc:2393] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:53.048004 24162 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:53.105712 24141 log.cc:927] Time spent T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:53.101516 24101 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.101220 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:53.098903 24031 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.129297 22036 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:53.103968 24085 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.127946 23775 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:53.053380 23941 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.135591 22068 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:53.136384 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:53.112033 24134 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.111517 24066 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:53.089823 24175 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.120914 24164 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:53.144551 22067 raft_consensus.cc:2368] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6.
I20260709 12:26:53.101529 23716 consensus_queue.cc:1059] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:26:53.149252 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:53.131608 23803 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:53.135129 24103 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:53.148797 24160 log.cc:927] Time spent T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:53.135370 24142 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.174010 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.159402 24058 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:26:53.151508 23965 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:53.157110 22070 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:53.186196 24172 raft_consensus.cc:3055] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:53.186688 24172 raft_consensus.cc:740] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:53.186950 24087 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.143524 24085 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.151001 24134 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.139478 24101 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.197453 24161 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:53.198043 24161 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.198473 24161 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:53.199958 23941 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:53.201371 24187 consensus_queue.cc:1048] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:26:53.202095 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.203508 24196 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:53.204121 24196 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.205744 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.206269 24031 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:53.206821 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.207020 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.207614 22141 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:53.181785 23965 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:53.208402 23965 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:53.204960 24150 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.174322 24103 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.210287 24150 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:53.210732 24103 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.213438 24184 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:53.214191 24185 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:53.211551 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.208761 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.214802 24185 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.246769 22137 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:53.218600 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:53.263652 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 83175.9us
I20260709 12:26:53.266275 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.267545 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.268587 24213 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:53.274503 22146 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:53.278465 22731 raft_consensus.cc:1240] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:53.278367 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:53.282048 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.282699 22142 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:53.285629 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:53.298213 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.299759 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.297226 24005 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:53.311427 22702 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:53.297358 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:53.319901 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.322515 22137 raft_consensus.cc:2368] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:53.320673 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.253599 24134 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:53.321002 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.329541 22146 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:53.331048 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:53.334808 22184 leader_election.cc:336] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.914s (SENT)
I20260709 12:26:53.335435 22184 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:53.336392 24150 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:53.332716 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.338331 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:53.338629 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:53.339028 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.340337 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:53.339293 22211 raft_consensus.cc:2393] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:53.342681 22218 raft_consensus.cc:2393] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:53.342748 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:53.207552 24104 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.179463 24142 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.342000 22215 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:53.342056 22142 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:53.269215 24213 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.317569 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:53.381531 24164 raft_consensus.cc:697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:53.403695 24187 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.425370 24187 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.309790 24172 consensus_queue.cc:260] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:53.410939 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.449865 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 162766us
I20260709 12:26:53.516152 22063 raft_consensus.cc:2368] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6.
I20260709 12:26:53.397255 22729 raft_consensus.cc:2368] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5.
I20260709 12:26:53.517984 22732 raft_consensus.cc:2393] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 6: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:53.519167 24122 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.519721 24122 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.519999 24104 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:53.520581 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.486977 24196 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.413247 22138 raft_consensus.cc:1275] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:53.523061 24099 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.523758 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.524391 22138 raft_consensus.cc:2376] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4. Re-sending same reply.
I20260709 12:26:53.523589 24099 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:53.525818 24151 consensus_meta.cc:287] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.004s
I20260709 12:26:53.526259 24151 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.527458 23803 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:53.528584 24151 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:53.528810 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.552632 22144 raft_consensus.cc:2368] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:53.539142 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:53.554014 22731 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
W20260709 12:26:53.383510 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 105226us
W20260709 12:26:53.541853 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.432005 24146 consensus_meta.cc:287] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.002s
I20260709 12:26:53.340590 23716 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:53.340391 24210 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.411095 24175 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.445569 24197 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:53.585798 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:53.397691 24194 log.cc:927] Time spent T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:26:53.396592 24209 log.cc:927] Time spent T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 12:26:53.554334 22185 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:53.588124 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.589071 22036 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:53.576849 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:53.590271 22146 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:26:53.345027 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:53.391078 22137 raft_consensus.cc:1240] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:53.441923 24157 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:53.427594 24185 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:53.411890 24162 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.597026 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:53.621796 22067 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:53.413491 22218 raft_consensus.cc:1275] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:26:53.622139 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 67903.5us
I20260709 12:26:53.605594 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:53.598747 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 80779.4us
I20260709 12:26:53.597357 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.598465 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:53.608870 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.341526 24005 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.514107 23965 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.588892 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:53.427807 24187 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:53.617427 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.619071 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.625831 22035 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:53.607084 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 50940.5us
I20260709 12:26:53.591361 24146 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.630965 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:53.908869 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.848902 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:53.775035 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:53.908062 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.910916 22071 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:53.910347 22213 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:53.648026 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:53.741035 22141 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:26:53.819562 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:53.921609 22070 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:53.924553 22143 raft_consensus.cc:1240] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:53.928122 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.933378 22067 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
W20260709 12:26:53.906708 24206 log.cc:927] Time spent T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 12:26:53.934377 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.939308 22144 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:53.936578 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:53.940124 22146 raft_consensus.cc:2376] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3. Re-sending same reply.
I20260709 12:26:53.941514 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.944193 22214 raft_consensus.cc:2393] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 6: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:26:53.875360 24161 consensus_meta.cc:287] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.000s
W20260709 12:26:53.944763 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 390320us
W20260709 12:26:53.928170 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 339145us
I20260709 12:26:53.848239 24185 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:53.952244 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:53.958235 22071 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:26:53.953313 22184 leader_election.cc:336] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.131s (SENT)
I20260709 12:26:53.954691 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.739012 24082 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:53.956503 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:53.951054 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:53.957007 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:53.631466 22212 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:53.614168 24210 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.967917 22036 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:53.618800 24217 consensus_queue.cc:1059] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.346s
W20260709 12:26:53.976348 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.976744 22184 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.141s (SENT)
I20260709 12:26:53.979141 22071 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:53.976143 24221 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
W20260709 12:26:53.986836 24219 log.cc:927] Time spent T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:26:53.987062 24005 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.951802 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 454) took 1273 ms. Trace:
I20260709 12:26:53.986429 24221 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.965317 24082 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.985361 22211 raft_consensus.cc:2410] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:53.870404 24164 consensus_queue.cc:237] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:53.957106 24161 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:53.996737 22144 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:26:54.053982 22071 raft_consensus.cc:1275] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:26:54.008770 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.055022 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 429272us
W20260709 12:26:54.048732 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 103432us
I20260709 12:26:54.009343 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:54.019635 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:54.071447 22215 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:54.071830 22185 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:54.073606 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:54.073212 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 102885us
W20260709 12:26:54.074606 22184 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.178s (SENT)
I20260709 12:26:53.965102 24185 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:54.021241 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:54.438897 24150 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:54.456135 24150 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.459290 24150 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:54.452726 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:54.470112 22068 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:54.145815 24187 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:54.471917 24187 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.472311 24187 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:54.019727 23716 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:54.473317 22184 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:54.364838 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.473853 24171 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:54.447994 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.473896 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 402152us
I20260709 12:26:54.366261 24210 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:54.379029 23775 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:54.424995 22070 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:54.491765 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1190) took 1078 ms. Trace:
I20260709 12:26:54.336191 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:54.492604 22146 raft_consensus.cc:2368] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:26:54.476074 22736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 659) took 1363 ms. Trace:
I20260709 12:26:54.146090 22137 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:54.308499 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:54.361950 24227 log.cc:927] Time spent T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:26:54.406322 24230 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:54.378129 24221 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:54.340111 23965 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:54.307993 24169 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.013s
I20260709 12:26:54.382472 24161 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:54.320778 24146 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:54.001405 24082 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:53.993269 24220 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:54.486560 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1008) took 1450 ms. Trace:
I20260709 12:26:54.226733 22215 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:54.251744 22035 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:54.100076 22735 raft_consensus.cc:1240] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:54.349924 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1178) took 1256 ms. Trace:
I20260709 12:26:54.492165 22070 rpcz_store.cc:276] 0709 12:26:53.413525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.631489 (+217964us) service_pool.cc:224] Handling call
0709 12:26:54.491705 (+860216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:54.493145 22736 rpcz_store.cc:276] 0709 12:26:53.110359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.110499 (+   140us) service_pool.cc:224] Handling call
0709 12:26:53.110836 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:53.113424 (+  2588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.113455 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:53.113980 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:26:53.587411 (+473431us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:53.587475 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.587582 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.346285 (+758703us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18003bc800. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208fc3f3 00007f1e208fe7c1 00007f1e208fe779 00007f1e208fe709 00007f1e208fe6d1 00007f1e208fd9cd 0000000000388634 0000000000388479 00007f1e208df83a
0709 12:26:54.350186 (+  3901us) raft_consensus.cc:1685] finished
0709 12:26:54.473822 (+123636us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.474087 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":661,"raft.queue_time_us":524,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":12196,"spinlock_wait_cycles":5526784,"thread_start_us":233056,"threads_started":1,"wal-append.queue_time_us":402090}
I20260709 12:26:54.383894 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:54.113889 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:54.601738 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.536952 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.508056 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:54.727562 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 475871us
I20260709 12:26:54.569307 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:54.725390 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 650743us
I20260709 12:26:54.671655 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:54.499194 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:54.389008 24101 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:54.025530 24005 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:54.000809 24142 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:54.728613 22064 rpcz_store.cc:276] 0709 12:26:53.093150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.093289 (+   139us) service_pool.cc:224] Handling call
0709 12:26:53.093582 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.093827 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:53.101904 (+  8077us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.349266 (+1247362us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b1800048100. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e235914bc 00007f1e208df48b 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208f9455 00007f1e239e1060 00007f1e239f3716 00007f1e23a04287
0709 12:26:54.349403 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.349474 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:54.349537 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.349626 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.349797 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25623,"prepare.queue_time_us":8154,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":35702,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"spinlock_wait_cycles":13924736,"thread_start_us":178227,"threads_started":2,"wal-append.queue_time_us":183079}
I20260709 12:26:54.368517 24231 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:54.403951 24156 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
W20260709 12:26:54.743290 22184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.237s (SENT) [suppressed 27 similar messages]
W20260709 12:26:54.789846 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 46605.5us
I20260709 12:26:54.486598 24022 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:54.289529 24232 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.628134 24150 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.821069 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:54.822265 22071 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:26:54.532845 24239 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:54.796269 24234 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.797634 24243 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:54.794724 22733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 664) took 1449 ms. Trace:
I20260709 12:26:54.825103 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:54.831542 24174 raft_consensus.cc:3055] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:54.794025 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:54.850404 24174 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:54.851445 24185 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:54.851867 24174 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.852674 24234 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:54.855841 24234 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:54.856540 24234 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:54.802639 24237 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:54.857586 24237 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.839670 22068 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:54.859017 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1188) took 1538 ms. Trace:
I20260709 12:26:54.859576 22068 rpcz_store.cc:276] 0709 12:26:53.320762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.320925 (+   163us) service_pool.cc:224] Handling call
0709 12:26:54.452521 (+1131596us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:54.858895 (+406374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398195456}
I20260709 12:26:54.822101 24232 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.862613 24232 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:54.868381 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1810) took 1661 ms. Trace:
I20260709 12:26:54.869009 22139 rpcz_store.cc:276] 0709 12:26:53.144836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.144989 (+   153us) service_pool.cc:224] Handling call
0709 12:26:54.805538 (+1660549us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:54.805828 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.806057 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.806097 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.806157 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:54.806201 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.806275 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.806441 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3743488}
I20260709 12:26:54.871088 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:54.874809 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:54.875676 22070 raft_consensus.cc:2393] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:54.875777 24246 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:54.876402 24246 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:54.381508 22730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 495) took 1152 ms. Trace:
I20260709 12:26:54.877321 22730 rpcz_store.cc:276] 0709 12:26:53.228794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.253573 (+ 24779us) service_pool.cc:224] Handling call
0709 12:26:54.380573 (+1127000us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b5800034598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:54.380826 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.381051 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.381082 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.381133 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:54.381197 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.381269 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.381408 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7386496}
I20260709 12:26:54.018947 24225 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:54.879104 24246 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:54.879519 24225 raft_consensus.cc:697] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:54.846588 24151 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.571314 24230 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:54.600203 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 635225us
I20260709 12:26:54.850034 22732 raft_consensus.cc:2393] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:54.498171 24171 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.794924 24156 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:54.848182 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:54.886672 22036 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:54.628571 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:54.887107 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:54.599444 22067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.016s	sys 0.014s
I20260709 12:26:54.390116 24154 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.894711 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 325) took 1302 ms. Trace:
I20260709 12:26:54.404960 24085 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:54.880318 24151 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.794680 24231 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.887401 22140 rpcz_store.cc:276] 0709 12:26:53.036617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.040660 (+  4043us) service_pool.cc:224] Handling call
0709 12:26:53.041062 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.041317 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:53.042719 (+  1402us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.183587 (+1140868us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b1800283300. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e235914bc 00007f1e208df48b 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e2358923a
0709 12:26:54.485283 (+301696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.486173 (+   890us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:54.486240 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.486333 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.486492 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063,"prepare.queue_time_us":1666,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":492141,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":87532,"spinlock_wait_cycles":13317248,"thread_start_us":516348,"threads_started":2,"wal-append.queue_time_us":222298,"wal-append.run_cpu_time_us":1712,"wal-append.run_wall_time_us":1138648}
I20260709 12:26:55.041162 22702 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:55.031220 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.045069 22064 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:54.128567 24217 raft_consensus.cc:3055] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:55.054625 24217 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:55.055837 24217 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:54.847466 22733 rpcz_store.cc:276] 0709 12:26:53.345448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.448829 (+103381us) service_pool.cc:224] Handling call
0709 12:26:53.539252 (+ 90423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:53.539704 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.539747 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:53.580627 (+ 40880us) log.cc:844] Serialized 26 byte log entry
0709 12:26:53.988529 (+407902us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:54.247257 (+258728us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.725782 (+478525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.725890 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.794322 (+ 68432us) raft_consensus.cc:1685] finished
0709 12:26:54.794371 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.794627 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42416,"prepare.queue_time_us":797685,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":9659,"raft.queue_time_us":158730,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":282,"spinlock_wait_cycles":68736,"thread_start_us":996019,"threads_started":3,"wal-append.queue_time_us":528245}
I20260709 12:26:54.989316 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:54.969645 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:54.985536 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:55.053664 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.933049 22138 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:55.060992 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59932 (request call id 1048) took 1041 ms. Trace:
I20260709 12:26:54.498732 23775 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:54.881924 24169 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.016s	sys 0.026s
I20260709 12:26:55.065730 24146 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:55.062579 22184 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.564s (SENT)
I20260709 12:26:55.073580 22184 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:55.073786 22066 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:54.879094 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.075693 24230 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:53.994414 22145 rpcz_store.cc:276] 0709 12:26:52.665755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.665905 (+   150us) service_pool.cc:224] Handling call
0709 12:26:52.666261 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:52.723877 (+ 57616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.723920 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:52.732490 (+  8570us) log.cc:844] Serialized 26 byte log entry
0709 12:26:52.911839 (+179349us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:52.919558 (+  7719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.933130 (+ 13572us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:53.034736 (+101606us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b1800426ca0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e20876c0a 00007f1e29fb6219 00007f1e278bd58f 00007f1e208fc571 00007f1e208fe7c1 00007f1e208fe779 00007f1e208fe709 00007f1e208fe6d1 00007f1e208fd9cd
0709 12:26:53.178032 (+143296us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b1800426ca0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208fc3f3 00007f1e208fe7c1 00007f1e208fe779 00007f1e208fe709 00007f1e208fe6d1 00007f1e208fd9cd 0000000000388634 0000000000388479 00007f1e208df83a
0709 12:26:53.873058 (+695026us) raft_consensus.cc:1685] finished
0709 12:26:53.874620 (+  1562us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.939331 (+ 64711us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29945,"raft.queue_time_us":50667,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6245,"spinlock_wait_cycles":137718528,"thread_start_us":74497,"threads_started":1,"wal-append.queue_time_us":122637,"wal-append.run_cpu_time_us":8303,"wal-append.run_wall_time_us":1736192}
I20260709 12:26:55.077979 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.079324 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.079769 24146 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.080669 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:55.081988 22184 leader_election.cc:336] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.568s (SENT)
I20260709 12:26:55.084374 22702 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:55.084604 22184 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:55.062625 22067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.017s	sys 0.021s
I20260709 12:26:55.063007 22141 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:54.885813 24237 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:55.068408 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.056908 24264 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.069728 22146 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:55.064702 22139 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:55.061677 22215 rpcz_store.cc:276] 0709 12:26:53.592306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.994329 (+402023us) service_pool.cc:224] Handling call
0709 12:26:54.894655 (+900326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:54.933252 24243 raft_consensus.cc:697] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:55.010591 22062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48062 (request call id 390) took 1711 ms (client timeout 1708 ms). Trace:
I20260709 12:26:55.061498 22138 rpcz_store.cc:276] 0709 12:26:54.019493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.025811 (+  6318us) service_pool.cc:224] Handling call
0709 12:26:55.060918 (+1035107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:55.071502 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:54.669941 24242 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.630407 24134 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.883329 24234 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.062243 22137 raft_consensus.cc:2410] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:26:55.084048 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:54.985536 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 416827us
I20260709 12:26:55.134464 23675 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:55.129638 22062 rpcz_store.cc:269] 0709 12:26:53.299055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.310216 (+ 11161us) service_pool.cc:224] Handling call
0709 12:26:54.383786 (+1073570us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4eee 000000000036eb39 00007f1e289381e0 00007f1e28a010c4 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:55.010173 (+626387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39016320}
I20260709 12:26:55.171710 22185 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:55.173507 22145 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:55.174679 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.175932 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:54.845145 24150 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.113436 22217 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:55.018360 24220 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:54.969205 24158 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:55.061743 24249 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:55.121651 22702 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:55.127388 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 45422.1us
W20260709 12:26:55.187233 22184 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.772s (SENT)
I20260709 12:26:55.179809 24158 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:55.188030 24255 log.cc:927] Time spent T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:26:55.124158 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:55.129992 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:55.130059 22140 raft_consensus.cc:2376] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3. Re-sending same reply.
I20260709 12:26:55.066566 24246 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:55.157450 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.180002 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.126766 24240 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:55.184042 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.187772 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:55.123320 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:54.916715 24022 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.196035 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:55.190835 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 69299.6us
I20260709 12:26:55.197068 22137 raft_consensus.cc:2410] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:55.192763 22217 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:55.181005 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.194967 22141 raft_consensus.cc:2368] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:55.200045 24211 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:55.064653 24154 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.199802 22141 raft_consensus.cc:3055] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:55.207291 22066 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:55.194571 24237 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:55.129314 23716 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:55.179077 24242 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.209637 23716 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.211336 24242 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:55.211409 24154 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:55.177299 24134 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.212879 22137 raft_consensus.cc:3055] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:55.213384 22137 raft_consensus.cc:740] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:55.214329 24134 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.179679 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:55.214463 22137 consensus_queue.cc:260] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.185269 24085 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.215749 22137 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:55.216077 24213 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:55.215833 24085 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.216775 22731 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:55.203410 22141 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:55.215137 22138 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:55.177143 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.178965 24234 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.121011 24248 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:54.880543 24225 consensus_queue.cc:237] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.136763 24264 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.180114 24249 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.179538 24220 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.223425 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.199970 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1189) took 1794 ms. Trace:
W20260709 12:26:55.502029 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.349210 22137 raft_consensus.cc:1275] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:55.589121 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:55.453713 24259 log.cc:927] Time spent T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:26:55.303558 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.592335 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.191931 23675 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:55.621564 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 397966us
W20260709 12:26:55.631870 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 444639us
W20260709 12:26:55.632812 22184 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.816s (SENT)
I20260709 12:26:55.633214 22184 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:55.633270 22702 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:55.379958 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 493326us
I20260709 12:26:55.622134 22067 rpcz_store.cc:276] 0709 12:26:53.405906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.945317 (+539411us) service_pool.cc:224] Handling call
0709 12:26:53.960470 (+ 15153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.960675 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:54.070917 (+110242us) log.cc:844] Serialized 14 byte log entry
0709 12:26:55.199534 (+1128617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:55.199609 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:55.199677 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.199781 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.199900 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":320951,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":244430,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":1224898,"threads_started":3,"wal-append.queue_time_us":738278}
W20260709 12:26:55.242005 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 68847.2us
W20260709 12:26:55.515892 24187 consensus_meta.cc:287] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.988s	user 0.007s	sys 0.003s
I20260709 12:26:55.631001 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.242129 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.615113 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1053) took 1205 ms. Trace:
I20260709 12:26:55.637315 22219 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:55.646772 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.381268 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:55.256316 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.590690 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:55.455101 24022 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.202325 24240 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.666518 24240 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:55.649308 24184 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:55.468387 24082 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.669535 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.669706 24274 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:55.669620 24184 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.670226 22070 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:55.671190 24082 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:55.662055 24257 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:55.671885 22216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1711) took 2238 ms (client timeout 2130 ms). Trace:
I20260709 12:26:55.672029 24184 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.660923 24187 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:55.672304 22216 rpcz_store.cc:269] 0709 12:26:53.422509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.422641 (+   132us) service_pool.cc:224] Handling call
0709 12:26:55.241917 (+1819276us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:55.660961 (+419044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16129792}
I20260709 12:26:55.672847 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:55.673481 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.329977 24134 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:55.462759 24231 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.674285 22216 raft_consensus.cc:2393] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:55.674917 22218 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:55.675354 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.675719 24254 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:55.675977 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 327) took 1177 ms. Trace:
I20260709 12:26:55.639436 22144 rpcz_store.cc:276] 0709 12:26:54.409381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.495724 (+ 86343us) service_pool.cc:224] Handling call
0709 12:26:54.726914 (+231190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.067106 (+340192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.067135 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:55.073525 (+  6390us) log.cc:844] Serialized 26 byte log entry
0709 12:26:55.361875 (+288350us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:55.589915 (+228040us) log.cc:844] Serialized 14 byte log entry
0709 12:26:55.614705 (+ 24790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.614787 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:55.614846 (+    59us) raft_consensus.cc:1685] finished
0709 12:26:55.614864 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.615032 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24404,"raft.queue_time_us":143367,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":692935,"threads_started":3,"wal-append.queue_time_us":305552}
W20260709 12:26:55.650195 22111 connection.cc:256] RPC call timeout handler was delayed by -4.3430160469997645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 12:26:55.635717 22036 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:55.649726 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.456188 24158 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.697078 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:55.662382 22735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 660) took 2516 ms. Trace:
I20260709 12:26:55.698424 22735 rpcz_store.cc:276] 0709 12:26:53.126449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.126572 (+   123us) service_pool.cc:224] Handling call
0709 12:26:53.126862 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:54.731141 (+1604279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.642341 (+911200us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540043a8d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:55.642537 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237386624}
I20260709 12:26:55.309478 22141 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.699848 22141 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:55.329486 24268 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:55.664187 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.445182 24258 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.470803 23775 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.444986 24159 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:55.711609 22068 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:55.711989 24159 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.673532 22062 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:55.713688 23775 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:55.676118 22216 raft_consensus.cc:2368] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5.
I20260709 12:26:55.714905 24159 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.715150 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.721582 22736 raft_consensus.cc:1240] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:55.722292 24150 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:55.722904 22736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 670) took 1050 ms. Trace:
I20260709 12:26:55.711599 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.711609 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.724630 22067 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
W20260709 12:26:55.677281 22111 connection.cc:256] RPC call timeout handler was delayed by -4.3430160469997645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 12:26:55.644349 24248 raft_consensus.cc:2804] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:55.652578 22220 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:55.652880 22702 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:55.728343 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 93881.9us
I20260709 12:26:55.654099 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:55.673578 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1019) took 2474 ms. Trace:
I20260709 12:26:55.676314 24254 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.674336 24187 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.455457 24151 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:55.220715 24246 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:55.240876 24237 raft_consensus.cc:697] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:55.680703 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.804113 22215 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:55.681378 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:55.681962 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 46368us
I20260709 12:26:55.683022 24263 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:55.685496 24217 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:55.674288 22069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1187) took 2361 ms (client timeout 2116 ms). Trace:
I20260709 12:26:55.686553 24224 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.675735 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 466) took 2334 ms. Trace:
I20260709 12:26:55.676370 22218 rpcz_store.cc:276] 0709 12:26:54.498418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.498819 (+   401us) service_pool.cc:224] Handling call
0709 12:26:55.675757 (+1176938us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540002d5d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:55.675894 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139299200}
W20260709 12:26:55.815972 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.816696 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.815567 22142 rpcz_store.cc:276] 0709 12:26:53.341550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.441660 (+100110us) service_pool.cc:224] Handling call
0709 12:26:55.674994 (+2233334us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:55.675235 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.675409 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.675433 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:55.675473 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:55.675509 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.675567 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.675676 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34274048}
I20260709 12:26:55.689388 24264 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:26:55.814512 22069 rpcz_store.cc:269] 0709 12:26:53.312756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.312896 (+   140us) service_pool.cc:224] Handling call
0709 12:26:55.674079 (+2361183us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54003985d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:55.674196 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4117986560}
I20260709 12:26:55.632015 23675 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:55.691499 24273 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:26:55.691902 24146 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:55.694794 24240 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.316506 24171 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:55.305472 24156 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:55.706076 22140 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
W20260709 12:26:55.846002 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.011s	sys 0.022s
I20260709 12:26:55.714110 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 392) took 2373 ms. Trace:
I20260709 12:26:55.677654 22137 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
W20260709 12:26:55.847194 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.011s	sys 0.022s
I20260709 12:26:55.723306 22736 rpcz_store.cc:276] 0709 12:26:54.673014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.927646 (+254632us) service_pool.cc:224] Handling call
0709 12:26:54.928118 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.722053 (+793935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.722659 (+   606us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54006beed4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:55.722839 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824293120}
I20260709 12:26:55.734846 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.848272 22068 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:55.733117 22143 rpcz_store.cc:276] 0709 12:26:53.199621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.201272 (+  1651us) service_pool.cc:224] Handling call
0709 12:26:53.924312 (+723040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.925114 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.673373 (+1748259us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540018a450. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:55.673494 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661915392}
I20260709 12:26:55.813078 22702 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:55.850332 22702 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:55.690819 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.817592 22218 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:26:55.852210 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:55.851899 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:55.856894 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 206886us
I20260709 12:26:55.831027 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:55.832000 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.319412 24243 consensus_queue.cc:237] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:55.710161 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 77368.6us
I20260709 12:26:55.871717 22185 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:55.877010 22184 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.940s (SENT)
I20260709 12:26:55.847045 22065 rpcz_store.cc:276] 0709 12:26:53.340918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.341077 (+   159us) service_pool.cc:224] Handling call
0709 12:26:54.453353 (+1112276us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:54.453608 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.955142 (+501534us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:55.125137 (+169995us) log.cc:844] Serialized 14 byte log entry
0709 12:26:55.435565 (+310428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:55.435638 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:55.435707 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.713862 (+278155us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54003e85d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:55.713907 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.714021 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6874,"prepare.queue_time_us":373380,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":171356,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13397,"spinlock_wait_cycles":1550967296,"thread_start_us":434039,"threads_started":2,"wal-append.queue_time_us":554106}
I20260709 12:26:55.871297 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.873759 22215 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:26:55.837502 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:55.836990 23675 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:55.881050 22067 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:55.882055 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 51148.9us
I20260709 12:26:55.877614 22185 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:55.904106 22036 leader_election.cc:400] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5.
I20260709 12:26:55.905601 22036 leader_election.cc:403] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:55.906486 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:55.907305 22218 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 8.
I20260709 12:26:55.912673 22220 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
W20260709 12:26:55.913596 22220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1712) took 2490 ms (client timeout 1575 ms). Trace:
I20260709 12:26:55.920684 22067 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:26:55.914328 22220 rpcz_store.cc:269] 0709 12:26:53.422859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.444410 (+ 21551us) service_pool.cc:224] Handling call
0709 12:26:55.590473 (+2146063us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:55.913495 (+323022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6217600}
W20260709 12:26:55.921712 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44736.7us
I20260709 12:26:55.923003 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.923305 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.935263 22069 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:55.935804 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.923902 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.936296 24172 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:55.936709 22067 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:55.927328 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.930938 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.931075 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.932080 22216 raft_consensus.cc:1240] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:55.932909 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.941433 22731 raft_consensus.cc:2393] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 5: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:55.942766 24085 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:55.934238 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.901072 24175 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:55.899919 24171 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:55.902247 24146 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:55.952487 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:55.963587 22068 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:55.964555 22036 connection.cc:256] RPC call timeout handler was delayed by -1.3979809699994803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:26:55.965226 22036 connection.cc:256] RPC call timeout handler was delayed by -1.3502809700003127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 12:26:55.965620 22036 connection.cc:256] RPC call timeout handler was delayed by -1.1081809699999212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 12:26:55.965994 22036 connection.cc:256] RPC call timeout handler was delayed by -1.0982809699999052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 12:26:55.966356 22036 connection.cc:256] RPC call timeout handler was delayed by -1.0343809699998019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:26:55.952783 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.899718 24156 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:55.953478 22067 raft_consensus.cc:1240] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:55.974743 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.975636 22067 raft_consensus.cc:2368] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5.
I20260709 12:26:55.919181 24268 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5.
I20260709 12:26:55.922673 24264 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:55.979187 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.981734 22737 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:26:55.978735 24225 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:55.991776 22068 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:55.961705 24171 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.990998 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:55.994416 22735 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:55.985886 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:55.822397 24263 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:55.995550 22731 raft_consensus.cc:2410] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:26:55.997313 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.997869 22036 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:55.954270 24175 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.003731 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.000892 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:55.984827 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.973632 24156 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:55.973228 24195 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:56.006024 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.007979 22067 raft_consensus.cc:2393] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 6: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:56.009585 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.986128 24101 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:55.990190 24146 raft_consensus.cc:697] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:26:56.011336 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 161079us
I20260709 12:26:56.023420 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:56.002434 24171 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:55.992681 24248 raft_consensus.cc:697] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:26:56.027407 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 92309.1us
I20260709 12:26:56.001633 24247 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:56.027652 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:55.919271 24237 consensus_queue.cc:237] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.005115 24264 raft_consensus.cc:697] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:56.029601 22068 raft_consensus.cc:2410] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:26:56.010824 24156 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.028436 22702 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.031965 22185 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:56.009272 24175 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.008577 24249 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.022294 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.010661 24224 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.041908 22702 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.042757 22036 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:56.035101 24159 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:26:56.045043 24146 consensus_queue.cc:237] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:56.045693 24282 log.cc:927] Time spent T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:26:56.045914 22062 raft_consensus.cc:2410] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:56.092271 22138 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:56.012887 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.109253 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59932 (request call id 1068) took 1032 ms. Trace:
I20260709 12:26:56.109663 22138 rpcz_store.cc:276] 0709 12:26:55.076970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.179404 (+102434us) service_pool.cc:224] Handling call
0709 12:26:56.109189 (+929785us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:56.110164 22069 raft_consensus.cc:1240] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:56.018679 24195 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.032217 24258 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.046929 24264 consensus_queue.cc:237] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.049644 24122 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.049906 24246 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.050984 24254 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.051772 24220 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:56.052488 24279 log.cc:927] Time spent T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:26:56.028733 24104 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.029007 24247 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:56.056382 24288 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.058158 24240 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.058962 24099 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:56.061844 22214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 315) took 3272 ms (client timeout 1752 ms). Trace:
W20260709 12:26:56.075467 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 43559.4us
I20260709 12:26:56.145272 22185 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:56.076192 23554 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.008625 23663 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:26:56.081593 22728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 662) took 2770 ms. Trace:
I20260709 12:26:56.081735 24263 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:56.026716 24101 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.010221 24225 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.085418 23716 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:56.087950 22063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54728 (request call id 1924) took 3440 ms (client timeout 1671 ms). Trace:
I20260709 12:26:56.092347 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:56.094738 22735 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:56.099206 22141 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
W20260709 12:26:56.105028 22184 leader_election.cc:336] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.766s (SENT)
I20260709 12:26:56.075861 24248 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.147434 23554 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.112116 22067 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.152141 24187 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:56.116796 22070 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 8.
I20260709 12:26:56.122530 24171 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.119614 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:56.144474 22214 rpcz_store.cc:269] 0709 12:26:52.789426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.789565 (+   139us) service_pool.cc:224] Handling call
0709 12:26:56.061643 (+3272078us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400035cd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:56.061774 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2550932736}
I20260709 12:26:56.113103 22062 raft_consensus.cc:1240] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:26:56.158188 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 108820us
I20260709 12:26:56.142311 24247 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.161788 22141 pending_rounds.cc:85] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 6
I20260709 12:26:56.166002 22184 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.166374 22064 raft_consensus.cc:1240] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:56.127149 24249 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.142508 24288 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:56.160699 22063 rpcz_store.cc:269] 0709 12:26:52.647708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.649850 (+  2142us) service_pool.cc:224] Handling call
0709 12:26:56.087769 (+3437919us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400399ed4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:56.087881 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749241216}
I20260709 12:26:56.095520 24236 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:56.113794 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 71962.7us
W20260709 12:26:56.173352 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 53863.7us
W20260709 12:26:56.179639 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 74669.2us
I20260709 12:26:56.180188 22036 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:56.172852 22141 pending_rounds.cc:107] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:26:56.182147 22702 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.182526 22141 raft_consensus.cc:2889] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:56.153149 24258 consensus_queue.cc:1059] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:26:56.170238 23554 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.186297 22736 raft_consensus.cc:2393] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:56.186617 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1066) took 1167 ms. Trace:
I20260709 12:26:56.188886 22141 rpcz_store.cc:276] 0709 12:26:55.019414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.199309 (+179895us) service_pool.cc:224] Handling call
0709 12:26:55.199665 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.186389 (+986724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.186560 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:56.185043 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:56.174831 24164 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.175521 24104 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.176551 24249 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.192811 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.196846 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.191237 24271 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:56.199856 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.184315 24187 raft_consensus.cc:697] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:56.199731 24156 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.200534 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:56.201139 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:56.201592 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.219090 22216 raft_consensus.cc:2393] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 6: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:56.202310 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.203285 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.219650 22215 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:26:56.220165 22737 raft_consensus.cc:2410] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:56.204044 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.204733 24122 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.225824 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.187655 24099 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:56.178962 24288 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.207275 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.209590 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.214851 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.188090 24158 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:56.217945 22067 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:26:56.223519 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.227981 22215 raft_consensus.cc:2393] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:26:56.236135 24294 log.cc:927] Time spent T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:26:56.230261 24099 raft_consensus.cc:697] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:56.237071 24187 consensus_queue.cc:237] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.237948 24099 consensus_queue.cc:237] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.231349 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.240612 22734 raft_consensus.cc:2368] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4.
I20260709 12:26:56.241051 22211 raft_consensus.cc:2410] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:26:56.231876 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:56.232920 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:56.242576 24156 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:56.242689 22064 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.206744 24164 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.244694 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:26:56.245462 24292 log.cc:927] Time spent T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:26:56.151985 22728 rpcz_store.cc:276] 0709 12:26:53.310922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.318812 (+  7890us) service_pool.cc:224] Handling call
0709 12:26:56.075941 (+2757129us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5800034598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:56.080989 (+  5048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.081220 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:56.081251 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:56.081298 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:56.081343 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.081403 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.081528 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47606528}
W20260709 12:26:56.246838 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.247042 24225 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.235350 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.249730 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.211966 24249 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.262527 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.263788 22216 raft_consensus.cc:1240] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:56.265545 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.267990 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:56.268715 22216 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.220861 24271 raft_consensus.cc:697] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:56.274953 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.276585 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.280974 22214 raft_consensus.cc:1275] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:56.279229 22185 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.283147 22185 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.284467 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.284844 24157 consensus_queue.cc:1059] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:26:56.285804 24157 raft_consensus.cc:3055] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:56.286158 24157 raft_consensus.cc:740] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:56.287097 24157 consensus_queue.cc:260] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.288480 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.289347 22062 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:56.290254 22219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1706) took 2951 ms (client timeout 1522 ms). Trace:
W20260709 12:26:56.290647 22219 rpcz_store.cc:269] 0709 12:26:53.339052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.347418 (+  8366us) service_pool.cc:224] Handling call
0709 12:26:55.588902 (+2241484us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:26:56.290078 (+701176us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b540038c7d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:56.290184 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48597120}
I20260709 12:26:56.291815 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.292541 22219 raft_consensus.cc:2393] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:56.266180 24237 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.288616 24157 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.300405 22185 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.304482 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.273037 24281 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:56.317034 24146 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:56.318142 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:56.275177 24195 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:56.294118 24239 consensus_queue.cc:1059] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:26:56.309223 23675 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.311354 22062 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.292575 24271 consensus_queue.cc:237] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.330729 22213 raft_consensus.cc:2393] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:56.303947 24231 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:56.332469 24146 raft_consensus.cc:697] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:56.302150 24237 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.334015 24237 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.333581 24146 consensus_queue.cc:237] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.335693 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.336337 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.336495 22214 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:56.337575 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:56.337873 22214 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.343750 24101 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.301287 24274 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:56.345690 24274 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.346174 24274 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.356969 24214 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:56.325642 24158 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:56.361363 24101 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:56.376094 22184 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.326593 24175 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.329914 23675 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:56.306586 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.345117 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.362071 24101 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.386898 22184 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:56.388726 22184 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:56.392616 24247 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:56.395792 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.397578 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.397637 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:56.398307 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.398329 22138 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.400761 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.401428 22139 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:56.403515 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.404211 22137 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:56.410032 24272 raft_consensus.cc:3055] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:56.410632 24272 raft_consensus.cc:740] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:56.411540 24272 consensus_queue.cc:260] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.412020 24237 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.413614 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:56.417371 24101 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.417634 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.418285 22212 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.418462 22730 raft_consensus.cc:2368] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7.
I20260709 12:26:56.406875 24281 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:56.418946 24175 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:56.419301 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:56.374744 24099 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.380111 24195 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:56.427296 22111 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.016s	sys 0.018s
I20260709 12:26:56.419293 24281 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:56.462284 22111 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.017s	sys 0.018s
W20260709 12:26:56.462709 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 736684us
I20260709 12:26:56.428953 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 336) took 1185 ms. Trace:
I20260709 12:26:56.390705 24158 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:56.433022 24247 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.436221 23675 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.472393 24195 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.463516 22213 rpcz_store.cc:276] 0709 12:26:55.243701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.602573 (+358872us) service_pool.cc:224] Handling call
0709 12:26:56.428687 (+826114us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54000affd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:56.428871 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590521088}
I20260709 12:26:56.477734 22069 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
W20260709 12:26:56.479902 24296 log.cc:927] Time spent T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:26:56.563690 22111 connection.cc:256] RPC call timeout handler was delayed by -4.243116046999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 12:26:56.566084 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.566799 22063 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.567595 22702 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:56.569260 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 180585us
I20260709 12:26:56.569684 22214 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:56.570183 22184 leader_election.cc:400] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:26:56.569311 22216 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.571552 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:56.475811 24281 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.582710 22184 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:56.585393 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:56.587141 22036 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:56.593827 24195 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:56.599524 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.600275 22146 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:56.601162 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.601300 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.601488 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.601749 22146 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:56.602098 22139 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:56.602138 22138 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:56.586623 24187 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.602667 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.603142 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.603284 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.603430 22141 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:56.603770 22145 raft_consensus.cc:2468] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.603971 22140 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:56.604416 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.602596 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:56.605048 22144 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:26:56.605336 22146 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.605494 24237 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.437369 24099 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.591480 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.475244 24288 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:56.637324 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 50273.8us
I20260709 12:26:56.586148 24272 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.646579 22146 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.592263 24268 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:56.648571 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:56.652201 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.652597 22063 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
I20260709 12:26:56.577491 24249 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.649801 22736 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:56.626701 24231 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.655932 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.621845 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.629416 24247 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:56.646211 24151 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.665455 22137 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 1.
I20260709 12:26:56.665654 22702 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.669031 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.655203 22036 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:56.671881 22142 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:26:56.672992 22036 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.674952 22735 raft_consensus.cc:2393] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:56.658780 24271 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:56.676585 24005 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:56.679502 22736 raft_consensus.cc:1240] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:56.669926 24247 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.689627 22036 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.693732 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.694366 22142 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:56.677440 24167 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:56.676851 24271 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.706818 24271 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.698530 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.700453 24249 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:56.700627 23554 consensus_meta.cc:287] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.005s
I20260709 12:26:56.670315 24231 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.693038 24005 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:26:56.695145 24247 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.701539 24099 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.691705 24132 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:56.696826 24167 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:56.713651 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.703194 24274 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:56.720985 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.708043 24195 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.692533 24214 consensus_queue.cc:1059] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:26:56.726446 22066 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1195) took 2706 ms (client timeout 2208 ms). Trace:
I20260709 12:26:56.726970 22065 raft_consensus.cc:1240] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:56.727389 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:56.737367 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:56.736761 22184 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.508s (SENT)
I20260709 12:26:56.738063 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:26:56.734539 22066 rpcz_store.cc:269] 0709 12:26:54.019961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.020907 (+   946us) service_pool.cc:224] Handling call
0709 12:26:56.725427 (+2704520us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54000b40d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:56.726361 (+   934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421787392}
I20260709 12:26:56.738925 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.738000 22141 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:56.740370 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:56.740830 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.722019 24132 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.724633 24167 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.740952 22143 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:56.747031 22036 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:56.724486 24271 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.753103 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.756003 24005 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.756521 24005 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:56.757718 22212 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:56.767827 22184 leader_election.cc:336] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.823s (SENT)
W20260709 12:26:56.768365 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.756944 24005 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.768365 22184 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.715070 23554 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:56.775960 22184 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.908s (SENT)
I20260709 12:26:56.775956 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:56.777408 22184 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:56.779011 22184 leader_election.cc:336] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.915s (SENT)
I20260709 12:26:56.779562 22184 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.739921 24087 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:26:56.750962 24132 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:56.775108 23803 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.781868 24239 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.769397 23663 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:56.794600 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.798200 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:56.798617 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.799057 22143 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:26:56.806589 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 140986us
I20260709 12:26:56.815814 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:56.789496 24171 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:56.827623 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.862742 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:56.863075 22140 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:56.863420 22142 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.859838 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.828564 22702 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.865658 24099 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:56.867883 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.829516 24249 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:56.833326 24157 consensus_meta.cc:287] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.002s
I20260709 12:26:56.790643 24288 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.838675 23554 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:56.840327 24274 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:56.843946 24247 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.793642 24225 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.809791 23663 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:56.846520 24304 log.cc:927] Time spent T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:26:56.848377 24231 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:56.793537 24264 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:56.918867 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.919572 22066 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.852288 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.858876 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.859949 22145 raft_consensus.cc:1240] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:56.869813 22064 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:56.923225 22070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48062 (request call id 407) took 1216 ms. Trace:
I20260709 12:26:56.923887 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.924561 22064 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.871281 22142 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:56.865248 22143 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
I20260709 12:26:56.879025 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.880283 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.881623 22068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:56.923586 22070 rpcz_store.cc:276] 0709 12:26:55.707219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.707411 (+   192us) service_pool.cc:224] Handling call
0709 12:26:56.923073 (+1215662us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54003e71d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:56.923171 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":902366592}
I20260709 12:26:56.927222 22068 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.892896 22069 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:56.900969 22702 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.901345 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.901364 22701 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:56.903724 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 124753us
W20260709 12:26:56.930102 22184 leader_election.cc:336] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.935s (SENT)
W20260709 12:26:56.873014 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.909825 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.933612 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.933737 22143 raft_consensus.cc:3055] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:26:56.932715 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 144594us
I20260709 12:26:56.934114 22143 raft_consensus.cc:740] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:56.911747 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.915021 22140 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:56.902940 22062 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.922506 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:56.930637 22701 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:56.930665 22184 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.866182 24099 raft_consensus.cc:697] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:56.936694 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:56.937605 22141 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:56.939579 22701 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:56.939029 22702 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:26:56.942947 22184 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.059s (SENT)
I20260709 12:26:56.944694 22137 raft_consensus.cc:1275] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:56.946609 22702 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:56.904707 24167 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:56.952632 22111 connection.cc:256] RPC call timeout handler was delayed by -3.0456186179999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:26:56.974246 22111 connection.cc:256] RPC call timeout handler was delayed by -3.0456186179999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 12:26:56.951843 22068 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:56.953864 24264 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.953999 24171 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.954761 22143 consensus_queue.cc:260] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.955479 22071 raft_consensus.cc:1275] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:56.987672 22143 raft_consensus.cc:3060] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.987874 22064 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:26:56.955633 24288 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.957298 24142 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:56.957230 22701 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:56.937285 24103 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:56.961777 23663 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:56.962512 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:56.963270 24247 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:56.966048 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:56.976456 22111 connection.cc:256] RPC call timeout handler was delayed by -2.9115186180006276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 12:26:56.977846 22063 raft_consensus.cc:1240] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:56.938009 24249 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:56.986202 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:56.914601 24005 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:56.990378 22701 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:56.957827 24240 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.917871 24225 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.951877 22066 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:57.002862 22071 raft_consensus.cc:1275] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:57.040498 24099 consensus_queue.cc:237] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.044811 22068 raft_consensus.cc:1275] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:57.001430 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:26:57.005693 22111 connection.cc:256] RPC call timeout handler was delayed by -2.9115186180006276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:26:57.045733 22111 connection.cc:256] RPC call timeout handler was delayed by -2.813418618000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:26:57.046092 22111 connection.cc:256] RPC call timeout handler was delayed by -2.7342186180003409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 12:26:56.975260 24281 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:56.994522 24237 raft_consensus.cc:2764] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:57.013952 22143 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:26:56.989642 24171 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:57.011305 22185 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:26:57.059427 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 48249.5us
I20260709 12:26:57.017740 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:57.063020 22137 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:56.989526 24288 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:57.016218 24122 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:26:57.021304 22070 raft_consensus.cc:1240] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.022471 22062 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:57.022570 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:57.035821 22035 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:56.993660 24103 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:57.046407 22111 connection.cc:256] RPC call timeout handler was delayed by -2.7342186180003409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 12:26:56.999809 24142 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:57.109738 24142 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.068154 24249 raft_consensus.cc:697] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:57.112167 24103 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.112128 24249 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.049140 22213 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 8.
W20260709 12:26:57.113621 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 77869.1us
I20260709 12:26:57.047945 22141 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:57.052742 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 62436.4us
I20260709 12:26:57.051240 24132 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.018735 24240 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:57.094535 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.107061 22111 connection.cc:256] RPC call timeout handler was delayed by -2.6712186180002391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:26:57.120827 22111 connection.cc:256] RPC call timeout handler was delayed by -2.6712186180002391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:26:57.110234 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 87725.1us
I20260709 12:26:57.051082 22143 pending_rounds.cc:85] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 5
I20260709 12:26:57.121536 22143 pending_rounds.cc:107] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.6
I20260709 12:26:57.114821 22035 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:57.123136 22035 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.049989 24164 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:57.052429 22702 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:57.116461 24197 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.116523 24271 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.118013 22701 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:57.118880 24167 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.119410 24005 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:57.065596 22734 raft_consensus.cc:2393] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:57.130164 24281 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:57.067286 22185 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:57.131151 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 69980.3us
W20260709 12:26:57.121209 22111 connection.cc:256] RPC call timeout handler was delayed by -2.6082186180001372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:26:57.131981 22111 connection.cc:256] RPC call timeout handler was delayed by -2.6082186180001372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 12:26:57.132068 22035 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:26:57.132316 22111 connection.cc:256] RPC call timeout handler was delayed by -2.5776186180000877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:26:57.132607 22111 connection.cc:256] RPC call timeout handler was delayed by -2.5776186180000877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:26:57.132858 22111 connection.cc:256] RPC call timeout handler was delayed by -2.5515186180000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 12:26:57.065404 24171 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.015086 24272 consensus_queue.cc:1048] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:26:57.150424 24239 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.133776 24268 raft_consensus.cc:2764] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:57.139219 24197 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.124527 22212 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:57.158828 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.159060 24132 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.139047 24271 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:57.115933 22216 raft_consensus.cc:1240] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:57.124387 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:57.068842 24288 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.161511 22736 raft_consensus.cc:2393] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 9: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:26:57.162381 22065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54728 (request call id 1928) took 1194 ms. Trace:
I20260709 12:26:57.162889 22065 rpcz_store.cc:276] 0709 12:26:55.967729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.083018 (+115289us) service_pool.cc:224] Handling call
0709 12:26:56.726813 (+643795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.735363 (+  8550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.162143 (+426780us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54000b40d0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:57.162304 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479863168}
I20260709 12:26:57.168654 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:57.169454 24315 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:57.106091 24319 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:57.195884 24319 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:57.196484 24319 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.127712 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:57.127815 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:57.068377 24280 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:26:57.133116 22111 connection.cc:256] RPC call timeout handler was delayed by -2.5515186180000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 12:26:57.134196 22143 raft_consensus.cc:2917] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Aborting config change with OpId 3.6: Aborted: Op aborted by new leader
W20260709 12:26:57.134181 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 81858.7us
I20260709 12:26:57.134675 22701 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.133844 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.142215 24122 raft_consensus.cc:2804] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:57.145480 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:26:57.145715 24247 raft_consensus.cc:2804] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.147506 24174 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.178251 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:57.210572 22111 connection.cc:256] RPC call timeout handler was delayed by -2.5083186179999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 12:26:57.222121 22111 connection.cc:256] RPC call timeout handler was delayed by -2.5083186179999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 12:26:57.222409 22111 connection.cc:256] RPC call timeout handler was delayed by -2.4138186180007324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 12:26:57.222681 22111 connection.cc:256] RPC call timeout handler was delayed by -2.4138186180007324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 12:26:57.222957 22111 connection.cc:256] RPC call timeout handler was delayed by -2.2725186180005039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23809999999999998s for a response
I20260709 12:26:57.179563 22213 raft_consensus.cc:1275] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:26:57.223223 22111 connection.cc:256] RPC call timeout handler was delayed by -2.2725186180005039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23809999999999998s for a response
W20260709 12:26:57.223528 22111 connection.cc:256] RPC call timeout handler was delayed by -2.2698186180004996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2384s for a response
W20260709 12:26:57.223798 22111 connection.cc:256] RPC call timeout handler was delayed by -2.2698186180004996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2384s for a response
I20260709 12:26:57.189606 24239 raft_consensus.cc:697] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:26:57.224068 22111 connection.cc:256] RPC call timeout handler was delayed by -1.4328186180000557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33140000000000003s for a response
I20260709 12:26:57.211786 22143 raft_consensus.cc:2889] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:57.212333 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 77732.7us
I20260709 12:26:57.066627 24307 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:26:57.127182 24240 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.218634 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:57.262614 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 44092.8us
W20260709 12:26:57.263998 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.264451 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.204845 22215 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:57.213764 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 80013.6us
I20260709 12:26:57.270789 24195 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.228101 22067 raft_consensus.cc:1240] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.231447 22070 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:26:57.228358 22111 connection.cc:256] RPC call timeout handler was delayed by -1.4328186180000557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33140000000000003s for a response
I20260709 12:26:57.201841 21967 catalog_manager.cc:5697] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 4, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.234887 24171 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.273782 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.273635 21967 catalog_manager.cc:5697] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 2 to 4, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:26:57.274613 24171 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:57.235656 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.275511 22141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
new_leader_uuid: "c9a50b2f586448c49281a6618c40a1f7"
 from {username='slave'} at 127.0.0.1:50602
W20260709 12:26:57.201103 21966 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48108 (request call id 305) took 13005 ms (client timeout 15000 ms). Trace:
I20260709 12:26:57.214023 24288 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.270910 22035 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:57.278453 22035 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.230346 22701 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.280049 24167 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.280392 24271 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:57.280496 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 50222us
I20260709 12:26:57.280872 24271 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:57.280743 24167 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.281355 24271 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.282086 22701 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.274685 22111 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.285043 24288 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.285422 23776 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:57.285717 24288 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.275086 21967 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.288370 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:57.287948 21967 catalog_manager.cc:5697] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.288964 22137 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.289357 22035 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.290102 24195 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:57.290460 24195 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:57.290810 24195 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.215305 24103 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:57.295001 22184 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.237s (SENT)
I20260709 12:26:57.295465 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:57.296753 24103 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.303668 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:57.276096 22141 raft_consensus.cc:606] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Received request to transfer leadership to TS c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:57.316453 22141 raft_consensus.cc:614] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:57.214775 24122 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:57.306248 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:57.322096 22138 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:57.309551 22215 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:26:57.312971 22137 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:57.212622 24162 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:57.326288 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:57.245728 24319 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.207844 24280 raft_consensus.cc:697] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:57.211539 24225 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.214318 23663 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.304569 21967 catalog_manager.cc:5697] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 1 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.301739 24247 raft_consensus.cc:697] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:26:57.276067 21966 rpcz_store.cc:269] 0709 12:26:44.195344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.217663 (+ 22319us) service_pool.cc:224] Handling call
0709 12:26:45.296597 (+1078934us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540032f354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23953090 00007f1e239f1f3a 00007f1e297a7e9c 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:57.201031 (+11904434us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:51.758872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:51.922125 (+163253us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:51.922214 (+    89us) write_op.cc:435] Acquired schema lock
0709 12:26:51.922242 (+    28us) tablet.cc:662] Decoding operations
0709 12:26:52.293716 (+371474us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:52.310844 (+ 17128us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:52.339133 (+ 28289us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:26:52.394821 (+ 55688us) tablet.cc:701] Row locks acquired
0709 12:26:52.394849 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:26:52.395084 (+   235us) write_op.cc:270] Start()
0709 12:26:52.395236 (+   152us) write_op.cc:276] Timestamp: P: 1783600012395021 usec, L: 0
0709 12:26:52.395267 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:26:52.396131 (+   864us) log.cc:844] Serialized 3209 byte log entry
0709 12:26:52.646197 (+250066us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b1800251da0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208ca2a6 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db
0709 12:26:52.949461 (+303264us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:26:53.323955 (+374494us) op_driver.cc:464] REPLICATION: finished
0709 12:26:53.867458 (+543503us) write_op.cc:301] APPLY: starting
0709 12:26:53.872725 (+  5267us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:53.944824 (+ 72099us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:53.949001 (+  4177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:54.227780 (+278779us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:54.481338 (+253558us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:26:54.481414 (+    76us) write_op.cc:312] APPLY: finished
0709 12:26:54.481849 (+   435us) log.cc:844] Serialized 65 byte log entry
0709 12:26:54.864189 (+382340us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:54.864375 (+   186us) write_op.cc:454] Released schema lock
0709 12:26:54.864449 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:54.865014 (+   565us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:54.865046 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":210516,"reported_tablets":21,"spinlock_wait_cycles":668927872,"child_traces":[["op",{"apply.queue_time_us":477250,"apply.run_cpu_time_us":41859,"apply.run_wall_time_us":1037098,"num_ops":8,"prepare.queue_time_us":124370,"prepare.run_cpu_time_us":29607,"prepare.run_wall_time_us":791378,"raft.queue_time_us":195271,"raft.run_cpu_time_us":12763,"raft.run_wall_time_us":269491,"replication_time_us":928431,"spinlock_wait_cycles":48704512,"thread_start_us":942339,"threads_started":5,"wal-append.queue_time_us":500675,"wal-append.run_cpu_time_us":41385,"wal-append.run_wall_time_us":2934555}]]}
I20260709 12:26:57.338232 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:57.389529 22144 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:57.208573 24312 consensus_queue.cc:1059] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 12:26:57.320536 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:57.399195 22139 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.208712 24158 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:26:57.205403 23803 consensus_queue.cc:1059] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 12:26:57.322973 22730 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.350590 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59926 (request call id 82) took 7683 ms. Trace:
I20260709 12:26:57.325050 24122 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:57.321427 24243 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:26:57.353725 23663 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:57.322978 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:57.337781 22140 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.421875 22062 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:57.421945 24309 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.422533 24309 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:57.422904 24309 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.388628 24239 consensus_queue.cc:237] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.394897 24319 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:26:57.326570 24162 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:57.428570 24162 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.429280 24240 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.432335 22736 raft_consensus.cc:1240] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.323194 24272 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:57.433753 24240 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.434070 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:57.434396 24280 consensus_queue.cc:237] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:57.401881 22734 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:57.356134 22035 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:57.405082 22143 rpcz_store.cc:276] 0709 12:26:49.647143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.647342 (+   199us) service_pool.cc:224] Handling call
0709 12:26:50.002785 (+355443us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b58000a58d0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239450aa 00007f1e239c7447 00007f1e239e470a 00007f1e239e576a 00007f1e239e491b 00007f1e239f003c 00007f1e239ef6b3 00007f1e239e79fa 00007f1e289af4c9 00007f1e21f2bc54
0709 12:26:50.065649 (+ 62864us) log.cc:844] Serialized 494 byte log entry
0709 12:26:50.555260 (+489611us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b2c0004c318. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e222e2a11 00007f1e222f1a0a 00007f1e222f1693 00007f1e222f1631 00007f1e23a25b52 00007f1e23a25cf5 00007f1e23962691 00007f1e23942eaa 00007f1e23949d53 00007f1e23949cd9 00007f1e23949c69
0709 12:26:50.753300 (+198040us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b1800211e60. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e23a25d01 00007f1e23962691 00007f1e23942eaa 00007f1e23949d53 00007f1e23949cd9 00007f1e23949c69 00007f1e23949c31 00007f1e23948dfd 0000000000388634 0000000000388479
0709 12:26:57.330434 (+6577134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105421,"raft.run_cpu_time_us":10738,"raft.run_wall_time_us":588506,"spinlock_wait_cycles":719085568,"thread_start_us":188526,"threads_started":1,"wal-append.queue_time_us":188690,"wal-append.run_cpu_time_us":1721,"wal-append.run_wall_time_us":1009528}
I20260709 12:26:57.419314 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:57.420527 24223 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.420887 24222 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.421308 24318 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.146s
I20260709 12:26:57.439682 22142 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.403972 22071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
W20260709 12:26:57.442667 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 168062us
W20260709 12:26:57.444564 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 88532.4us
I20260709 12:26:57.445595 22035 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:57.448688 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:57.449713 22140 raft_consensus.cc:1275] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:57.458760 22142 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:57.439105 23663 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.438689 24271 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:57.451181 24268 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.481824 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.485605 22701 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:57.486799 22701 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:57.487838 22701 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:57.489388 24242 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:57.489876 24242 raft_consensus.cc:697] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:57.490728 24242 consensus_queue.cc:237] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.464172 24223 raft_consensus.cc:697] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:57.493830 24237 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:57.496235 23716 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.472316 22062 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 9.
I20260709 12:26:57.497466 24307 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:57.498047 24307 raft_consensus.cc:697] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:57.497478 24101 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:57.498979 24307 consensus_queue.cc:237] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.501139 22702 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:57.503000 24237 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:57.502796 24247 consensus_queue.cc:237] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.503593 24237 raft_consensus.cc:697] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:57.504766 24237 consensus_queue.cc:237] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.510466 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:57.511235 22144 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.516158 22139 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:26:57.517992 22701 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:26:57.522806 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.444214 24264 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 12:26:57.523274 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 77421.4us
I20260709 12:26:57.496847 23716 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.528019 24223 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.492295 24214 raft_consensus.cc:3055] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.530251 24331 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.549579 24154 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:57.585134 24332 raft_consensus.cc:2804] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:57.627555 22144 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:26:57.628322 22731 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
W20260709 12:26:57.630273 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 161916us
I20260709 12:26:57.596361 24214 raft_consensus.cc:740] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:57.553589 24195 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:57.622109 24087 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.642181 24271 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.620344 24331 raft_consensus.cc:697] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:57.619542 24154 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:57.634878 24332 raft_consensus.cc:697] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:57.682677 22111 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.693007 22062 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:57.697599 23675 raft_consensus.cc:3055] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:26:57.716838 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 167857us
W20260709 12:26:57.736280 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.713459 24335 log.cc:927] Time spent T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:26:57.705339 24249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.020s	sys 0.014s
W20260709 12:26:57.757208 24249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.020s	sys 0.016s
I20260709 12:26:57.757761 24158 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.758023 24332 consensus_queue.cc:237] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.758504 24158 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.760741 24158 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:57.762158 24343 raft_consensus.cc:2764] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:26:57.752380 24254 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.768536 24254 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:57.772230 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.772568 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:57.773725 22064 raft_consensus.cc:2410] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:57.790601 24331 consensus_queue.cc:237] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:57.793540 24154 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:57.848234 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.741361 23675 raft_consensus.cc:740] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:57.846743 24271 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:57.866856 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 235632us
I20260709 12:26:57.850323 24254 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.846264 24281 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:57.793008 24309 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:57.882287 24309 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.708623 24214 consensus_queue.cc:260] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.883822 23663 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:57.886049 24346 consensus_queue.cc:1059] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:57.887012 24346 raft_consensus.cc:3055] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.887403 24346 raft_consensus.cc:740] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:57.887265 24122 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.888535 22737 raft_consensus.cc:1240] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:57.888447 24346 consensus_queue.cc:260] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.891547 24346 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:57.894164 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.893750 24345 consensus_queue.cc:1059] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:26:57.909045 24345 raft_consensus.cc:3055] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:57.909085 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.909585 24345 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:57.910893 22111 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.911101 24318 raft_consensus.cc:2764] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:26:57.911324 22184 leader_election.cc:336] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.690s (SENT)
I20260709 12:26:57.911855 24318 raft_consensus.cc:2764] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:26:57.912367 22111 leader_election.cc:400] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5.
I20260709 12:26:57.912726 22111 leader_election.cc:403] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:57.913733 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.914705 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:26:57.915930 24318 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245) with higher term. Message: Invalid argument: T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5.
I20260709 12:26:57.910507 24345 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.917194 24345 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.919291 23675 consensus_queue.cc:260] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.858215 24307 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:26:57.929343 24195 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:57.941133 24338 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.941788 24338 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.942983 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:57.947530 22070 raft_consensus.cc:2393] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:26:57.943362 22065 raft_consensus.cc:1240] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:57.951799 24346 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:26:57.963765 24142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.000s	sys 0.015s
I20260709 12:26:57.951165 24343 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.877027 24271 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.875357 24162 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.906401 24281 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:57.991957 24281 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:57.977669 24346 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:57.993597 24346 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.997047 24271 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:57.998054 24338 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:58.001892 24122 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:58.008911 23663 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:58.015805 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:58.016702 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:58.019256 22139 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.990003 24162 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:26:57.981792 24142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.000s	sys 0.015s
W20260709 12:26:58.028751 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 113239us
I20260709 12:26:58.032668 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.033327 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:58.034077 22216 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:58.039721 22143 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:57.984850 24343 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:26:58.178879 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.001937 24214 raft_consensus.cc:3060] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:58.184597 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.110348 22219 raft_consensus.cc:1275] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:26:58.132200 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 71396.3us
I20260709 12:26:58.189975 22736 raft_consensus.cc:1240] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:58.162103 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.174240 22139 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:26:58.070246 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.193776 22214 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.132838 22215 raft_consensus.cc:1275] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:26:58.087082 22184 leader_election.cc:336] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.037s (SENT)
W20260709 12:26:58.173008 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 135199us
I20260709 12:26:58.138557 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.052454 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.137594 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.198113 22218 raft_consensus.cc:2393] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:26:58.149910 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.202214 22064 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:58.041944 22144 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:58.200110 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:58.186367 24343 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.210687 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:58.167776 24281 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.213541 22736 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:58.220330 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:58.214458 22702 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:58.104328 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.028232 24316 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.087626 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:26:58.037786 24332 consensus_queue.cc:1059] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.177s
I20260709 12:26:58.216552 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:58.215592 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 128587us
I20260709 12:26:58.218618 22137 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:58.217383 22701 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:58.231529 22737 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:58.228385 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.176124 24357 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.224764 22702 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:58.233153 22184 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.037s (SENT)
I20260709 12:26:58.199537 23663 consensus_queue.cc:1059] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:26:58.239885 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.257551 24319 consensus_queue.cc:1048] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:58.235934 24271 raft_consensus.cc:2764] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:26:58.259945 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.226787 24315 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.245296 24357 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.235503 24354 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:58.229882 24281 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.261595 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:26:58.249788 22111 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:58.262238 22211 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:58.262847 24357 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:58.264173 24281 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:58.135300 24346 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.281498 24332 raft_consensus.cc:3055] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:58.281980 24332 raft_consensus.cc:740] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:26:58.283257 24346 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:58.282932 24332 consensus_queue.cc:260] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.264232 22111 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:58.246788 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:58.266563 22069 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:58.267184 24354 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:58.267699 24319 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:26:58.250270 24358 log.cc:927] Time spent T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:26:58.269243 24316 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.260915 24315 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.273970 23663 raft_consensus.cc:3055] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:58.219563 24132 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:26:58.270596 22702 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:58.277618 22036 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:58.278160 24164 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:58.236819 22214 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:58.286604 22219 raft_consensus.cc:2410] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:58.592124 24271 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.693113 24332 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:58.693698 22212 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:58.285377 22213 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:58.694950 24343 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.562309 24310 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:58.697760 24343 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:58.697360 24310 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.625413 24357 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.251804 24099 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:58.703472 22184 leader_election.cc:336] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.712s (SENT)
W20260709 12:26:58.361323 24329 log.cc:927] Time spent T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 1.102s	user 0.008s	sys 0.000s
I20260709 12:26:58.693267 24271 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:58.346244 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.523639 24214 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.715561 24214 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.521044 24281 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.717572 24281 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.718127 24271 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:58.692756 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.227536 24122 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:58.701586 24315 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:58.328362 24331 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:58.306684 24222 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.398s
I20260709 12:26:58.327396 24087 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:58.706599 24316 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:58.706923 23663 raft_consensus.cc:740] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:58.252054 24247 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:58.287277 24242 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.407s
I20260709 12:26:58.706624 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:58.326596 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 62463.2us
W20260709 12:26:58.474382 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.710108 24167 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.469964 22211 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 9.
W20260709 12:26:58.711835 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 434259us
I20260709 12:26:58.698918 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:58.698987 24357 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:58.731333 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 466642us
W20260709 12:26:58.756893 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.701876 24310 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:58.763665 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:58.818006 22218 raft_consensus.cc:2410] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:26:58.782907 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.790905 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 441) took 1485 ms. Trace:
I20260709 12:26:58.730136 24122 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:58.792598 24328 log.cc:927] Time spent T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 1.264s	user 0.004s	sys 0.011s
I20260709 12:26:58.796535 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:26:58.803342 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.791910 24320 log.cc:927] Time spent T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 1.494s	user 0.007s	sys 0.015s
I20260709 12:26:58.729580 24164 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:58.818596 22066 rpcz_store.cc:276] 0709 12:26:57.305625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.305736 (+   111us) service_pool.cc:224] Handling call
0709 12:26:58.790139 (+1484403us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:58.790353 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.790551 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.790576 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:58.790626 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:58.790654 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.790719 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.790844 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20358400}
I20260709 12:26:58.820223 22219 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:58.779872 24319 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:58.779569 24271 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:58.780334 24264 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.797465 24315 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.827171 22214 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:58.827332 22213 raft_consensus.cc:1275] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:58.843354 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:58.843804 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:58.844003 22141 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:58.844372 22142 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.845992 22138 raft_consensus.cc:1240] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:58.847059 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:58.847599 22138 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.850241 22215 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:58.780234 24099 raft_consensus.cc:697] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:58.789881 24087 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.831692 22218 raft_consensus.cc:3055] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:58.876035 22218 raft_consensus.cc:740] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:58.815663 24316 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.822507 24310 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:58.875029 22035 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:58.825390 24122 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.892064 22138 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:58.832708 24367 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.893476 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:58.819640 24167 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.911206 22140 raft_consensus.cc:2410] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:26:58.917337 21952 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf83ee90e33b4083aebda67b32ca1149 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:26:58.893657 24316 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.888221 22218 consensus_queue.cc:260] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.921499 22218 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:58.922657 24316 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:58.871896 24315 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.922895 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:58.923967 22062 raft_consensus.cc:1240] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:58.924453 22066 raft_consensus.cc:1240] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:58.924693 24315 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:58.925344 22064 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:58.844830 24264 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.916136 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:58.874374 24318 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:26:58.927603 22069 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:58.927896 24318 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.927627 24264 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:58.884315 24164 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:26:58.920799 22140 raft_consensus.cc:1240] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:58.931272 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:58.933020 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:26:58.933301 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 113970us
I20260709 12:26:58.934548 22036 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:26:58.934988 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:58.935240 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:58.935547 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:58.933717 22064 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:58.941566 22218 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:58.943133 22141 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:26:58.943882 22218 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:58.946522 22142 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:26:58.835824 24271 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.952162 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:58.957161 22138 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 6: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
W20260709 12:26:58.957544 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 141835us
I20260709 12:26:58.931493 24214 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:58.963891 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1741) took 2012 ms. Trace:
I20260709 12:26:58.964406 22220 rpcz_store.cc:276] 0709 12:26:56.944201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.944677 (+   476us) service_pool.cc:224] Handling call
0709 12:26:57.215525 (+270848us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4eee 000000000036eb39 00007f1e289381e0 00007f1e28a010c4 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:57.215668 (+   143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:57.216045 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:57.216071 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:57.216500 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:26:57.443317 (+226817us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:57.443355 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.443415 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.791878 (+1348463us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:26:58.956114 (+164236us) raft_consensus.cc:1685] finished
0709 12:26:58.956143 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.956303 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":376,"raft.queue_time_us":5105,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":71827,"spinlock_wait_cycles":8878336,"thread_start_us":226478,"threads_started":1,"wal-append.queue_time_us":311530}
I20260709 12:26:58.886401 24371 consensus_queue.cc:1059] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 12:26:58.974661 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 44041.5us
I20260709 12:26:58.894439 24310 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.936745 24369 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.953054 24316 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.955701 24354 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:58.979449 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 245064us
I20260709 12:26:58.950335 24370 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:58.962436 24142 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.968031 24229 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:58.973763 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:58.922912 24367 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:58.974205 24318 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:58.978355 22735 raft_consensus.cc:1240] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:58.993641 22066 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:58.973683 24213 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:58.918215 23663 consensus_queue.cc:260] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.005330 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:59.012739 22140 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:59.008980 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:59.013729 22066 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:26:59.011483 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:59.014691 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:59.014704 22735 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:26:59.015646 22111 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:26:59.015964 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:59.020303 22111 leader_election.cc:400] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4.
I20260709 12:26:59.020790 22111 leader_election.cc:403] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:59.022140 22111 leader_election.cc:400] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7.
I20260709 12:26:59.022300 22733 raft_consensus.cc:1275] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:59.022604 22111 leader_election.cc:403] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:59.027804 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:59.028604 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 142899us
I20260709 12:26:58.998587 24229 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:58.983439 24319 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:26:59.009509 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:59.036950 22701 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:59.006603 24281 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:59.009738 24264 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.021039 24357 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:59.031783 22729 raft_consensus.cc:1240] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:59.026497 24318 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.986742 24369 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.031575 24343 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:58.988832 24316 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:59.091457 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 117186us
I20260709 12:26:58.998873 24142 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:58.983139 24099 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:59.098564 22184 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.342s (SENT)
I20260709 12:26:59.046967 24229 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.018373 24214 consensus_queue.cc:1059] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:26:59.049340 24354 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7.
W20260709 12:26:59.108707 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 86656.7us
I20260709 12:26:59.026746 24315 consensus_queue.cc:1059] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:26:59.110543 22731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34992 (request call id 484) took 2906 ms (client timeout 2021 ms). Trace:
I20260709 12:26:59.017499 24213 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:59.112548 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 66598.8us
W20260709 12:26:59.126099 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 112196us
W20260709 12:26:59.097760 24360 log.cc:927] Time spent T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:26:58.997926 24370 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:59.129417 22731 rpcz_store.cc:269] 0709 12:26:56.193016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.193212 (+   196us) service_pool.cc:224] Handling call
0709 12:26:59.098935 (+2905723us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54005f1c54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:26:59.099045 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3160330112}
W20260709 12:26:59.131098 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 94268us
I20260709 12:26:59.108769 22728 raft_consensus.cc:1240] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:59.138356 24171 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:59.110008 24376 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:59.145722 22111 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:59.064105 24264 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.128844 24237 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:26:59.151391 22184 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.565s (SENT)
I20260709 12:26:59.152670 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:59.155077 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:59.150918 24354 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.140935 24380 raft_consensus.cc:3055] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:59.136770 24318 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.158785 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:59.149648 24381 raft_consensus.cc:3055] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:59.143752 24171 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.172358 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:59.146960 24167 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:59.150306 24214 consensus_queue.cc:1059] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:26:59.160097 24379 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.194568 24354 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.160248 24380 raft_consensus.cc:740] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:59.155997 24343 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:26:59.175248 24381 raft_consensus.cc:740] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:59.160219 24383 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:26:59.159282 24237 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.177835 24318 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:59.379714 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.184432 24171 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.380946 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1755) took 1143 ms. Trace:
I20260709 12:26:59.283746 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1756) took 1045 ms. Trace:
W20260709 12:26:59.236032 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.396095 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 215938us
W20260709 12:26:59.205657 22184 leader_election.cc:336] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.489s (SENT)
I20260709 12:26:59.429494 22219 rpcz_store.cc:276] 0709 12:26:58.237795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.333490 (+1095695us) service_pool.cc:224] Handling call
0709 12:26:59.380257 (+ 46767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.380517 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.380554 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.380612 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:59.380661 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.380735 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.380873 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:59.432026 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 226407us
I20260709 12:26:59.186458 24271 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:59.432345 22702 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:59.422302 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.430394 22214 rpcz_store.cc:276] 0709 12:26:58.238088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.888089 (+650001us) service_pool.cc:224] Handling call
0709 12:26:58.920345 (+ 32256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.027330 (+106985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.027377 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.027428 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:59.027472 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.283396 (+255924us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000983d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:59.283466 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.283658 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245460864}
I20260709 12:26:59.187729 24310 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:59.320699 24378 log.cc:927] Time spent T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.193s	user 0.000s	sys 0.004s
W20260709 12:26:59.440191 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.439711 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 267621us
I20260709 12:26:59.296432 24281 raft_consensus.cc:3055] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:59.316962 24332 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.278650 23716 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:59.378129 23675 raft_consensus.cc:3060] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.321799 22212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 359) took 1285 ms. Trace:
I20260709 12:26:59.286562 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:59.464246 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 305662us
I20260709 12:26:59.495412 22111 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:26:59.441926 24373 log.cc:927] Time spent T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 12:26:59.433267 24376 raft_consensus.cc:697] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:59.497198 22146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.008s
I20260709 12:26:59.424930 24312 consensus_queue.cc:1059] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:26:59.319978 24156 consensus_queue.cc:1059] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
W20260709 12:26:59.451303 24122 consensus_meta.cc:287] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 12:26:59.333914 24377 consensus_queue.cc:1048] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:26:59.439739 24397 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:59.500283 22146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.005s	sys 0.009s
W20260709 12:26:59.454469 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 520500us
I20260709 12:26:59.492275 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:59.447109 22145 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:26:59.509402 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.520279 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.443159 24393 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.518788 24332 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:59.456357 24281 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:26:59.486675 24389 log.cc:927] Time spent T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:26:59.502451 24371 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:26:59.523087 24156 raft_consensus.cc:3055] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:59.523633 24397 raft_consensus.cc:697] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:59.524493 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 70044.4us
I20260709 12:26:59.524272 24381 consensus_queue.cc:260] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.510869 24357 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.500000 22730 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:26:59.524940 24122 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.526798 22036 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:59.511960 24316 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:59.518811 22111 leader_election.cc:400] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5.
W20260709 12:26:59.518838 22037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.008s
I20260709 12:26:59.496817 24331 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4.
I20260709 12:26:59.502779 24367 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:26:59.522117 22702 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:59.561148 24254 raft_consensus.cc:2804] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:59.561745 24254 raft_consensus.cc:697] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:26:59.562028 23909 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:59.562431 24375 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:59.501291 24142 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:59.540359 22035 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:59.516562 24213 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:59.532987 24370 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:26:59.581991 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 55262.5us
I20260709 12:26:59.551323 24415 raft_consensus.cc:3055] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:59.536315 24156 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:26:59.554003 24318 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:59.495092 22212 rpcz_store.cc:276] 0709 12:26:58.036585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.060948 (+ 24363us) service_pool.cc:224] Handling call
0709 12:26:58.109336 (+ 48388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.694158 (+584822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.321419 (+627261us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000974d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:26:59.321710 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343006464}
I20260709 12:26:59.595021 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:59.562297 24381 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.508425 24239 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:59.591717 24164 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:59.604959 24156 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.612411 24156 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.563797 24264 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:59.576100 22111 leader_election.cc:400] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6.
I20260709 12:26:59.541631 24371 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:26:59.583922 22184 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.508s (SENT)
W20260709 12:26:59.584685 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44435.4us
I20260709 12:26:59.585711 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:59.583570 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:59.544409 23716 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.529114 24229 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:59.556553 22037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.015s	sys 0.008s
I20260709 12:26:59.543092 24383 consensus_queue.cc:1059] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:26:59.544636 24357 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:26:59.660863 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 77371.7us
W20260709 12:26:59.643608 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.655516 22111 leader_election.cc:403] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:59.586180 24415 raft_consensus.cc:740] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:26:59.562747 24254 consensus_queue.cc:237] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.586086 24401 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:26:59.606015 24392 consensus_queue.cc:1048] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:26:59.663801 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 475129us
I20260709 12:26:59.656312 22184 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:26:59.654651 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:26:59.661365 24213 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.666662 24213 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.662328 22035 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:26:59.592252 24369 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:26:59.607656 24122 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:59.581775 23776 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:26:59.593611 24376 consensus_queue.cc:237] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.694321 24413 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6.
I20260709 12:26:59.706073 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:59.706629 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:59.581768 23976 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:26:59.600673 24403 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.688760 24415 consensus_queue.cc:260] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.609642 24164 raft_consensus.cc:697] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:26:59.787038 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 205734us
I20260709 12:26:59.530499 24380 consensus_queue.cc:260] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.695089 22185 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:26:59.665236 24167 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.679836 24264 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.700109 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:59.704154 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 120322us
I20260709 12:26:59.706923 22730 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 6: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
W20260709 12:26:59.710162 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 49629.2us
I20260709 12:26:59.712354 24391 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:26:59.711093 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:26:59.695564 24087 consensus_meta.cc:287] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.007s
I20260709 12:26:59.713374 22142 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:59.693722 24338 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.743870 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:59.695314 24381 consensus_queue.cc:1059] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:26:59.771811 24271 raft_consensus.cc:3055] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:59.734860 24413 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:59.694101 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 137146us
W20260709 12:26:59.744819 24405 log.cc:927] Time spent T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:26:59.761723 24417 log.cc:927] Time spent T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:26:59.734831 24383 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:00.005029 22137 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:59.979773 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:26:59.767179 24407 consensus_queue.cc:1059] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:59.761518 24415 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.709537 24370 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:59.777550 22734 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:59.773835 24411 log.cc:927] Time spent T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:26:59.736876 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:26:59.825742 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 130889us
W20260709 12:26:59.835927 22184 leader_election.cc:336] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.569s (SENT)
I20260709 12:26:59.699657 24214 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:27:00.039790 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 330787us
I20260709 12:26:59.609532 24239 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.844391 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:00.055352 22138 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.846060 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:26:59.991708 24379 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:59.880719 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.952023 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:26:59.608983 24397 consensus_queue.cc:237] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.825487 24167 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:59.898412 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.007632 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.995029 22111 leader_election.cc:400] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5.
W20260709 12:27:00.070101 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.070484 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 75687.9us
I20260709 12:27:00.018311 24264 raft_consensus.cc:3055] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:00.038255 22184 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:00.076470 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 240575us
W20260709 12:27:00.077278 22184 leader_election.cc:336] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.640s (SENT)
I20260709 12:27:00.077760 22184 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:00.079222 22184 leader_election.cc:336] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.710s (SENT)
I20260709 12:26:59.941453 24390 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.877562 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:26:59.991830 24354 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.942160 24213 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:27:00.044629 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:00.004235 24391 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.970657 24087 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.049059 23776 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:00.049069 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:00.014334 24413 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:00.052769 21952 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf83ee90e33b4083aebda67b32ca1149 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 85f0d4cf04de40aa9e25849fb2380466 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:00.211061 21952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 158340us
W20260709 12:27:00.211156 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 162154us
I20260709 12:27:00.054087 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1852) took 1218 ms. Trace:
I20260709 12:26:59.680049 24401 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:26:59.929455 24419 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:00.064908 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:00.066026 22185 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:26:59.989984 24271 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:00.109508 22138 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:26:59.984025 24171 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.004276 24338 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:26:59.849684 24223 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.215s
I20260709 12:27:00.091101 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:00.246409 22220 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.086364 22111 leader_election.cc:400] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6.
W20260709 12:27:00.247674 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 161528us
I20260709 12:27:00.248940 22111 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:00.156627 22737 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:00.160221 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.255147 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.255647 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.065011 24229 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:26:59.949695 24164 consensus_queue.cc:237] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:00.083740 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.170254 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 125715us
I20260709 12:27:00.080687 24167 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.075603 24264 raft_consensus.cc:740] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:00.126387 24388 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.091223 24369 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.019909 24383 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.163105 24407 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.167896 24318 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:00.277341 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 532) took 1273 ms. Trace:
I20260709 12:27:00.213397 22146 rpcz_store.cc:276] 0709 12:26:58.835637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.835756 (+   119us) service_pool.cc:224] Handling call
0709 12:26:58.836120 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.935472 (+ 99352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.935498 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.935975 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.518631 (+582656us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:59.518670 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.518734 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.053788 (+535054us) raft_consensus.cc:1685] finished
0709 12:27:00.053820 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.054005 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13216,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8897,"thread_start_us":649264,"threads_started":2,"wal-append.queue_time_us":645243}
W20260709 12:27:00.218933 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 139751us
W20260709 12:27:00.216207 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 150266us
I20260709 12:27:00.291626 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:00.292265 22071 raft_consensus.cc:1275] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:27:00.292773 22185 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:00.129817 24332 consensus_queue.cc:1059] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:27:00.168426 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:00.075150 24379 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.206185 24357 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:00.217530 24307 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:00.153455 24354 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.279431 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.279608 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.278967 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:27:00.306144 22184 leader_election.cc:336] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.901s (SENT)
I20260709 12:27:00.276500 22211 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:27:00.272068 24420 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:00.287056 22140 rpcz_store.cc:276] 0709 12:26:59.004476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.018682 (+ 14206us) service_pool.cc:224] Handling call
0709 12:26:59.018946 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.019333 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.019358 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.030879 (+ 11521us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.316550 (+285671us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b4800181ed8. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e28912aa1 00007f1e28909b37 00007f1e289099ca 00007f1e28a0126f 00007f1e28a00f37 00007f1e28a1555c 00007f1e28a15508 00007f1e28a15488 00007f1e28a15443 00007f1e28a146ec 00007f1e2793ea96
0709 12:26:59.488827 (+172277us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:59.488950 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.489143 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.270111 (+780968us) raft_consensus.cc:1685] finished
0709 12:27:00.270130 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.277254 (+  7124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":2614,"raft.run_wall_time_us":290516,"spinlock_wait_cycles":10615168,"thread_start_us":394239,"threads_started":1,"wal-append.queue_time_us":596757}
I20260709 12:27:00.297830 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.276434 24431 raft_consensus.cc:3055] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:00.219065 24419 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.267515 24390 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.278795 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.287302 24410 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:00.307000 22184 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.966s (SENT) [suppressed 46 similar messages]
I20260709 12:27:00.306941 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:00.320317 24419 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.345988 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 440) took 3042 ms. Trace:
I20260709 12:27:00.357753 24399 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.358661 24399 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:00.359175 24156 consensus_meta.cc:287] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.003s
I20260709 12:27:00.355547 22067 rpcz_store.cc:276] 0709 12:26:57.303494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.303622 (+   128us) service_pool.cc:224] Handling call
0709 12:26:58.734754 (+1431132us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:58.735016 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.023566 (+288550us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:59.023612 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.024192 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.530715 (+506523us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b18003dea60. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e235914bc 00007f1e208df48b 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e235890d1
0709 12:26:59.530850 (+   135us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:59.530883 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.345515 (+814632us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54000cb054. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:00.345596 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.345666 (+    70us) raft_consensus.cc:1685] finished
0709 12:27:00.345686 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.345903 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94477,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":41451,"spinlock_wait_cycles":541450240,"thread_start_us":138292,"threads_started":2,"wal-append.queue_time_us":119496}
W20260709 12:27:00.305900 23675 consensus_meta.cc:287] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.002s
I20260709 12:27:00.347283 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 445) took 2913 ms. Trace:
I20260709 12:27:00.349648 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1849) took 1514 ms. Trace:
I20260709 12:27:00.350678 24379 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.352110 24413 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:00.352731 24239 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:00.354041 24171 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:00.314348 22139 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.362627 22068 rpcz_store.cc:276] 0709 12:26:57.433552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.437838 (+  4286us) service_pool.cc:224] Handling call
0709 12:26:58.761775 (+1323937us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4eee 000000000036eb39 00007f1e289381e0 00007f1e28a010c4 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:58.762004 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.982404 (+220400us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:59.453620 (+471216us) log.cc:844] Serialized 14 byte log entry
0709 12:26:59.537068 (+ 83448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.537119 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:59.537199 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.347000 (+809801us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400283f54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:00.347065 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.347214 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8659,"prepare.queue_time_us":211375,"prepare.run_cpu_time_us":11432,"prepare.run_wall_time_us":216918,"raft.queue_time_us":1055,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1415,"spinlock_wait_cycles":510678144,"thread_start_us":530750,"threads_started":2,"wal-append.queue_time_us":219391}
I20260709 12:27:00.363152 22143 rpcz_store.cc:276] 0709 12:26:58.834822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.835879 (+  1057us) service_pool.cc:224] Handling call
0709 12:26:59.268371 (+432492us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:00.348592 (+1080221us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4e9c 00007f1e208c4a5b 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:00.348833 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.349075 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.349113 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.349306 (+   193us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:00.349359 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.349447 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.349578 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138736640}
I20260709 12:27:00.320535 22220 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:27:00.309027 24357 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.410053 22067 raft_consensus.cc:1240] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:00.410866 22141 raft_consensus.cc:1240] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:00.312443 24420 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.295701 24407 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.297919 24318 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.308409 24214 consensus_queue.cc:1048] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 12:27:00.595685 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.309518 24264 consensus_queue.cc:260] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.429922 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:00.617882 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:00.528203 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 92527us
I20260709 12:27:00.341192 24315 raft_consensus.cc:3055] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:00.325453 23663 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:00.533798 22216 raft_consensus.cc:2468] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:27:00.327823 24424 log.cc:927] Time spent T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:27:00.331620 24426 log.cc:927] Time spent T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:27:00.334214 24410 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:00.331153 24423 log.cc:927] Time spent T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:27:00.562480 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 255472us
I20260709 12:27:00.639479 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:00.640600 22035 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:00.339843 24383 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:00.317916 24431 raft_consensus.cc:740] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:00.598770 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.338186 24401 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.332662 24338 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:00.334517 24390 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:00.669947 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.671344 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.672478 24390 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.672649 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.409022 24404 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:00.673050 24390 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.673748 24404 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.675242 24390 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.675781 24390 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.676188 24404 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:00.527546 24413 raft_consensus.cc:3055] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:00.676857 24413 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
W20260709 12:27:00.639797 24370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.028s
I20260709 12:27:00.653497 24381 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.658098 24434 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.644266 24315 raft_consensus.cc:740] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:00.642889 24420 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:00.668143 22184 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.026s (SENT)
I20260709 12:27:00.490427 24379 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:00.527495 24435 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.491430 24369 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.633104 24332 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.682649 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.660502 22139 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:27:00.713405 22220 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:00.715003 22220 raft_consensus.cc:3055] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:00.715464 22220 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:00.695051 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.690412 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:00.683419 24370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.029s
I20260709 12:27:00.670502 24264 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:00.722519 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 54405.7us
W20260709 12:27:00.813951 22184 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 3.247s (SENT)
I20260709 12:27:00.815023 22066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 467) took 1227 ms. Trace:
I20260709 12:27:00.683905 22069 raft_consensus.cc:2410] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:27:00.685822 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 436959us
I20260709 12:27:00.662446 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.824189 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.670418 22070 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:27:00.827651 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.828904 22214 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:00.829855 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.830892 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.831722 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.832350 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:00.812992 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 172419us
I20260709 12:27:00.815742 22066 rpcz_store.cc:276] 0709 12:26:59.587386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.587555 (+   169us) service_pool.cc:224] Handling call
0709 12:26:59.588014 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.588288 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.588326 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.613424 (+ 25098us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.788209 (+174785us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:59.788267 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.788369 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.814056 (+1025687us) raft_consensus.cc:1685] finished
0709 12:27:00.814166 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.814673 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":174339,"threads_started":1,"wal-append.queue_time_us":456001}
I20260709 12:27:00.841215 22035 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:00.842649 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:00.716403 22220 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.844799 22220 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:00.849994 22062 raft_consensus.cc:2393] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:27:00.711839 24101 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:00.677132 24167 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.875181 24167 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.755853 24315 consensus_queue.cc:260] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.730675 24332 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.892740 24315 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.894824 24332 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.755749 24354 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.687511 24381 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.730957 24357 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.730820 24369 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.898313 24229 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:00.729760 24370 raft_consensus.cc:697] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:27:00.694267 24387 log.cc:927] Time spent T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 1.343s	user 0.006s	sys 0.000s
I20260709 12:27:00.686152 24391 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:00.902493 24457 consensus_queue.cc:1059] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:00.676244 24390 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.908644 24390 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.910311 22702 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:00.910818 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 382) took 1332 ms. Trace:
I20260709 12:27:00.911516 22211 rpcz_store.cc:276] 0709 12:26:59.578512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.582161 (+  3649us) service_pool.cc:224] Handling call
0709 12:27:00.910303 (+1328142us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400312c54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:00.910559 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393809280}
I20260709 12:27:00.768307 24419 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.915874 24419 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.904744 24457 raft_consensus.cc:3055] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:00.916706 24457 raft_consensus.cc:740] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
W20260709 12:27:00.918491 22216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 357) took 2883 ms (client timeout 1736 ms). Trace:
W20260709 12:27:00.919196 22216 rpcz_store.cc:269] 0709 12:26:58.034986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.149079 (+114093us) service_pool.cc:224] Handling call
0709 12:27:00.917916 (+2768837us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54001e0354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:00.918164 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5054105472}
I20260709 12:27:00.919062 24457 consensus_queue.cc:260] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.735617 24379 raft_consensus.cc:697] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:00.688244 24434 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.943091 22217 raft_consensus.cc:1275] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:00.945240 24370 consensus_queue.cc:237] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:00.946301 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.726797 24435 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.751817 24431 consensus_queue.cc:260] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:00.738508 24436 log.cc:927] Time spent T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:27:00.941205 24174 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:00.766916 24415 consensus_meta.cc:287] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.736s	user 0.007s	sys 0.004s
I20260709 12:27:00.953810 24174 raft_consensus.cc:697] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:00.751521 24439 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.955286 24439 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.955595 24174 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.958273 22218 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:00.733872 24442 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.757715 24407 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:00.980340 24449 consensus_queue.cc:1059] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:27:00.779073 24420 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.985893 24390 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.986796 24390 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.862087 24101 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.875466 24399 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:00.688694 24281 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.997591 24281 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.998267 24434 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.998588 24271 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.879302 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:00.989034 24420 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.881057 22212 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:00.888358 24156 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:00.895342 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56596 (request call id 539) took 1043 ms. Trace:
I20260709 12:27:01.003324 24237 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.003790 22139 rpcz_store.cc:276] 0709 12:26:59.851952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.951765 (+ 99813us) service_pool.cc:224] Handling call
0709 12:27:00.894783 (+943018us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002d4bd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:00.895089 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570818816}
I20260709 12:27:00.739328 24413 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:00.904824 22736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 693) took 1929 ms. Trace:
W20260709 12:27:00.928546 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 84946.4us
I20260709 12:27:01.005900 22736 rpcz_store.cc:276] 0709 12:26:58.975156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.975264 (+   108us) service_pool.cc:224] Handling call
0709 12:26:58.975574 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.977969 (+  2395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.977995 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.978428 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.128699 (+150271us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:59.128740 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.128985 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.693729 (+1564744us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:27:00.903998 (+210269us) raft_consensus.cc:1685] finished
0709 12:27:00.904043 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.904530 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3925,"raft.queue_time_us":5505,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2261,"spinlock_wait_cycles":42090240,"thread_start_us":127011,"threads_started":1,"wal-append.queue_time_us":198633}
I20260709 12:27:01.008368 24431 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.890990 22036 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:00.946815 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.929677 24229 raft_consensus.cc:697] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:00.953387 24338 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.959488 22220 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:00.963140 24435 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.977895 24441 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:00.981766 24449 raft_consensus.cc:3055] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:00.964423 24442 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:00.985450 24439 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:00.964531 24379 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:01.024757 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.025312 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.025822 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.026374 24442 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.025342 24420 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.027457 24441 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.028565 24420 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.030508 24441 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.030874 24420 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.031756 24338 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.035192 24338 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.036041 24156 consensus_queue.cc:1059] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:01.037593 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:01.038475 22212 raft_consensus.cc:2376] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5. Re-sending same reply.
I20260709 12:27:00.995046 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.039923 24229 consensus_queue.cc:237] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.021615 24449 raft_consensus.cc:740] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:01.047998 22702 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:01.041288 24390 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.051775 24392 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:01.052335 24392 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.052352 24380 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:01.059644 24156 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.060139 24167 raft_consensus.cc:3055] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:01.060732 24167 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:27:01.061369 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.060364 24156 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:01.063277 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 202561us
I20260709 12:27:01.063541 22185 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:01.064498 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:01.064728 24315 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:01.065685 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 43583.1us
I20260709 12:27:01.052779 24392 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.064530 24156 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.077945 24315 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.094331 24315 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.098376 24410 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:01.098567 24467 log.cc:927] Time spent T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:27:01.099086 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.099476 24101 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.099938 24171 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:01.100867 22065 raft_consensus.cc:1240] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.101300 22063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:01.117223 24167 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.118842 24167 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.123121 24370 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.124001 24370 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.125986 22140 raft_consensus.cc:1275] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:01.048069 24449 consensus_queue.cc:260] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.129984 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.131098 22143 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:01.115399 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:01.156927 22062 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:01.160478 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 96179.2us
I20260709 12:27:01.127561 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.155411 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:01.198146 22063 raft_consensus.cc:2393] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
I20260709 12:27:01.151021 24156 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:01.156466 24468 log.cc:927] Time spent T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:01.209411 24427 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.215794 24087 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.157043 24403 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:01.218252 24264 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:01.158113 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:01.226734 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.228660 24465 log.cc:927] Time spent T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:27:01.231019 22141 raft_consensus.cc:3055] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:01.231592 22141 raft_consensus.cc:740] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:01.233937 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:01.231335 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 133303us
I20260709 12:27:01.212924 24318 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.236334 22139 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:01.238126 22070 raft_consensus.cc:2468] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:01.232883 22141 consensus_queue.cc:260] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:01.266664 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.292488 24156 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.296295 24370 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.296706 24156 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.297014 22036 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:01.298079 24476 log.cc:927] Time spent T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:27:01.301455 24318 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.302354 24318 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.306591 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.313830 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.314024 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.315820 22730 raft_consensus.cc:2393] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 2: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:01.315642 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.249351 22145 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:01.318192 24379 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.318982 24379 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.321743 24379 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.321967 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.321985 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.322817 24379 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.323971 24370 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:01.323928 24379 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:01.321959 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 97495.9us
W20260709 12:27:01.325065 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 81226.2us
W20260709 12:27:01.330111 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 92954.3us
I20260709 12:27:01.331441 24379 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:01.332309 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.332835 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.333276 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.335913 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.338045 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.337190 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:01.337033 24427 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.338894 22212 raft_consensus.cc:1217] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 12:27:01.339570 22212 raft_consensus.cc:1240] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:27:01.337188 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.339231 22729 raft_consensus.cc:2368] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6.
I20260709 12:27:01.336994 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:01.351796 24338 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:01.359763 22062 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:01.358778 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.362519 22214 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.361121 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.363554 22139 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.363942 22728 raft_consensus.cc:2393] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:01.364892 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 379) took 1842 ms. Trace:
I20260709 12:27:01.365302 22217 rpcz_store.cc:276] 0709 12:26:59.522031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.522150 (+   119us) service_pool.cc:224] Handling call
0709 12:27:00.932954 (+1410804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.943553 (+ 10599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.364660 (+421107us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001e0350. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:01.364810 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3216242432}
I20260709 12:27:01.372797 22139 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:01.377780 22141 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:01.379432 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1766) took 1089 ms. Trace:
I20260709 12:27:01.381560 22735 raft_consensus.cc:1240] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:01.381400 24318 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.385383 22035 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:27:01.393899 22111 connection.cc:256] RPC call timeout handler was delayed by -3.5339995989997988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 12:27:01.397744 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.398716 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.399669 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.399986 22139 raft_consensus.cc:2393] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:01.400470 22145 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:01.401664 22141 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:01.402915 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.403648 22141 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:01.403813 24433 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.404548 24433 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.409015 22214 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:01.407110 24433 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.379864 22215 rpcz_store.cc:276] 0709 12:27:00.289934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.735519 (+445585us) service_pool.cc:224] Handling call
0709 12:27:00.737072 (+  1553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.957832 (+220760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.957887 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.958503 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 12:27:01.021067 (+ 62564us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:01.021134 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.378857 (+357723us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540038c7d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:01.378906 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:01.378966 (+    60us) raft_consensus.cc:1685] finished
0709 12:27:01.378981 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.379253 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43710,"raft.queue_time_us":61495,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":11131,"spinlock_wait_cycles":368118528,"thread_start_us":61299,"threads_started":1,"wal-append.queue_time_us":131017}
I20260709 12:27:01.417923 22217 raft_consensus.cc:1275] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:01.419750 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.419690 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:01.422937 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.423400 22139 raft_consensus.cc:2393] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:01.422720 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:01.424760 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.413869 24410 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:01.426308 22184 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.533s (SENT)
I20260709 12:27:01.406687 24392 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.428334 22184 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:01.428988 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 79766.9us
I20260709 12:27:01.434108 22219 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:01.437675 24264 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.437707 22734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 695) took 2461 ms. Trace:
I20260709 12:27:01.431370 24410 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:01.440726 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.440306 21952 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf83ee90e33b4083aebda67b32ca1149 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 85f0d4cf04de40aa9e25849fb2380466 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:01.442798 24410 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.420444 24427 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:01.493665 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.444973 22735 raft_consensus.cc:1240] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 5. Ops: []
I20260709 12:27:01.507359 22035 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:01.457454 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:01.452109 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:01.463724 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:27:01.439458 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 79804.6us
I20260709 12:27:01.443545 22069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:01.547304 22069 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.466717 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:01.473507 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 378) took 1951 ms. Trace:
W20260709 12:27:01.490428 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.452075 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.489866 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.590385 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.451588 22731 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:01.595460 22142 raft_consensus.cc:2410] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:27:01.598641 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 132046us
W20260709 12:27:01.454856 24422 log.cc:927] Time spent T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 1.302s	user 0.000s	sys 0.009s
I20260709 12:27:01.548478 22219 rpcz_store.cc:276] 0709 12:26:59.521579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.521689 (+   110us) service_pool.cc:224] Handling call
0709 12:26:59.521993 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.434546 (+1912553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.473187 (+ 38641us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54004001d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:01.473436 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4335970560}
I20260709 12:27:01.602311 22035 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:01.438463 22734 rpcz_store.cc:276] 0709 12:26:58.975698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.977590 (+  1892us) service_pool.cc:224] Handling call
0709 12:26:59.265934 (+288344us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b5800034598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:26:59.266243 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.040089 (+773846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.436156 (+1396067us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b540044e420. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e23960dc0 00007f1e239eca02 00007f1e239e8dd6 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2
0709 12:27:01.437123 (+   967us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540044dc54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:01.437443 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099160576}
I20260709 12:27:01.462931 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.445853 24392 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.468207 24381 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.461135 24449 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.465914 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:01.455453 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.610491 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:01.611343 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 47997.4us
I20260709 12:27:01.615352 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:01.618094 23909 consensus_queue.cc:1048] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:01.618338 24232 consensus_queue.cc:1048] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:27:01.619609 24407 raft_consensus.cc:2804] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:01.621290 22068 raft_consensus.cc:1240] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:01.623251 22144 raft_consensus.cc:1275] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:01.624284 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:01.627637 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:01.599481 24281 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:01.630040 24437 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:01.630481 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.633765 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.438364 24264 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.640609 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.615002 24380 raft_consensus.cc:2804] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:01.655818 24380 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:01.656539 24380 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.658092 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.658974 22142 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:01.660202 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.642376 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:01.661368 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 106699us
I20260709 12:27:01.661706 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.662164 24406 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:01.662395 22144 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:01.662531 22035 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:01.662768 24406 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:01.663332 24406 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.663578 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.664721 24440 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:01.665730 24440 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:01.666286 24440 raft_consensus.cc:697] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:01.666146 24410 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:01.667546 24440 consensus_queue.cc:237] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:01.670061 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 66215.6us
I20260709 12:27:01.670233 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.671099 22139 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:01.672181 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.672714 24312 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.673032 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:01.673506 24312 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.674043 24434 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:01.674484 24434 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.674840 24434 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.678843 24331 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:01.679951 24331 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.650162 22737 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.688591 24312 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:01.656653 24472 log.cc:927] Time spent T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.449s	user 0.002s	sys 0.000s
I20260709 12:27:01.645702 22732 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:01.651808 24315 consensus_meta.cc:287] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.005s
I20260709 12:27:01.691859 24315 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.679133 24379 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.693485 24379 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.678916 24390 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.650875 24407 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.695092 24390 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.695753 24407 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.652231 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:01.698551 24390 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.699663 22070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:01.699972 24331 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.700529 22070 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.703771 24380 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.706525 24380 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.707787 24229 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:01.664927 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.710969 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.714399 22137 raft_consensus.cc:2393] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
W20260709 12:27:01.715268 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.715355 22069 raft_consensus.cc:2468] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:01.715673 22213 raft_consensus.cc:2393] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:27:01.646775 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.732182 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.732643 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.661232 22142 raft_consensus.cc:2393] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:01.661746 22145 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:01.723711 22737 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:01.723959 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.744154 22035 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:27:01.747993 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.748724 22143 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:01.751210 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.752246 22139 raft_consensus.cc:2368] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:01.754140 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.745960 24232 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 12:27:01.760279 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.761402 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 76922.7us
I20260709 12:27:01.750089 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.760895 22070 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
W20260709 12:27:01.796562 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 370307us
W20260709 12:27:01.823544 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 106908us
I20260709 12:27:01.764575 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.761883 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.852181 22142 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.852429 22144 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:27:01.836097 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.828161 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.763016 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:01.827888 22143 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:27:01.864005 22139 raft_consensus.cc:2410] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:01.864040 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:01.865096 22036 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:01.761804 24402 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:01.824210 24457 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:01.829553 24264 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.867694 24402 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.761145 22732 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:01.779829 24315 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:01.869908 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.870692 22702 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:01.876067 22218 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.868646 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.872129 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.872521 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.874770 24402 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.876562 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.878957 22137 raft_consensus.cc:2410] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:27:01.874794 24394 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:27:01.815865 24406 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.866873 24379 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.884205 22145 raft_consensus.cc:2393] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:01.872102 24427 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:01.873999 24380 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:01.898650 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.900044 22069 raft_consensus.cc:1240] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:01.903782 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.911111 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.908265 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.913205 22139 raft_consensus.cc:2410] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:01.914080 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.914563 24371 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:01.914768 22139 raft_consensus.cc:2393] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:01.915544 22145 raft_consensus.cc:2410] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:27:01.887691 24380 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.917335 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.905313 24392 raft_consensus.cc:2804] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:01.919533 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.927497 22143 raft_consensus.cc:2393] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:01.925864 22144 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 2.
I20260709 12:27:01.901688 24394 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:27:01.917502 24380 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.932199 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:01.933432 22139 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:01.932114 22137 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:01.940157 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:01.944041 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 70553.4us
I20260709 12:27:01.947021 22144 raft_consensus.cc:1240] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:01.939314 24392 raft_consensus.cc:697] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:01.954907 24392 consensus_queue.cc:237] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.956467 24413 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.953192 24434 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:01.966297 24450 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:01.963490 24431 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:27:01.967939 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:01.954946 24406 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:01.970347 22144 raft_consensus.cc:1240] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:01.967052 24450 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.973558 24369 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:01.975487 24494 log.cc:927] Time spent T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:27:01.975687 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:01.976946 24490 log.cc:927] Time spent T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:27:01.939003 24407 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:01.982313 22137 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
W20260709 12:27:02.000313 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 60637.6us
I20260709 12:27:02.002660 22218 raft_consensus.cc:2468] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:27:02.007122 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:27:02.014292 24491 log.cc:927] Time spent T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:27:02.015771 24407 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:02.017063 24489 log.cc:927] Time spent T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:27:02.021421 24101 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:02.024750 22067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1267) took 1380 ms. Trace:
I20260709 12:27:02.025148 22067 rpcz_store.cc:276] 0709 12:27:00.643916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.644979 (+  1063us) service_pool.cc:224] Handling call
0709 12:27:00.645397 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.677784 (+ 32387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.677823 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.677877 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:00.677923 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.024339 (+1346416us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b54002567d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:02.024403 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.024579 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73861888}
I20260709 12:27:02.025835 24434 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:02.029021 22064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48062 (request call id 464) took 2452 ms. Trace:
I20260709 12:27:02.029767 24315 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:02.030470 24315 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.032811 24315 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:02.034251 22111 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.029454 22064 rpcz_store.cc:276] 0709 12:26:59.576164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.577026 (+   862us) service_pool.cc:224] Handling call
0709 12:26:59.577379 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.583273 (+  5894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.583321 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.598006 (+ 14685us) log.cc:844] Serialized 26 byte log entry
0709 12:27:01.838569 (+2240563us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18003f93a0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208dee07 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e235890d1 00007f1e239a4a0f
0709 12:27:01.936910 (+ 98341us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:01.936979 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.941884 (+  4905us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.028568 (+ 86684us) raft_consensus.cc:1685] finished
0709 12:27:02.028589 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.028820 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5474,"raft.queue_time_us":5598,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":6757,"spinlock_wait_cycles":39426944,"thread_start_us":77204,"threads_started":1,"wal-append.queue_time_us":2385929}
W20260709 12:27:02.037729 24492 log.cc:927] Time spent T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:27:02.044067 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:02.045506 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.045681 24354 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:02.045925 22732 raft_consensus.cc:2393] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:27:02.049073 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.049798 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.050688 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.051048 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.052349 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.052990 22736 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:02.053157 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.053838 22139 raft_consensus.cc:2376] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4. Re-sending same reply.
I20260709 12:27:02.053886 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.054811 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.055152 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.055394 22139 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:27:02.056384 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:02.057302 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.057749 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.058115 24271 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.059504 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.061753 24427 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.062292 24427 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.064095 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:02.064700 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 62235.4us
I20260709 12:27:02.066816 22142 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:02.069839 22144 raft_consensus.cc:1240] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:02.056921 22139 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:02.071405 22702 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:02.072470 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.066098 22701 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:02.073729 22215 raft_consensus.cc:2393] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:02.010555 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.073555 22064 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:27:02.075614 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.080260 22138 raft_consensus.cc:2468] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:02.082711 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.084801 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.087415 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.089779 22068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1266) took 1450 ms. Trace:
I20260709 12:27:02.094108 22068 rpcz_store.cc:276] 0709 12:27:00.639592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.642325 (+  2733us) service_pool.cc:224] Handling call
0709 12:27:00.899355 (+257030us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5800001298. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:00.899794 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.653491 (+753697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.089559 (+436068us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54003c3054. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:02.089722 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457839360}
I20260709 12:27:02.089677 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.096514 22216 raft_consensus.cc:1240] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:02.090718 22219 raft_consensus.cc:1240] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 5. Ops: []
W20260709 12:27:02.092763 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 58649.1us
I20260709 12:27:02.098523 22142 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:02.077704 22065 raft_consensus.cc:1240] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:02.075474 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.098706 22035 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:02.104826 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.100448 22137 raft_consensus.cc:1240] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:02.112553 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.104784 22701 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:02.066622 24434 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:02.128906 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.130326 22218 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:02.133967 22215 raft_consensus.cc:1275] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:02.135381 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:02.140268 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.161515 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.168201 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.203418 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.104511 24431 raft_consensus.cc:2804] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:02.208184 22111 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.209002 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:02.205343 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.211097 22219 raft_consensus.cc:1240] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:02.211364 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:02.211948 24499 log.cc:927] Time spent T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:27:02.212780 22216 raft_consensus.cc:1275] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:02.213508 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:02.213757 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.214269 22137 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.214000 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.214926 22066 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:27:02.216500 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.218014 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
W20260709 12:27:02.219532 24487 log.cc:927] Time spent T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:27:02.219765 22066 raft_consensus.cc:1217] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 12:27:02.220346 22066 raft_consensus.cc:1240] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:27:02.220448 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:02.221909 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.222725 22216 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:02.225414 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:02.225766 22068 raft_consensus.cc:1240] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:02.225327 24434 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.226788 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.227793 24434 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:02.227876 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:02.228255 22184 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.226s (SENT)
I20260709 12:27:02.228425 22211 raft_consensus.cc:3055] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:02.229452 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.230065 22216 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:02.230690 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.231391 22140 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:02.124723 24101 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:02.237053 24498 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:02.237634 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.238390 22146 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 1.
I20260709 12:27:02.238873 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59944 (request call id 1883) took 1005 ms. Trace:
I20260709 12:27:02.239213 22146 rpcz_store.cc:276] 0709 12:27:01.233970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.238943 (+  4973us) service_pool.cc:224] Handling call
0709 12:27:02.011836 (+772893us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:27:02.238818 (+226982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10141568}
I20260709 12:27:02.228871 22211 raft_consensus.cc:740] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:02.245383 22065 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:02.245575 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:02.246426 22702 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
W20260709 12:27:02.250540 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.201540 24307 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:02.254057 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.254889 22142 raft_consensus.cc:2410] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:02.255687 22220 raft_consensus.cc:1275] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:27:02.258145 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.261955 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.262710 22142 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.264331 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.265019 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:02.265215 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 164943us
I20260709 12:27:02.237668 24498 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.263830 22065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.261873 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.250133 24431 raft_consensus.cc:697] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:02.281939 22064 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:02.282898 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.283789 22066 raft_consensus.cc:2393] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 6: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:02.284796 23976 raft_consensus.cc:2804] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:02.286904 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.289985 24402 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:02.295223 22184 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.332s (SENT)
I20260709 12:27:02.295775 22184 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:02.272688 24457 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.261161 24315 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.297075 24437 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:02.303118 22216 raft_consensus.cc:2393] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 5: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:02.310901 22067 raft_consensus.cc:2368] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7.
I20260709 12:27:02.310922 22215 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:02.292899 24402 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:02.357913 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 258380us
I20260709 12:27:02.312256 23976 raft_consensus.cc:697] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:02.332437 24315 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.296942 24431 consensus_queue.cc:237] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.272188 24264 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.271569 24498 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:02.420789 22142 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:02.418654 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.428808 22137 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:02.436478 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.432375 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.430519 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:02.443380 22184 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.748s (SENT)
I20260709 12:27:02.444422 24394 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.446525 24394 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.450642 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.451395 22066 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:02.454727 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:02.457314 24380 consensus_meta.cc:287] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.005s
I20260709 12:27:02.457688 24457 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.457803 24354 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:02.461742 24380 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.459141 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.459040 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.465027 24380 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:02.465510 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.427539 24399 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:02.445783 22217 raft_consensus.cc:2393] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 6: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:02.469693 22111 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.467788 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:02.471943 22137 raft_consensus.cc:3060] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.464378 22142 raft_consensus.cc:2410] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:27:02.508698 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.512529 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.514945 22036 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:02.547493 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.551776 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.507725 24449 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.594462 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.596206 22142 raft_consensus.cc:2393] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
W20260709 12:27:02.544703 24499 log.cc:927] Time spent T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:27:02.511566 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:02.544027 24380 raft_consensus.cc:2804] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:02.475160 24402 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 12:27:02.543598 24434 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:27:02.445771 24264 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.594002 24407 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:02.614130 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:02.616295 22142 raft_consensus.cc:2368] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:27:02.618306 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:02.620067 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 542) took 1163 ms. Trace:
W20260709 12:27:02.620344 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 185667us
I20260709 12:27:02.619134 22140 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 2.
I20260709 12:27:02.511886 24399 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.624042 24357 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.510730 23976 consensus_queue.cc:237] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.608281 24354 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.602843 24271 consensus_queue.cc:1048] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:27:02.611691 24229 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:02.630724 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.611176 24380 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:02.620517 22142 rpcz_store.cc:276] 0709 12:27:01.456300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.616968 (+1160668us) service_pool.cc:224] Handling call
0709 12:27:02.617292 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.619638 (+  2346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.619679 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.619737 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:02.619779 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.619869 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.620003 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.619464 24407 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.635429 22137 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:02.606842 24449 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:02.640069 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.643924 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 544) took 1187 ms. Trace:
W20260709 12:27:02.644644 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 187563us
I20260709 12:27:02.643056 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.644327 22140 rpcz_store.cc:276] 0709 12:27:01.456957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.621528 (+1164571us) service_pool.cc:224] Handling call
0709 12:27:02.629005 (+  7477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.643620 (+ 14615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.643646 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.643687 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:02.643720 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.643772 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.643870 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.650172 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:02.639513 24413 consensus_meta.cc:287] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.682s	user 0.016s	sys 0.000s
I20260709 12:27:02.655999 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1889) took 1088 ms. Trace:
I20260709 12:27:02.657801 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.659816 22142 rpcz_store.cc:276] 0709 12:27:01.567900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.644778 (+1076878us) service_pool.cc:224] Handling call
0709 12:27:02.645121 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.655537 (+ 10416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.655581 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.655640 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:02.655686 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.655771 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.655924 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:02.660203 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 109781us
I20260709 12:27:02.663609 22036 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.641757 24380 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.665349 22036 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.644243 24407 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.673941 22139 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:02.671837 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:02.675923 22217 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.679581 22036 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:02.680449 24434 raft_consensus.cc:2804] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:02.680841 24434 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.681223 24434 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:02.688855 24434 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.691236 22036 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.693282 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.693869 24510 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:02.694571 24479 log.cc:927] Time spent T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 1.480s	user 0.004s	sys 0.001s
I20260709 12:27:02.670885 24427 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:02.671007 24229 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:02.697758 22140 raft_consensus.cc:3055] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:02.697012 24264 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:02.699292 22217 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:27:02.657346 24394 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:02.675369 24379 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.640007 24357 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.703298 22036 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:02.704816 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 545) took 1244 ms. Trace:
W20260709 12:27:02.721438 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 76033us
I20260709 12:27:02.703097 24428 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:02.708006 22140 raft_consensus.cc:740] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:02.692004 24402 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:02.713122 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7"
I20260709 12:27:02.725726 22066 raft_consensus.cc:2393] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate c9a50b2f586448c49281a6618c40a1f7 in this term.
W20260709 12:27:02.715123 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.714872 22064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.727366 22064 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:02.702720 24315 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:02.731422 22111 leader_election.cc:400] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) with higher term. Message: Invalid argument: T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6.
W20260709 12:27:02.698177 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.720009 22137 rpcz_store.cc:276] 0709 12:27:01.457258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.651186 (+1193928us) service_pool.cc:224] Handling call
0709 12:27:02.651972 (+   786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.701118 (+ 49146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.701147 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.701219 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:02.701633 (+   414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.701710 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.701813 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.733115 22140 consensus_queue.cc:260] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:02.738221 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.743184 22139 raft_consensus.cc:1240] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:02.743919 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1110) took 1118 ms. Trace:
I20260709 12:27:02.744240 22139 rpcz_store.cc:276] 0709 12:27:01.625221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.742525 (+1117304us) service_pool.cc:224] Handling call
0709 12:27:02.742920 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.743680 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.743864 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:02.745625 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.747947 22140 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:02.728343 24427 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:02.710382 24510 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.721768 24379 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.751489 22137 raft_consensus.cc:1240] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:02.761628 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1108) took 1137 ms. Trace:
I20260709 12:27:02.750775 22036 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:02.754901 22141 raft_consensus.cc:1240] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:02.763332 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1116) took 1135 ms. Trace:
I20260709 12:27:02.755424 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:27:02.758484 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.762084 22137 rpcz_store.cc:276] 0709 12:27:01.624583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.732458 (+1107875us) service_pool.cc:224] Handling call
0709 12:27:02.751319 (+ 18861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.761297 (+  9978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.761546 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.763788 22141 rpcz_store.cc:276] 0709 12:27:01.627588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.754343 (+1126755us) service_pool.cc:224] Handling call
0709 12:27:02.754723 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.763022 (+  8299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.763262 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.770478 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1892) took 1134 ms. Trace:
I20260709 12:27:02.770954 22141 rpcz_store.cc:276] 0709 12:27:01.636186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.766165 (+1129979us) service_pool.cc:224] Handling call
0709 12:27:02.769884 (+  3719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.770090 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.770125 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.770193 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:02.770227 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.770283 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.770381 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:02.771896 24504 log.cc:927] Time spent T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:27:02.784016 22139 raft_consensus.cc:3055] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:02.784449 22139 raft_consensus.cc:740] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:02.798852 22137 raft_consensus.cc:3055] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:02.799381 22137 raft_consensus.cc:740] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:02.766052 24512 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.768136 24402 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:27:02.810107 22184 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.797s (SENT)
W20260709 12:27:02.810894 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.811151 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.818856 22184 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:02.815760 22139 consensus_queue.cc:260] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:02.814427 21967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40564 (request call id 200) took 11672 ms (client timeout 15000 ms). Trace:
I20260709 12:27:02.831305 24354 consensus_queue.cc:1059] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:27:02.841557 22067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.823616 24315 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Timed out: LeaderStepDown RPC to 127.20.98.66:42771 timed out after 10.000s (SENT)
I20260709 12:27:02.844064 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
I20260709 12:27:02.846160 22137 consensus_queue.cc:260] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.847489 22137 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.853021 22140 raft_consensus.cc:1275] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:27:02.854628 22140 pending_rounds.cc:85] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 1
W20260709 12:27:02.822973 21967 rpcz_store.cc:269] 0709 12:26:51.142163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.144701 (+  2538us) service_pool.cc:224] Handling call
0709 12:27:02.814108 (+11669407us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:57.560169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:57.590518 (+ 30349us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:57.596963 (+  6445us) write_op.cc:435] Acquired schema lock
0709 12:26:57.597797 (+   834us) tablet.cc:662] Decoding operations
0709 12:26:57.749259 (+151462us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:57.752767 (+  3508us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:57.797369 (+ 44602us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:26:57.961965 (+164596us) tablet.cc:701] Row locks acquired
0709 12:26:57.964563 (+  2598us) write_op.cc:260] PREPARE: finished
0709 12:26:57.979324 (+ 14761us) write_op.cc:270] Start()
0709 12:26:58.009823 (+ 30499us) write_op.cc:276] Timestamp: P: 1783600017979262 usec, L: 0
0709 12:26:58.016741 (+  6918us) op_driver.cc:348] REPLICATION: starting
0709 12:26:58.130261 (+113520us) log.cc:844] Serialized 2054 byte log entry
0709 12:26:59.032475 (+902214us) op_driver.cc:464] REPLICATION: finished
0709 12:26:59.514390 (+481915us) write_op.cc:301] APPLY: starting
0709 12:26:59.521922 (+  7532us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:59.578470 (+ 56548us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:59.605628 (+ 27158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:59.606286 (+   658us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:59.606526 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:26:59.606580 (+    54us) write_op.cc:312] APPLY: finished
0709 12:26:59.606842 (+   262us) log.cc:844] Serialized 47 byte log entry
0709 12:26:59.607020 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:59.607137 (+   117us) write_op.cc:454] Released schema lock
0709 12:26:59.607195 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:59.607640 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:59.607672 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":822305,"reported_tablets":16,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":450863,"apply.run_cpu_time_us":2784,"apply.run_wall_time_us":108831,"num_ops":5,"prepare.queue_time_us":156397,"prepare.run_cpu_time_us":66679,"prepare.run_wall_time_us":812235,"raft.queue_time_us":284201,"raft.run_cpu_time_us":33563,"raft.run_wall_time_us":335026,"replication_time_us":993472,"spinlock_wait_cycles":2944,"thread_start_us":620785,"threads_started":4,"wal-append.queue_time_us":571679,"wal-append.run_cpu_time_us":64973,"wal-append.run_wall_time_us":1956648}]]}
I20260709 12:27:02.861490 22062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c9a50b2f586448c49281a6618c40a1f7" is_pre_election: true
I20260709 12:27:02.821873 24512 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:02.865960 24514 log.cc:927] Time spent T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 12:27:02.867014 24512 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:02.824378 24402 raft_consensus.cc:697] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:02.868789 24510 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:02.869091 24402 consensus_queue.cc:237] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.869882 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1896) took 1151 ms. Trace:
I20260709 12:27:02.870025 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59944 (request call id 1877) took 1746 ms. Trace:
I20260709 12:27:02.870368 22138 rpcz_store.cc:276] 0709 12:27:01.123499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.132486 (+  8987us) service_pool.cc:224] Handling call
0709 12:27:02.869838 (+1737352us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54002e4354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:02.869939 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953426304}
I20260709 12:27:02.871858 22138 raft_consensus.cc:1240] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:02.872064 22145 raft_consensus.cc:1240] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:27:02.872452 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1898) took 1032 ms. Trace:
I20260709 12:27:02.874835 24407 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:02.875806 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.876276 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1100) took 1428 ms. Trace:
I20260709 12:27:02.878865 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1895) took 1161 ms. Trace:
I20260709 12:27:02.879437 22141 rpcz_store.cc:276] 0709 12:27:01.717799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.772077 (+1054278us) service_pool.cc:224] Handling call
0709 12:27:02.772471 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.772819 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.772848 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.773354 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.831758 (+ 58404us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:02.831818 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.831918 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.878602 (+ 46684us) raft_consensus.cc:1685] finished
0709 12:27:02.878629 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.878790 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9891,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":32624,"thread_start_us":58012,"threads_started":1,"wal-append.queue_time_us":74510}
I20260709 12:27:02.876602 22144 rpcz_store.cc:276] 0709 12:27:01.448302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.976652 (+528350us) service_pool.cc:224] Handling call
0709 12:27:02.067916 (+ 91264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.071852 (+  3936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.876100 (+804248us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b54002d3cd0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:02.876223 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209021824}
I20260709 12:27:02.870288 22146 rpcz_store.cc:276] 0709 12:27:01.718169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.868966 (+1150797us) service_pool.cc:224] Handling call
0709 12:27:02.869320 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.869557 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.869583 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.869621 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:02.869648 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.869694 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.869808 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.872767 22138 rpcz_store.cc:276] 0709 12:27:01.840612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.871341 (+1030729us) service_pool.cc:224] Handling call
0709 12:27:02.871663 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.872223 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.872403 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.883049 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.889047 22069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1284) took 1193 ms. Trace:
I20260709 12:27:02.889533 22069 rpcz_store.cc:276] 0709 12:27:01.695582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.835677 (+140095us) service_pool.cc:224] Handling call
0709 12:27:01.838602 (+  2925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.900478 (+ 61876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.888794 (+988316us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54003f6954. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:02.888985 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140861184}
I20260709 12:27:02.891004 22070 raft_consensus.cc:1240] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 5. Ops: []
I20260709 12:27:02.837905 24449 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:02.854995 22140 pending_rounds.cc:107] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:27:02.899731 22140 raft_consensus.cc:2889] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:02.906678 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.914734 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:02.915329 22215 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.920662 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1104) took 1322 ms. Trace:
I20260709 12:27:02.921237 22140 rpcz_store.cc:276] 0709 12:27:01.598484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.649632 (+1051148us) service_pool.cc:224] Handling call
0709 12:27:02.669776 (+ 20144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.920347 (+250571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.920588 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.898978 24428 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:02.854964 24413 consensus_queue.cc:1059] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:27:02.929406 24515 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.936251 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1782) took 1599 ms. Trace:
I20260709 12:27:02.937986 22213 rpcz_store.cc:276] 0709 12:27:01.336722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.336865 (+   143us) service_pool.cc:224] Handling call
0709 12:27:02.936068 (+1599203us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54002c65d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:02.936205 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854012672}
W20260709 12:27:02.958755 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.942340 24515 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.943461 24428 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.967051 24510 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:02.967676 24510 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.974752 22137 raft_consensus.cc:1275] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:27:02.971683 22215 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:02.967937 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.995781 22137 pending_rounds.cc:85] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 2
I20260709 12:27:02.996583 22219 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:02.998792 22137 pending_rounds.cc:107] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:27:03.000002 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.000764 22137 raft_consensus.cc:2889] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:02.969484 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:02.999996 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.000131 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.005808 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.005323 24440 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.008551 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.002797 24413 raft_consensus.cc:3055] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:03.009279 22737 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
W20260709 12:27:03.008906 24521 log.cc:927] Time spent T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:27:03.008420 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:02.950297 22212 raft_consensus.cc:1240] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 5. Ops: []
I20260709 12:27:03.009346 24440 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:02.968602 24449 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:02.967849 24515 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.015733 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.016441 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:03.017148 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.002768 24437 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.009240 24413 raft_consensus.cc:740] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:03.033759 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.034158 24413 consensus_queue.cc:260] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.035650 24413 raft_consensus.cc:3060] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.037338 24437 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:03.038348 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.039808 24428 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.040516 24437 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:03.041533 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.045189 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.033102 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1891) took 1428 ms. Trace:
I20260709 12:27:03.046116 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1118) took 1417 ms. Trace:
I20260709 12:27:03.046921 22137 rpcz_store.cc:276] 0709 12:27:01.628282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.765827 (+1137545us) service_pool.cc:224] Handling call
0709 12:27:02.784430 (+ 18603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.045767 (+261337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.046036 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:03.046180 22213 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 2.
I20260709 12:27:03.046048 22142 rpcz_store.cc:276] 0709 12:27:01.604258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.661127 (+1056869us) service_pool.cc:224] Handling call
0709 12:27:02.662230 (+  1103us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:02.671340 (+  9110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.671370 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:02.692620 (+ 21250us) log.cc:844] Serialized 52 byte log entry
0709 12:27:02.767291 (+ 74671us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:02.931206 (+163915us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.032509 (+101303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.032584 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.032628 (+    44us) raft_consensus.cc:1685] finished
0709 12:27:03.032640 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.033036 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":247389,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":13909,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":7690,"thread_start_us":273164,"threads_started":3,"wal-append.queue_time_us":112293}
I20260709 12:27:03.041785 22729 raft_consensus.cc:2376] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5. Re-sending same reply.
I20260709 12:27:03.081101 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.083370 22213 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:03.079813 22137 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:03.045138 24449 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.078256 24354 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.083564 24498 consensus_meta.cc:287] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.000s
I20260709 12:27:03.106196 24440 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.106657 24498 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.108145 22733 raft_consensus.cc:2393] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:03.079277 24457 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:03.110395 24457 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.111707 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.112411 24457 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:03.114327 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:03.115206 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:03.127854 24449 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.133669 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:03.134478 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 50984.7us
I20260709 12:27:03.136284 22184 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:03.137367 24449 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.137806 24449 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.138202 24449 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.138600 22212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37716 (request call id 1993) took 1787 ms. Trace:
I20260709 12:27:03.139000 22212 rpcz_store.cc:276] 0709 12:27:01.350986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.360505 (+  9519us) service_pool.cc:224] Handling call
0709 12:27:02.940654 (+1580149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.023129 (+ 82475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.138363 (+115234us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54002c65d0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:03.138522 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3619228032}
I20260709 12:27:03.140455 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.152294 22216 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:03.152549 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.152697 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.153855 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:03.156154 24529 log.cc:927] Time spent T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:27:03.091763 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.101528 24510 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.157362 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1899) took 1099 ms. Trace:
I20260709 12:27:03.105391 24354 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.157768 22145 rpcz_store.cc:276] 0709 12:27:02.058431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.872927 (+814496us) service_pool.cc:224] Handling call
0709 12:27:02.873237 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.873641 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.873673 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.874138 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.003515 (+129377us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:03.003573 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.003663 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.157088 (+153425us) raft_consensus.cc:1685] finished
0709 12:27:03.157120 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.157298 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1206,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":128952,"threads_started":1,"wal-append.queue_time_us":167805}
I20260709 12:27:03.160226 24413 raft_consensus.cc:2764] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:27:03.160657 24354 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.112939 24457 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:03.161372 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 44247.3us
I20260709 12:27:03.109778 24498 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323)
I20260709 12:27:03.161823 24457 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.170590 24392 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:03.273561 24357 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.171748 24375 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:27:03.187952 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.190928 24407 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:03.279217 24434 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.279778 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:03.120882 24380 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.257869 24512 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.280668 24512 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.258527 24379 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:03.141068 22212 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:03.262693 22137 raft_consensus.cc:1240] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.263167 22142 raft_consensus.cc:3055] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:03.291096 22142 raft_consensus.cc:740] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:03.137120 22184 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:27:03.293947 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 156899us
I20260709 12:27:03.294852 22184 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:03.266331 24399 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:03.268325 24271 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:03.160943 24413 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:03.270120 22139 raft_consensus.cc:3060] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.271536 24450 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:03.275134 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.305418 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.278156 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.273685 24392 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.279444 24375 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.165941 22185 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:03.259779 22211 consensus_queue.cc:260] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.296022 22036 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:03.292241 22142 consensus_queue.cc:260] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.315150 22142 raft_consensus.cc:3060] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.316349 24407 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:03.316949 24407 raft_consensus.cc:697] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:03.317900 24407 consensus_queue.cc:237] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:03.318415 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 59506.3us
I20260709 12:27:03.319710 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.303026 24434 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.324638 24434 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.316421 24319 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:27:03.327652 24434 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.329281 22211 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.330631 24380 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.332669 24375 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:03.333858 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:03.335085 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:27:03.336443 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.290618 24357 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:03.312232 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.344025 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.316344 24501 log.cc:927] Time spent T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.691s	user 0.001s	sys 0.010s
W20260709 12:27:03.344522 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 49763.9us
W20260709 12:27:03.343746 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 177862us
I20260709 12:27:03.320902 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:03.346792 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:03.344553 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.349203 22733 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:03.353353 22211 raft_consensus.cc:1275] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:03.354616 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1796) took 1129 ms. Trace:
I20260709 12:27:03.355031 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:03.355003 22211 rpcz_store.cc:276] 0709 12:27:02.225329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.227899 (+  2570us) service_pool.cc:224] Handling call
0709 12:27:02.228249 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.192838 (+964589us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4c003ab880. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e21cb5a20 00007f1e21cc6a29 00007f1e21c8c644 00007f1e21cb3f2d 00007f1e21cb3b93 00007f1e239e418b 00007f1e239e4cb5 00007f1e239dff30 00007f1e239e17de 00007f1e239ebb49 00007f1e239ec416
0709 12:27:03.354368 (+161530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.354561 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7247104}
I20260709 12:27:03.355870 22137 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.348136 22184 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:03.353327 22729 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.348217 24315 raft_consensus.cc:2804] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:03.345615 24516 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:03.345944 24399 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.333415 24271 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.387557 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.374624 24507 consensus_queue.cc:1059] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:27:03.390331 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.393895 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.377307 24315 raft_consensus.cc:697] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:03.396091 24315 consensus_queue.cc:237] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.354447 24357 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.407987 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:03.437433 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 117781us
I20260709 12:27:03.372416 24516 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.440923 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:03.377007 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:03.443436 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 312745us
I20260709 12:27:03.444388 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:03.447196 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 43608.3us
I20260709 12:27:03.450495 22142 raft_consensus.cc:1275] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:27:03.440188 24413 raft_consensus.cc:697] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:03.447021 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 553) took 1125 ms. Trace:
I20260709 12:27:03.453611 22142 pending_rounds.cc:85] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 6
I20260709 12:27:03.427644 24431 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:03.453928 22111 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:03.449640 22035 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.442906 24516 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.474334 22111 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:03.476428 22035 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.471505 22142 pending_rounds.cc:107] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:27:03.440188 24437 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:03.477845 22035 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:03.487792 22035 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:03.479104 22142 raft_consensus.cc:2889] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.397925 21966 catalog_manager.cc:5697] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:03.489238 22139 raft_consensus.cc:1275] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:27:03.489619 22139 pending_rounds.cc:85] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 5
I20260709 12:27:03.489847 22139 pending_rounds.cc:107] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:27:03.456684 24318 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:03.490109 22139 raft_consensus.cc:2889] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.459296 24531 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:03.491685 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.446308 24450 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.509068 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59932 (request call id 1111) took 1883 ms. Trace:
I20260709 12:27:03.489869 24434 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:03.510751 22035 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:03.509969 22139 rpcz_store.cc:276] 0709 12:27:01.625659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.744959 (+1119300us) service_pool.cc:224] Handling call
0709 12:27:02.750227 (+  5268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.269542 (+519315us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b54000ab2a0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e2395ea1d 00007f1e239451a4 00007f1e239c7447 00007f1e239dffe7 00007f1e239e17de 00007f1e239ebb49 00007f1e239ec416 00007f1e239e8d8f 00007f1e239e883e 00007f1e289ad419
0709 12:27:03.508715 (+239173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.508990 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96765184}
I20260709 12:27:03.511387 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:03.512271 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:03.512850 22139 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:03.513343 22142 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.459568 22728 raft_consensus.cc:2468] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:03.486243 24354 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:03.517967 22111 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.512472 21966 catalog_manager.cc:5697] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 3 to 5, leader changed from <none> to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 5 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:03.509454 24440 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:03.496511 24498 consensus_queue.cc:1048] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:27:03.518858 24392 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:03.511691 24512 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.541218 22137 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:03.515038 24457 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.542500 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:03.543123 22137 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:03.544210 22701 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:03.545557 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:03.546295 22137 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.490895 24437 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:03.520766 24271 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.474762 24357 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.565860 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 552) took 1254 ms. Trace:
I20260709 12:27:03.485962 24379 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.454728 22146 rpcz_store.cc:276] 0709 12:27:02.322096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.913948 (+591852us) service_pool.cc:224] Handling call
0709 12:27:02.927112 (+ 13164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.929980 (+  2868us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:03.043970 (+113990us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.446598 (+402628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.446667 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:03.446724 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.446817 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.446955 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85154,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":4866,"thread_start_us":478260,"threads_started":2}
I20260709 12:27:03.553084 24392 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:03.540798 21966 catalog_manager.cc:5697] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.520646 24515 raft_consensus.cc:2764] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:27:03.490221 24380 raft_consensus.cc:2804] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.520524 24354 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:03.510805 24434 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.577790 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:03.591138 22139 raft_consensus.cc:2410] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:27:03.538067 22111 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.564734 24437 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.576906 22144 rpcz_store.cc:276] 0709 12:27:02.311752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.912733 (+600981us) service_pool.cc:224] Handling call
0709 12:27:02.926122 (+ 13389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.941786 (+ 15664us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:03.085960 (+144174us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.565152 (+479192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.565267 (+   115us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:03.565343 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.565478 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.565737 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70592,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"thread_start_us":382845,"threads_started":2}
I20260709 12:27:03.516335 24449 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.516506 24450 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.543154 24318 raft_consensus.cc:2764] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:27:03.597848 22216 raft_consensus.cc:1240] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.599665 22137 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:27:03.585386 24392 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.597537 24449 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:03.606009 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 68069.9us
I20260709 12:27:03.606786 22111 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:03.583367 24379 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.599220 24450 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:03.608961 24543 log.cc:927] Time spent T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:27:03.609220 24379 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.607831 24392 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.615118 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 551) took 1312 ms. Trace:
I20260709 12:27:03.615525 22141 rpcz_store.cc:276] 0709 12:27:02.302193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.903702 (+601509us) service_pool.cc:224] Handling call
0709 12:27:02.916783 (+ 13081us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:02.917253 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.917297 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:02.929560 (+ 12263us) log.cc:844] Serialized 52 byte log entry
0709 12:27:03.035917 (+106357us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b18003aea00. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208dee07 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e235890d1 00007f1e239a4a0f
0709 12:27:03.284815 (+248898us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:03.291544 (+  6729us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.404597 (+113053us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b18003aea00. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e20876c0a 00007f1e29fb6219 00007f1e208fea40 00007f1e208f94e4 00007f1e208f9455 00007f1e239e1060 00007f1e239f3716 00007f1e23a04287 00007f1e23a04208
0709 12:27:03.407259 (+  2662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.407371 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.614898 (+207527us) raft_consensus.cc:1685] finished
0709 12:27:03.614918 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.615059 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12438,"prepare.queue_time_us":7255,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":132345,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":23945,"spinlock_wait_cycles":24525952,"thread_start_us":248645,"threads_started":1,"wal-append.queue_time_us":624064}
I20260709 12:27:03.619088 24379 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:03.601544 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 153255us
W20260709 12:27:03.634713 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 110980us
W20260709 12:27:03.601591 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 199250us
I20260709 12:27:03.589955 24354 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.594626 24434 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.605262 24376 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:03.630322 24537 log.cc:927] Time spent T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:27:03.621541 21952 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf83ee90e33b4083aebda67b32ca1149 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 85f0d4cf04de40aa9e25849fb2380466 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:03.640807 22142 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:03.607981 21966 catalog_manager.cc:5697] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.594348 24380 raft_consensus.cc:697] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:03.556427 24413 consensus_queue.cc:237] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.654395 24449 consensus_queue.cc:1059] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:03.657229 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.657598 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.657749 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.658039 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.658412 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.657234 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.658797 22142 raft_consensus.cc:1275] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:03.659432 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:03.660004 24540 log.cc:927] Time spent T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:27:03.660290 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.662177 22732 raft_consensus.cc:1240] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:03.660887 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 312788us
I20260709 12:27:03.664453 24437 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.678399 24375 raft_consensus.cc:3055] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.680682 24380 consensus_queue.cc:237] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.683597 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:03.686327 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 554) took 1254 ms. Trace:
I20260709 12:27:03.686872 22146 raft_consensus.cc:1240] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:03.687531 24379 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.687399 24392 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.694721 22139 raft_consensus.cc:1275] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:03.703423 22145 raft_consensus.cc:1275] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:03.703598 22701 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:03.705443 21966 catalog_manager.cc:5697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.708755 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.709421 22144 raft_consensus.cc:1275] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:03.712153 22140 rpcz_store.cc:276] 0709 12:27:02.434041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.922151 (+488110us) service_pool.cc:224] Handling call
0709 12:27:02.922534 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.053757 (+131223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.053806 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:03.080691 (+ 26885us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.456112 (+375421us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:03.478411 (+ 22299us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.587727 (+109316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.587867 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.686109 (+ 98242us) raft_consensus.cc:1685] finished
0709 12:27:03.686128 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.686265 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551,"prepare.queue_time_us":22397,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2870,"raft.queue_time_us":12799,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":13069,"thread_start_us":555393,"threads_started":3,"wal-append.queue_time_us":462786}
I20260709 12:27:03.708746 24375 raft_consensus.cc:740] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:03.708366 24437 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:03.749600 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.750718 23776 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:03.738323 24375 consensus_queue.cc:260] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.735942 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.745491 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:03.746699 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.719496 24376 raft_consensus.cc:2804] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:03.720391 24548 raft_consensus.cc:3055] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:03.709499 24519 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 12:27:03.754724 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.738529 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.754864 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.730124 21966 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:03.759245 22184 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:03.768368 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.787496 22186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.787961 24440 raft_consensus.cc:697] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:03.788231 24427 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:03.787508 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:03.789196 24440 consensus_queue.cc:237] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:03.776172 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.750806 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:03.759320 23776 raft_consensus.cc:697] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:27:03.794675 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.792843 21966 catalog_manager.cc:5697] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 4, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:03.757050 24376 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:03.791085 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.759222 24548 raft_consensus.cc:740] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:03.800912 22035 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:03.790112 24375 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:03.806847 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 51310.7us
I20260709 12:27:03.807298 21966 catalog_manager.cc:5697] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:03.797788 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 74977.9us
W20260709 12:27:03.797758 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 93633.5us
I20260709 12:27:03.793839 22729 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:03.796212 24437 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:03.800336 24376 raft_consensus.cc:3060] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.805388 24515 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:03.793203 22728 raft_consensus.cc:2468] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:03.820117 22185 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:03.811538 24407 raft_consensus.cc:2804] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:03.825394 21966 catalog_manager.cc:5697] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 3 to 4, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 4 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.792480 23776 consensus_queue.cc:237] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.834630 22184 leader_election.cc:400] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:27:03.848726 22185 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:03.849965 21966 catalog_manager.cc:5697] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 3 to 4, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:03.851255 24449 raft_consensus.cc:2804] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:03.852023 21966 catalog_manager.cc:5697] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.854592 24449 raft_consensus.cc:697] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:03.854539 24548 consensus_queue.cc:260] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.855875 24548 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.850401 24392 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:03.855902 24449 consensus_queue.cc:237] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.857081 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:03.857400 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.858044 24315 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.858448 24315 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:03.858845 24315 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.865442 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:03.866091 22144 raft_consensus.cc:2376] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3. Re-sending same reply.
I20260709 12:27:03.868480 22137 raft_consensus.cc:3055] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:03.868881 22137 raft_consensus.cc:740] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:03.869686 22137 consensus_queue.cc:260] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.870874 22137 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.873252 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.880280 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:03.884364 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 71735.1us
I20260709 12:27:03.884853 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:03.885041 22185 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:03.864696 24516 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.899437 24518 consensus_queue.cc:1059] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:03.900591 24518 raft_consensus.cc:3055] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.900691 24271 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.901032 24518 raft_consensus.cc:740] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:03.901335 24271 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.902034 24518 consensus_queue.cc:260] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.903374 24518 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:03.903416 24271 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:03.912317 22216 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:03.911743 21966 catalog_manager.cc:5697] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 5, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 5 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:03.915047 22219 raft_consensus.cc:1240] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:03.916854 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:03.922533 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 315802us
I20260709 12:27:03.922770 22137 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:27:03.923209 22137 pending_rounds.cc:85] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 4
I20260709 12:27:03.923465 22137 pending_rounds.cc:107] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:27:03.923337 22111 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:03.923808 22137 raft_consensus.cc:2889] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.925340 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.926380 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.884377 24549 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.929257 21966 catalog_manager.cc:5697] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 3 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.885535 24437 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.885800 24399 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:03.933091 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.934549 22216 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:03.934638 22185 leader_election.cc:336] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:03.896904 24427 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:03.934711 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.905089 24407 raft_consensus.cc:697] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:03.940716 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:03.913514 24533 raft_consensus.cc:2764] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:03.951846 21966 catalog_manager.cc:5697] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.949951 22211 raft_consensus.cc:1275] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:03.915160 24380 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:03.881256 24552 consensus_queue.cc:1048] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:27:03.893944 24428 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:27:03.974233 22185 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:03.892436 24431 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:27:03.928634 24510 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:03.975358 22185 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:03.928776 24512 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.934790 24562 log.cc:927] Time spent T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:27:03.894359 24553 consensus_queue.cc:1048] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:27:03.953671 22219 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:27:03.975965 22185 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:03.897797 24434 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:03.940881 24399 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.987716 21966 catalog_manager.cc:5697] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:03.989583 22213 raft_consensus.cc:3055] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:03.991323 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:03.947487 24531 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:03.953262 24457 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:03.989992 22213 raft_consensus.cc:740] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:03.939702 24519 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:03.975811 24437 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.038731 22213 consensus_queue.cc:260] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.982862 24515 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:04.036433 21966 catalog_manager.cc:5697] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:04.048035 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.951969 24354 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.993260 24399 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.053869 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:03.996357 24510 raft_consensus.cc:697] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:04.062976 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:03.955983 24427 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:04.069475 24567 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:04.069864 24427 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:04.070535 22213 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.070245 24567 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:04.078429 22184 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.769s (SENT)
W20260709 12:27:04.079002 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 155742us
I20260709 12:27:04.079023 22184 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:04.082002 21966 catalog_manager.cc:5697] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 5, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.072904 24567 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:03.985489 24380 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:03.984835 24512 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:04.097877 22702 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:04.129076 22702 consensus_peers.cc:597] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:04.133342 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 54940.1us
W20260709 12:27:04.130927 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 45572us
W20260709 12:27:04.138078 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:04.141956 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:04.130569 21966 catalog_manager.cc:5697] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 6, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 6 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.097877 24437 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:04.147570 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:04.144889 22035 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:04.079653 24515 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.153017 22702 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:04.052508 24519 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.161214 22702 leader_election.cc:336] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:04.163916 21966 catalog_manager.cc:5697] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 1 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:04.169966 22111 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:04.170006 21966 catalog_manager.cc:5697] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 2 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:04.127879 24376 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:04.156502 24457 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:04.089578 24407 consensus_queue.cc:237] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:04.139909 24315 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:04.181751 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:04.189909 22145 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:04.178783 21966 catalog_manager.cc:5697] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 reported cstate change: term changed from 3 to 5, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:04.191825 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.194648 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:04.202489 22213 raft_consensus.cc:1275] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:04.187944 24357 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.214937 24357 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:04.225064 24564 log.cc:927] Time spent T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:27:04.226434 24569 log.cc:927] Time spent T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:27:04.174160 24516 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:04.241094 22184 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.848s (SENT)
I20260709 12:27:04.241838 22184 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:04.249526 22219 raft_consensus.cc:1240] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:04.178187 24570 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:04.251686 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.252820 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:04.179510 24568 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.260190 22145 raft_consensus.cc:2393] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
W20260709 12:27:04.267575 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 72997.6us
I20260709 12:27:04.268770 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:04.269467 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 376721us
W20260709 12:27:04.253400 24561 log.cc:927] Time spent T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
W20260709 12:27:04.272852 22184 leader_election.cc:336] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.855s (SENT)
W20260709 12:27:04.273398 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 460060us
I20260709 12:27:04.192025 24319 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:27:04.275612 22184 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:04.236584 24457 raft_consensus.cc:697] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:04.248577 24428 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.259990 24551 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:04.267721 24516 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.290417 24516 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.286669 22111 leader_election.cc:400] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Vote denied by peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323) with higher term. Message: Invalid argument: T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7.
I20260709 12:27:04.262755 24434 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:04.298732 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.302182 22036 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
W20260709 12:27:04.303545 22184 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.124s (SENT)
I20260709 12:27:04.304141 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:04.276922 24533 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:04.308950 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.291126 24413 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.177675 24510 consensus_queue.cc:237] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:04.282338 24440 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:04.314669 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:04.293807 24354 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:04.321761 22111 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:04.322696 22184 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.192s (SENT)
I20260709 12:27:04.323145 22184 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:04.320161 22145 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:04.289409 24551 raft_consensus.cc:697] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:04.262236 24570 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:04.343207 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:04.311518 24428 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:27:04.351148 22036 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:04.341888 24380 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:04.319177 24413 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:04.346218 24568 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.342092 24579 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.365486 24376 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:04.366981 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 49233.6us
I20260709 12:27:04.352262 24567 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:04.336854 24440 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.364670 24375 consensus_meta.cc:287] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 12:27:04.370927 24315 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:04.352175 24578 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.360947 24515 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:04.359625 24512 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:04.383195 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:04.399015 24577 log.cc:927] Time spent T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:04.346107 24457 consensus_queue.cc:237] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:04.383790 24571 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.401106 24568 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:04.373903 24575 consensus_queue.cc:1059] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 12:27:04.453281 22702 leader_election.cc:336] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:04.457492 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:04.459345 22702 leader_election.cc:336] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:04.459877 22702 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:04.488938 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 137855us
I20260709 12:27:04.449407 24427 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:04.508308 24586 log.cc:927] Time spent T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:27:04.401396 24551 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:04.509609 24582 log.cc:927] Time spent T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:27:04.509500 24571 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:04.513352 24427 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:04.524633 24566 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.525445 24566 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:04.525928 24587 log.cc:927] Time spent T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:04.452800 24568 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.556618 22184 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.811s (SENT)
I20260709 12:27:04.557343 22184 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:04.496461 24375 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:04.615080 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 124998us
W20260709 12:27:04.619529 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 160195us
I20260709 12:27:04.620213 24578 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:04.621882 24553 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:04.622617 24380 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:04.624881 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 68318.1us
I20260709 12:27:04.627346 24413 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:04.597080 24574 log.cc:927] Time spent T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 12:27:04.650167 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 306960us
I20260709 12:27:04.652797 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 566) took 1298 ms. Trace:
W20260709 12:27:04.653373 24548 consensus_meta.cc:287] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.007s
I20260709 12:27:04.653265 22143 rpcz_store.cc:276] 0709 12:27:03.353894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.681922 (+328028us) service_pool.cc:224] Handling call
0709 12:27:03.699345 (+ 17423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.952204 (+252859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.952268 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:03.978236 (+ 25968us) log.cc:844] Serialized 26 byte log entry
0709 12:27:04.174690 (+196454us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:04.174760 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.174852 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.652549 (+477697us) raft_consensus.cc:1685] finished
0709 12:27:04.652576 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.652731 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":247350,"raft.queue_time_us":246810,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":18386,"thread_start_us":120714,"threads_started":1,"wal-append.queue_time_us":284341}
I20260709 12:27:04.629048 22036 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:04.510442 24571 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.640056 24399 consensus_meta.cc:287] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.002s
W20260709 12:27:04.630198 24518 consensus_meta.cc:287] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.726s	user 0.014s	sys 0.001s
W20260709 12:27:04.673599 22184 leader_election.cc:336] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.610s (SENT)
I20260709 12:27:04.637300 24407 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.658720 24595 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.659231 24568 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:04.684412 24399 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.685590 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.680791 24380 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.718222 22218 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 7: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:04.731267 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1920) took 1256 ms. Trace:
I20260709 12:27:04.731851 22137 rpcz_store.cc:276] 0709 12:27:03.474492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.702447 (+227955us) service_pool.cc:224] Handling call
0709 12:27:03.868337 (+165890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.924286 (+ 55949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.730992 (+806706us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002b70d0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:04.731180 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380802432}
I20260709 12:27:04.714015 24595 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.771740 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.777241 24376 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:04.778133 24376 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.779639 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.790807 24578 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.712292 24407 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:04.898805 24449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.009s	sys 0.023s
W20260709 12:27:04.899470 24449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.009s	sys 0.023s
W20260709 12:27:04.993300 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 364368us
I20260709 12:27:04.994181 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:04.994516 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:04.997093 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.005707 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.006374 22137 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:05.007061 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.007453 22137 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:05.008033 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.008544 22137 raft_consensus.cc:2410] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:27:05.009893 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 336336us
I20260709 12:27:05.010445 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.019775 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.020978 22145 raft_consensus.cc:2410] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:27:05.011924 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.012393 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.021955 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.023025 22142 raft_consensus.cc:2368] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 6. Current term is 7.
I20260709 12:27:05.012157 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.023229 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.011685 24600 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.024528 24449 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:05.029228 24449 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.001827 24595 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.031616 24449 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:05.024788 24599 consensus_queue.cc:1048] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:27:05.020588 24578 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:05.001824 24519 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:05.035650 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.036834 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.036918 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.038029 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.039147 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.039911 22137 raft_consensus.cc:2368] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:27:05.041486 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.043902 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.033430 24578 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.053337 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37180 (request call id 437) took 1083 ms. Trace:
I20260709 12:27:05.051448 24440 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:05.052881 24556 log.cc:927] Time spent T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 1.194s	user 0.000s	sys 0.013s
I20260709 12:27:05.053371 24571 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:05.050156 24559 log.cc:927] Time spent T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 1.196s	user 0.004s	sys 0.007s
I20260709 12:27:05.053876 22218 rpcz_store.cc:276] 0709 12:27:03.969710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.972467 (+  2757us) service_pool.cc:224] Handling call
0709 12:27:05.053128 (+1080661us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540002d0d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:05.053277 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669570944}
I20260709 12:27:05.059463 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.060142 22143 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:05.063751 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.064376 22146 raft_consensus.cc:3060] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.064522 22144 raft_consensus.cc:2393] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 3: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:05.065062 24578 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:05.065629 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.062402 24399 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.069154 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.069769 22138 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.071918 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.079831 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 434) took 1152 ms. Trace:
I20260709 12:27:05.080332 22216 rpcz_store.cc:276] 0709 12:27:03.927913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.928081 (+   168us) service_pool.cc:224] Handling call
0709 12:27:03.928336 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.938405 (+ 10069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.079580 (+1141175us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b54004001d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:05.079759 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8644352}
I20260709 12:27:05.081586 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.090404 24594 raft_consensus.cc:3055] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:05.090957 24594 raft_consensus.cc:740] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:05.091792 24594 consensus_queue.cc:260] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.094161 22146 raft_consensus.cc:1275] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:05.096329 24566 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:05.104449 24427 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.108680 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.105006 22138 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:05.109830 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.110893 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.111559 22140 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:05.112036 22143 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:05.112723 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.111282 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.113492 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.114881 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.115504 22145 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:05.117575 24594 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.129053 22138 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:05.122324 24531 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.132170 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.134447 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.135067 23976 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.137383 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 116609us
I20260709 12:27:05.140100 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.141355 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.141942 22216 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:27:05.142549 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:05.143469 22215 raft_consensus.cc:2393] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:05.156344 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:05.156811 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.156957 22215 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.157954 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.158829 22137 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:05.159289 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.161753 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.162603 22214 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:05.163590 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.164479 22218 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 7: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:05.164894 22111 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.135023 24531 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.165809 24573 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.161352 24457 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.170642 24399 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:05.171118 24457 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.167689 22728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 732) took 1211 ms. Trace:
I20260709 12:27:05.135913 23976 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:05.172700 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 161264us
I20260709 12:27:05.175800 22215 raft_consensus.cc:2468] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 7.
I20260709 12:27:05.177851 22184 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.179194 22184 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.161643 24551 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.166956 24568 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.187543 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.189531 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:27:05.192934 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:05.189311 22702 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.195182 22735 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:05.179980 24449 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:05.195047 22185 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.201820 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.201931 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:05.203581 23976 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:05.179787 24399 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:27:05.184471 24578 consensus_queue.cc:1048] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:27:05.204355 24427 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:05.207137 22185 leader_election.cc:336] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.210639 22733 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 7: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
W20260709 12:27:05.210582 22185 leader_election.cc:336] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.212762 24427 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.215474 24427 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.199723 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.219318 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.220148 22137 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:05.211349 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.220175 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.199762 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:05.252482 24613 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.256249 24613 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.258698 24613 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.262115 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.209153 24271 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:27:05.260890 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 96016.3us
I20260709 12:27:05.266561 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:05.264175 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:05.240763 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.268505 22185 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.269240 22185 leader_election.cc:336] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.269737 22185 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.219310 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:05.273777 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.274386 22035 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:05.274497 22111 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:05.273219 22185 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.196072 24551 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:05.276065 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.265442 24449 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.275964 22737 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 7: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:05.276576 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.250349 24399 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.285807 22035 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:05.287391 22111 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:05.284417 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.304941 22185 leader_election.cc:336] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.299518 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:05.308107 22111 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:05.309872 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.279358 24578 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.312500 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.314229 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:05.279438 24431 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:05.319131 24431 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:05.282590 24568 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.315642 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.324117 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.324844 22137 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.325435 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.327126 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.328544 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.329752 24568 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.329969 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.330338 24568 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:05.330879 24568 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.331043 22730 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 7: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:05.275104 24271 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:05.334542 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.316412 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 137316us
I20260709 12:27:05.297576 24613 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.319975 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.295912 24531 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:05.337831 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.295519 24449 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.321362 24457 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:05.335033 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.335520 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:05.319275 22138 raft_consensus.cc:2393] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 7: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
W20260709 12:27:05.313491 22185 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 72 similar messages]
W20260709 12:27:05.374765 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 59206.4us
W20260709 12:27:05.375205 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 68361us
I20260709 12:27:05.319674 24431 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.352766 22137 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:05.333462 22730 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:27:05.175388 22728 rpcz_store.cc:276] 0709 12:27:03.954351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.968816 (+ 14465us) service_pool.cc:224] Handling call
0709 12:27:04.061861 (+ 93045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.090407 (+ 28546us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:04.162013 (+ 71606us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.118223 (+956210us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b18003bd640. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208dee07 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e2358923a 00007f1e239f3a2a
0709 12:27:05.138334 (+ 20111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.153470 (+ 15136us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:05.155770 (+  2300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.165667 (+  9897us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.165822 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27434,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":1560,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14479,"spinlock_wait_cycles":14802816,"thread_start_us":12734,"threads_started":1,"wal-append.queue_time_us":1002185}
I20260709 12:27:05.378680 24613 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:05.379315 24613 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.371901 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.314973 24583 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:05.390522 22736 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
W20260709 12:27:05.344056 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.395085 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 45644us
W20260709 12:27:05.396631 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 58398.4us
W20260709 12:27:05.397325 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.397876 22702 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.397934 22036 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:05.398010 22111 leader_election.cc:336] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:05.398594 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.398737 22111 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:05.400354 22111 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.400944 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:05.404321 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 68883.3us
I20260709 12:27:05.405229 22184 leader_election.cc:400] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:27:05.405575 22184 leader_election.cc:403] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:05.405337 22035 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.342873 24599 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.320283 24616 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:05.399245 22702 consensus_peers.cc:597] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.415561 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.416201 22702 consensus_peers.cc:597] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.344252 24515 raft_consensus.cc:2804] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:05.414168 22111 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.376379 24531 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.418256 22184 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:05.419013 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.419468 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.393689 24457 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.373872 24566 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:27:05.407735 24449 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:05.433712 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.408833 24583 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:05.426501 22184 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.424242 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.453212 22184 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:05.421685 24596 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.422214 24515 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:05.424211 24612 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.418473 24595 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:05.455994 24583 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.449040 24613 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:05.418416 24599 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.497524 24271 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.449103 24399 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:05.502948 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 105073us
W20260709 12:27:05.504675 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 50862.7us
I20260709 12:27:05.449688 24617 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:05.505694 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 86513.9us
I20260709 12:27:05.466002 24616 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.465775 24578 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.510357 22036 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.498761 24515 raft_consensus.cc:3060] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.427775 24531 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.511629 22184 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:05.520012 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.490648 24440 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:27:05.512427 22035 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:05.505403 24449 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.476044 24619 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5.
I20260709 12:27:05.509364 24613 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.508033 24594 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:27:05.510515 24457 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.526244 22184 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.525913 24399 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.533628 24613 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.538002 24613 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.541324 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1825) took 1557 ms. Trace:
I20260709 12:27:05.543489 24570 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:05.549057 24598 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.550086 22219 rpcz_store.cc:276] 0709 12:27:03.984065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.984211 (+   146us) service_pool.cc:224] Handling call
0709 12:27:03.984499 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.249970 (+265471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.540906 (+1290936us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400034dd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:05.541259 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609087872}
I20260709 12:27:05.547588 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.552269 22184 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.557662 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 45337.9us
I20260709 12:27:05.526865 24551 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.550751 24570 raft_consensus.cc:2804] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:05.564031 24570 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.564421 24570 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:05.564800 24376 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.559942 24510 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.565316 24531 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:05.565739 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:05.560825 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.567440 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.566794 22184 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.568495 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.569234 22733 raft_consensus.cc:2468] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:05.572849 22184 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.579152 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:05.568249 24399 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.580857 24399 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.581244 24614 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:05.581440 24449 consensus_queue.cc:1048] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:27:05.581823 24614 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:05.550338 24599 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:05.587884 22702 leader_election.cc:336] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.591338 24626 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.591770 24625 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:27:05.600417 24357 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:05.603034 24515 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.573902 24510 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.618085 24626 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:05.624356 24618 log.cc:927] Time spent T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Append to log took a long time: real 0.231s	user 0.003s	sys 0.000s
I20260709 12:27:05.588454 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:05.561107 24620 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:05.611073 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.613727 22145 raft_consensus.cc:1275] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:05.615725 24624 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.628118 22702 leader_election.cc:336] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:05.634117 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.613691 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 199552us
W20260709 12:27:05.640477 22111 leader_election.cc:336] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:05.642632 22185 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.643435 22185 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:05.643160 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1931) took 1463 ms. Trace:
I20260709 12:27:05.644264 22141 rpcz_store.cc:276] 0709 12:27:04.163616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.170804 (+  7188us) service_pool.cc:224] Handling call
0709 12:27:04.180885 (+ 10081us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:04.293742 (+112857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.293788 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:04.301527 (+  7739us) log.cc:844] Serialized 52 byte log entry
0709 12:27:04.347189 (+ 45662us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:04.347229 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.607577 (+1260348us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001423d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:05.607629 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:05.607679 (+    50us) raft_consensus.cc:1685] finished
0709 12:27:05.607692 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.626795 (+ 19103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4872,"raft.queue_time_us":1573,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":2989,"spinlock_wait_cycles":258444544,"thread_start_us":10937,"threads_started":1,"wal-append.queue_time_us":124785,"wal-append.run_cpu_time_us":2186,"wal-append.run_wall_time_us":1059418}
W20260709 12:27:05.647830 22185 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.648408 22185 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.650064 22185 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.641008 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:05.651667 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:05.662794 22111 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.663622 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.665658 22111 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:05.666415 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 43743.6us
W20260709 12:27:05.666886 22111 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.582682 24614 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.667547 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.662889 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 83813.7us
I20260709 12:27:05.669971 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.670691 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 82294.4us
I20260709 12:27:05.673910 22036 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.678561 22702 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:05.689316 22185 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:05.689814 22185 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.650918 24357 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.708963 22145 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:05.707450 22111 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.650768 24549 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.714674 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.715492 22146 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 7: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:05.666137 24531 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.710505 22111 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:05.670897 24457 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:05.730732 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 56899.5us
I20260709 12:27:05.689278 24629 raft_consensus.cc:2804] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.688073 24578 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.688612 24449 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.708262 24519 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.716159 24616 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.714303 24626 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.670382 24431 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.745967 24434 consensus_queue.cc:1059] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:27:05.688318 24399 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.763592 24583 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.734891 24598 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.734994 24551 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.643513 24620 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.739917 24629 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:05.794422 24407 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.751770 24549 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.755024 24434 raft_consensus.cc:3055] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:05.755002 24431 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:05.752312 24531 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.798417 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.734706 24573 consensus_queue.cc:1059] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:27:05.813823 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.734404 24568 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.775416 24457 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:05.666308 24624 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.806656 22144 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.768477 24594 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.824566 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:05.824992 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:05.834208 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 127493us
I20260709 12:27:05.741110 24628 consensus_queue.cc:1048] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:27:05.781308 24399 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.802371 24616 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:05.791944 24629 raft_consensus.cc:3060] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.834218 22735 raft_consensus.cc:2468] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:05.836871 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.831278 24431 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.802055 24434 raft_consensus.cc:740] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:05.844959 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:05.838243 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 148867us
I20260709 12:27:05.840133 22143 raft_consensus.cc:1240] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:05.836992 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.836113 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.839709 22219 raft_consensus.cc:2468] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:05.848932 22219 raft_consensus.cc:1275] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:05.842105 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.833421 24319 raft_consensus.cc:3055] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:05.852490 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:05.842278 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 131846us
I20260709 12:27:05.750224 24449 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.853924 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:05.835947 24457 raft_consensus.cc:697] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:05.838200 24628 consensus_queue.cc:1243] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer 85f0d4cf04de40aa9e25849fb2380466 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:27:05.859499 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:05.869421 22137 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.863082 24518 consensus_queue.cc:1059] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:05.847697 22215 raft_consensus.cc:2468] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:05.839385 24583 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:05.827998 24531 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.837976 24594 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.872910 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.873384 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:05.847786 24626 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:05.880543 22735 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:05.871848 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.853469 24319 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
W20260709 12:27:05.899761 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 64910.8us
I20260709 12:27:05.901692 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:05.858538 24625 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.907963 22219 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:05.869551 24599 raft_consensus.cc:2804] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:05.872884 24515 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:05.922678 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.921801 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:05.871825 24596 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.848405 24431 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.929982 24596 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.925933 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.933082 22220 raft_consensus.cc:1240] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:05.926127 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.933946 22214 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:05.930469 22111 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:05.940809 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:05.905578 24651 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:05.926729 24630 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:05.955689 24630 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.956081 24630 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.955690 24651 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.961728 24434 consensus_queue.cc:260] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.999378 22137 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
W20260709 12:27:06.017030 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 177847us
W20260709 12:27:06.038606 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.924052 24599 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.843979 24616 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:05.924768 24626 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:05.927847 24625 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:06.849988 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 927648us
W20260709 12:27:06.850051 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 832177us
I20260709 12:27:06.211452 22144 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
W20260709 12:27:06.813459 22111 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.003s	sys 0.051s
W20260709 12:27:06.855823 22111 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.004s	sys 0.052s
I20260709 12:27:06.855901 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59944 (request call id 1965) took 1086 ms. Trace:
W20260709 12:27:06.856150 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 925764us
I20260709 12:27:06.856388 22144 rpcz_store.cc:276] 0709 12:27:05.769892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.773199 (+  3307us) service_pool.cc:224] Handling call
0709 12:27:06.855789 (+1082590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.857537 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:06.155180 24645 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:06.781064 24578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.003s	sys 0.011s
W20260709 12:27:06.859345 24578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.004s	sys 0.012s
I20260709 12:27:06.160372 24630 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:06.174599 22140 raft_consensus.cc:1240] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:06.860019 24319 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:06.691718 24588 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.025s	sys 0.046s
I20260709 12:27:06.861197 24319 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.861752 24630 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:06.174141 22139 raft_consensus.cc:1240] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:06.862437 24630 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:06.862828 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1963) took 1117 ms. Trace:
I20260709 12:27:06.862964 24630 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:06.783496 24510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.007s	sys 0.017s
I20260709 12:27:06.863722 24661 raft_consensus.cc:2804] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:27:06.864249 24510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.008s	sys 0.018s
I20260709 12:27:06.864735 24661 raft_consensus.cc:697] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:06.190719 22219 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 7: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:27:06.754747 22109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.008s	sys 0.008s
I20260709 12:27:06.838263 24668 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:06.861398 24588 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.031s	sys 0.047s
W20260709 12:27:06.781148 22218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.000s	sys 0.013s
W20260709 12:27:06.124523 24634 log.cc:927] Time spent T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 12:27:06.804957 22112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.008s	sys 0.007s
I20260709 12:27:06.858440 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:06.844825 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:06.796342 22185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.009s	sys 0.004s
W20260709 12:27:06.836602 22141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.007s	sys 0.007s
W20260709 12:27:06.865944 22109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.008s	sys 0.010s
W20260709 12:27:06.875679 22141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.007s	sys 0.008s
W20260709 12:27:06.473448 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.863281 22139 rpcz_store.cc:276] 0709 12:27:05.745145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.173512 (+428367us) service_pool.cc:224] Handling call
0709 12:27:06.173898 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.862499 (+688601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.862713 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.704298 22137 raft_consensus.cc:1275] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:06.877643 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 583) took 1113 ms. Trace:
W20260709 12:27:06.875425 22185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.011s	sys 0.005s
I20260709 12:27:06.878078 22139 rpcz_store.cc:276] 0709 12:27:05.764546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.876803 (+1112257us) service_pool.cc:224] Handling call
0709 12:27:06.877089 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.877268 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.877294 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.877405 (+   111us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:06.877436 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.877494 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.877590 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:06.875633 22112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.009s	sys 0.007s
W20260709 12:27:06.869585 22218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.000s	sys 0.014s
I20260709 12:27:06.877791 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 581) took 1113 ms. Trace:
W20260709 12:27:06.835986 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.881704 22137 rpcz_store.cc:276] 0709 12:27:05.763944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.543016 (+779072us) service_pool.cc:224] Handling call
0709 12:27:06.703826 (+160810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.877457 (+173631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.877720 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.882385 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:06.880008 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 584) took 1115 ms. Trace:
I20260709 12:27:06.885854 22139 rpcz_store.cc:276] 0709 12:27:05.764820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.879322 (+1114502us) service_pool.cc:224] Handling call
0709 12:27:06.879575 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.879730 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.879754 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.879791 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:06.879820 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.879867 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.879960 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.886397 22036 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:06.796257 24357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.000s	sys 0.013s
I20260709 12:27:06.884179 22701 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:06.887923 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 587) took 1122 ms. Trace:
I20260709 12:27:06.890105 22139 rpcz_store.cc:276] 0709 12:27:05.765698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.886918 (+1121220us) service_pool.cc:224] Handling call
0709 12:27:06.887302 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.887523 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.887554 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.887612 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:06.887658 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.887733 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.887857 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.892871 22139 raft_consensus.cc:1275] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:06.894994 22702 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:06.895730 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:06.259457 24570 consensus_meta.cc:287] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.695s	user 0.002s	sys 0.010s
I20260709 12:27:06.854808 24434 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.113543 24599 raft_consensus.cc:3060] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.893332 24678 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:06.842610 24614 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:06.898604 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:06.866159 24661 consensus_queue.cc:237] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:06.900645 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:06.194444 24531 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:06.901309 24498 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:06.906150 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 585) took 1141 ms. Trace:
I20260709 12:27:06.849102 24667 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.865132 24630 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:06.847566 24399 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:06.850623 24594 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:06.894562 24357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.001s	sys 0.013s
I20260709 12:27:06.914551 22214 raft_consensus.cc:2410] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:06.866645 24626 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:06.919147 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 572) took 1245 ms. Trace:
I20260709 12:27:06.931090 22141 rpcz_store.cc:276] 0709 12:27:05.673308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.684579 (+ 11271us) service_pool.cc:224] Handling call
0709 12:27:05.715619 (+ 31040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.715863 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:05.853072 (+137209us) log.cc:844] Serialized 14 byte log entry
0709 12:27:06.918694 (+1065622us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.918764 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:06.918830 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.918910 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.919048 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14654,"prepare.queue_time_us":89517,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3513,"raft.queue_time_us":47377,"thread_start_us":1183161,"threads_started":3,"wal-append.queue_time_us":983659}
I20260709 12:27:06.840329 24651 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:06.919611 22137 rpcz_store.cc:276] 0709 12:27:05.765093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.882866 (+1117773us) service_pool.cc:224] Handling call
0709 12:27:06.905676 (+ 22810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.905843 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.905869 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.905908 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:06.905936 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.905988 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.906096 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.919234 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:06.928596 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1957) took 1337 ms. Trace:
I20260709 12:27:06.934826 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:06.895951 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 588) took 1130 ms. Trace:
W20260709 12:27:06.943375 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 59269.1us
I20260709 12:27:06.911221 24616 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:06.951521 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 65231us
I20260709 12:27:06.946839 22142 rpcz_store.cc:276] 0709 12:27:05.590837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.590993 (+   156us) service_pool.cc:224] Handling call
0709 12:27:05.594463 (+  3470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.610872 (+ 16409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.610900 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.611338 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.665822 (+ 54484us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:05.665871 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.667160 (+  1289us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.928309 (+1261149us) raft_consensus.cc:1685] finished
0709 12:27:06.928339 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.928516 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16021,"raft.queue_time_us":17743,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7806,"thread_start_us":54193,"threads_started":1,"wal-append.queue_time_us":118725}
I20260709 12:27:06.496855 24620 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:06.953640 22214 raft_consensus.cc:2393] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 3: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:06.955147 22141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1966) took 1109 ms. Trace:
I20260709 12:27:06.932076 24428 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:06.190488 24457 consensus_queue.cc:237] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:06.950784 22139 rpcz_store.cc:276] 0709 12:27:05.765964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.892283 (+1126319us) service_pool.cc:224] Handling call
0709 12:27:06.892562 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.895484 (+  2922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.895899 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.955583 22141 rpcz_store.cc:276] 0709 12:27:05.845479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.932802 (+1087323us) service_pool.cc:224] Handling call
0709 12:27:06.954646 (+ 21844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.954825 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.954852 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.954896 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:06.954926 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.954976 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.955092 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:06.933739 24630 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:06.956321 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:06.968871 22220 raft_consensus.cc:2410] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:06.957588 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:06.911466 24570 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:06.933043 24645 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.959023 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1967) took 1109 ms. Trace:
I20260709 12:27:06.951290 24498 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:06.967905 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.866806 24668 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:06.950544 24594 raft_consensus.cc:2804] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:06.961196 22216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1842) took 1111 ms. Trace:
I20260709 12:27:07.014619 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:06.915903 24678 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:06.975612 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:07.020207 22220 raft_consensus.cc:2410] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:06.972255 22139 raft_consensus.cc:1240] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:27:06.918813 24614 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.012001 22141 raft_consensus.cc:1240] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:27:06.971911 22137 rpcz_store.cc:276] 0709 12:27:05.849722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.946260 (+1096538us) service_pool.cc:224] Handling call
0709 12:27:06.958510 (+ 12250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.958700 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.958737 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.958776 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:06.958810 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.958870 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.958971 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.012867 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1854) took 1057 ms. Trace:
I20260709 12:27:06.958648 24620 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:06.970978 24616 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.018571 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.036420 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1831) took 1200 ms. Trace:
I20260709 12:27:07.018222 24392 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:07.025112 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.042404 24680 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.025890 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.043025 24680 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:07.025882 24662 log.cc:927] Time spent T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:06.973062 24624 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:06.931945 24667 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.045317 24680 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.050732 22220 raft_consensus.cc:1275] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:07.028316 24614 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.022912 22214 rpcz_store.cc:276] 0709 12:27:05.955970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.011030 (+1055060us) service_pool.cc:224] Handling call
0709 12:27:07.012340 (+  1310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.012540 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.012563 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.012605 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:07.012638 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.012688 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.012805 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.017227 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:07.014954 22216 rpcz_store.cc:276] 0709 12:27:05.849782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.858877 (+  9095us) service_pool.cc:224] Handling call
0709 12:27:05.859228 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.856859 (+997631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.856894 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.857362 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.892918 (+ 35556us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:06.892974 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.893071 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.960965 (+ 67894us) raft_consensus.cc:1685] finished
0709 12:27:06.960984 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.961115 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":727366,"raft.queue_time_us":264452,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19425,"thread_start_us":372151,"threads_started":2,"wal-append.queue_time_us":34899}
I20260709 12:27:07.058656 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1848) took 1186 ms. Trace:
I20260709 12:27:07.036818 22218 rpcz_store.cc:276] 0709 12:27:05.836045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.836566 (+   521us) service_pool.cc:224] Handling call
0709 12:27:05.844938 (+  8372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.845145 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:06.054010 (+208865us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.036099 (+982089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.036149 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:07.036193 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.036260 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.036366 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154570,"prepare.queue_time_us":993751,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"thread_start_us":1022799,"threads_started":2,"wal-append.queue_time_us":793018}
I20260709 12:27:07.041843 24428 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.062641 22215 rpcz_store.cc:276] 0709 12:27:05.872262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.875146 (+  2884us) service_pool.cc:224] Handling call
0709 12:27:05.875531 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.877872 (+  2341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.877904 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.921275 (+ 43371us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.190299 (+269024us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:06.197317 (+  7018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.197415 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.058425 (+861010us) raft_consensus.cc:1685] finished
0709 12:27:07.058455 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.058595 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130588,"raft.queue_time_us":1013541,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":22334,"thread_start_us":226855,"threads_started":1,"wal-append.queue_time_us":981582}
I20260709 12:27:07.062608 22214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1860) took 1104 ms. Trace:
I20260709 12:27:07.041983 24392 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.022271 24681 consensus_queue.cc:1048] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 12:27:07.040772 24670 log.cc:927] Time spent T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:27:07.053653 24660 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.059170 24531 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.010871 24645 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:07.056139 22111 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:07.077744 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 60617.1us
I20260709 12:27:07.074708 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 582) took 1310 ms. Trace:
I20260709 12:27:07.065379 22214 rpcz_store.cc:276] 0709 12:27:05.957873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.061661 (+1103788us) service_pool.cc:224] Handling call
0709 12:27:07.061923 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.062243 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.062272 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.062312 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:07.062342 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.062394 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.062491 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.067353 22216 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:07.079140 22211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.004s	sys 0.010s
I20260709 12:27:07.067219 22141 raft_consensus.cc:1275] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:06.973882 24630 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:07.079627 22211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.004s	sys 0.010s
I20260709 12:27:07.080857 22218 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.078967 22144 rpcz_store.cc:276] 0709 12:27:05.764252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.858583 (+1094331us) service_pool.cc:224] Handling call
0709 12:27:06.873985 (+ 15402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.874214 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:06.932857 (+ 58643us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.074267 (+141410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.074342 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:07.074401 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.074486 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.074628 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12037,"prepare.queue_time_us":35379,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":15381,"thread_start_us":148780,"threads_started":2}
I20260709 12:27:07.017987 24594 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.053804 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1855) took 1097 ms. Trace:
I20260709 12:27:07.078872 22036 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:07.084682 22220 rpcz_store.cc:276] 0709 12:27:05.956336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.040246 (+1083910us) service_pool.cc:224] Handling call
0709 12:27:07.050426 (+ 10180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.053559 (+  3133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.053752 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.057874 24625 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.069208 24428 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:07.090673 24629 consensus_meta.cc:287] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 1.237s	user 0.012s	sys 0.000s
I20260709 12:27:07.083743 24531 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.087445 22036 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:07.097728 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:07.097936 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1838) took 1254 ms. Trace:
I20260709 12:27:07.098347 22220 raft_consensus.cc:2468] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 9.
I20260709 12:27:07.098315 22211 rpcz_store.cc:276] 0709 12:27:05.843843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.843972 (+   129us) service_pool.cc:224] Handling call
0709 12:27:05.851257 (+  7285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.851469 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:06.196139 (+344670us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.097646 (+901507us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.097694 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:07.097733 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.097792 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.097886 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23834,"prepare.queue_time_us":987752,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":1211480,"threads_started":2,"wal-append.queue_time_us":879162}
I20260709 12:27:07.040637 24620 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.056842 24616 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.081188 24578 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.086061 24594 raft_consensus.cc:3060] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.109326 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.110335 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.128463 22212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 441) took 2893 ms. Trace:
I20260709 12:27:07.111215 22733 raft_consensus.cc:1275] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:07.114562 24392 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.093516 24600 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.115140 22217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1841) took 1270 ms. Trace:
I20260709 12:27:07.116730 24428 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:07.117234 24675 log.cc:927] Time spent T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:27:07.117652 24630 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.118232 24578 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.118820 24645 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.120306 24678 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.120923 24616 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.108042 22036 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:07.128845 22212 rpcz_store.cc:276] 0709 12:27:04.215231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.216870 (+  1639us) service_pool.cc:224] Handling call
0709 12:27:04.217260 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.625149 (+1407889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.633393 (+  8244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.633455 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:05.633494 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.108396 (+1474902us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001e0354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:07.108453 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.108581 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3237345536}
I20260709 12:27:07.168942 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:07.121898 24683 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.086625 24685 raft_consensus.cc:2804] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:07.133019 22217 rpcz_store.cc:276] 0709 12:27:05.849474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.849878 (+   404us) service_pool.cc:224] Handling call
0709 12:27:05.850179 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.248598 (+398419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.248652 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.849938 (+601286us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.941034 (+ 91096us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:06.941072 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.941136 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.114869 (+173733us) raft_consensus.cc:1685] finished
0709 12:27:07.114912 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.115066 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1280,"raft.queue_time_us":263923,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":422749,"threads_started":2,"wal-append.queue_time_us":174171}
I20260709 12:27:07.107097 24651 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.108745 24625 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:07.165973 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:07.194813 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.106379 24639 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.106917 24457 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.131982 24449 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.141486 24399 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.102694 24629 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.176826 24531 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.083635 24660 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.187484 24685 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.128787 24570 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.131971 24620 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:07.183862 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 75956.8us
I20260709 12:27:07.231483 22218 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:07.232386 22036 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
W20260709 12:27:07.195277 22185 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:07.132337 24667 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.233129 22185 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:07.237448 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:07.237982 22036 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:07.237982 22185 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:07.228696 24399 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.196520 24625 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.179392 22220 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.182888 24614 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:27:07.204612 24552 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.245337 24600 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:07.264885 24600 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.265308 24600 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.254119 24674 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.266292 24674 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.254487 24688 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.234593 24685 raft_consensus.cc:3060] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.270500 24578 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.265322 24599 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.245582 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.247102 24357 consensus_queue.cc:1048] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:27:07.250790 24671 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:07.255545 24686 log.cc:927] Time spent T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:27:07.218322 24457 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.245033 24101 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.280751 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.196372 24651 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:07.250574 24571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.697s	user 0.028s	sys 0.056s
I20260709 12:27:07.284387 24399 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.231943 24531 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.285768 22216 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:07.243091 24666 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.242887 24449 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:07.290302 24531 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.291177 24667 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.291692 24667 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.292416 24531 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.293576 24667 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.249804 24625 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.254179 22729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 560) took 1424 ms. Trace:
I20260709 12:27:07.203752 24639 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:07.297139 24571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.748s	user 0.028s	sys 0.057s
I20260709 12:27:07.306910 24674 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.308187 24457 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.310755 22219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37718 (request call id 1852) took 1405 ms. Trace:
I20260709 12:27:07.302623 24599 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.325712 22219 rpcz_store.cc:276] 0709 12:27:05.905583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.922448 (+ 16865us) service_pool.cc:224] Handling call
0709 12:27:07.310484 (+1388036us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540002d0d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:07.310675 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601239808}
W20260709 12:27:07.326287 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.314445 24685 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.287755 24671 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.317891 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1836) took 1475 ms. Trace:
I20260709 12:27:07.324029 24666 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.210278 24683 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.296897 24101 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.376904 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:07.379158 22213 rpcz_store.cc:276] 0709 12:27:05.842324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.842826 (+   502us) service_pool.cc:224] Handling call
0709 12:27:05.843131 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.850828 (+  7697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.850863 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.962626 (+1111763us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b2c0007cbf8. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e222e2a11 00007f1e222f2372 00007f1e23a24a01 00007f1e239e943a 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2
0709 12:27:06.963021 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.972031 (+  9010us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:06.972084 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.972169 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.317364 (+345195us) raft_consensus.cc:1685] finished
0709 12:27:07.317390 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.317828 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14046,"raft.queue_time_us":146591,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":95875,"spinlock_wait_cycles":2363136,"thread_start_us":7476,"threads_started":1,"wal-append.queue_time_us":73397}
W20260709 12:27:07.389534 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 94511.4us
I20260709 12:27:07.395648 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.379272 24674 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.397115 24674 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.398692 24629 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.399302 24674 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.399403 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 578) took 1689 ms. Trace:
I20260709 12:27:07.399813 22146 rpcz_store.cc:276] 0709 12:27:05.710496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.731659 (+ 21163us) service_pool.cc:224] Handling call
0709 12:27:05.745133 (+ 13474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.746369 (+  1236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.746415 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.746481 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:05.746526 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.399181 (+1652655us) spinlock_profiling.cc:243] Waited 984 us on lock 0x7b54002f3ad4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:07.399230 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.399348 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264320}
I20260709 12:27:07.402067 24457 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.402580 24457 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.402969 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1968) took 1482 ms. Trace:
I20260709 12:27:07.403577 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:07.404937 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.406075 24457 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.389948 24357 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.403350 22142 rpcz_store.cc:276] 0709 12:27:05.920959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.953146 (+1032187us) service_pool.cc:224] Handling call
0709 12:27:06.970323 (+ 17177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.101452 (+131129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.101497 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.101564 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:07.101612 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.402760 (+301148us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400059454. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:07.402802 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.402915 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300917120}
I20260709 12:27:07.409332 24431 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.411242 24674 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.411927 24674 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.412815 24596 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.414103 24683 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.415352 24674 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:07.417423 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 137461us
I20260709 12:27:07.418977 24357 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.422297 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 577) took 1715 ms. Trace:
I20260709 12:27:07.423243 24357 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.424144 24498 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.424609 24498 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.426805 24498 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.432649 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1961) took 1823 ms. Trace:
W20260709 12:27:07.432770 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 55957.1us
I20260709 12:27:07.433086 22143 rpcz_store.cc:276] 0709 12:27:05.609427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.609567 (+   140us) service_pool.cc:224] Handling call
0709 12:27:05.609820 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.846971 (+237151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.432409 (+1585438us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000d6bd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:07.432592 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527502592}
I20260709 12:27:07.434012 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:07.434757 24380 raft_consensus.cc:2804] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:07.435166 24380 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.435688 24380 raft_consensus.cc:3060] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:07.437160 24626 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.438154 24575 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.437922 24626 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.440469 24626 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.446383 22211 raft_consensus.cc:1240] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.446564 24450 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.447088 24450 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.447561 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:07.448179 22137 raft_consensus.cc:2468] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:07.449841 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:07.462939 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.379648 24399 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.480394 24668 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.480862 24399 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.469112 24660 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.483523 24399 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.377813 24624 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:27:07.464417 24674 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.485491 24674 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.488410 24674 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.465296 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:07.465822 24648 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:07.490527 24648 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.491786 24101 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.467842 22142 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:27:07.390600 24666 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.494581 24639 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.495083 24666 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.469934 24428 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.495842 24428 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.470919 24596 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.471451 24629 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.471525 24628 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.472018 24600 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.472600 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.474009 24651 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.422808 22145 rpcz_store.cc:276] 0709 12:27:05.706636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.728834 (+ 22198us) service_pool.cc:224] Handling call
0709 12:27:05.731018 (+  2184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.790165 (+ 59147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.790212 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.790273 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:05.790323 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.421987 (+1631664us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b5400342e54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:07.422072 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.422227 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135438208}
I20260709 12:27:07.449079 24450 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.512354 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:07.513482 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:07.514250 22144 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:27:07.303272 22729 rpcz_store.cc:276] 0709 12:27:05.831156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.831373 (+   217us) service_pool.cc:224] Handling call
0709 12:27:05.847748 (+ 16375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.845601 (+997853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.845640 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.846234 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.917717 (+ 71483us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:06.923359 (+  5642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.941853 (+ 18494us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.239136 (+297283us) raft_consensus.cc:1685] finished
0709 12:27:07.242683 (+  3547us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.253021 (+ 10338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86918,"raft.queue_time_us":968916,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":63512,"threads_started":1,"wal-append.queue_time_us":108417}
I20260709 12:27:07.437323 24457 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:07.516330 24357 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.513254 24596 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.518376 24357 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.498376 22735 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:07.507136 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:07.513242 22143 raft_consensus.cc:2468] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:07.518246 24457 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.496636 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:07.521644 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:07.493026 24648 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:07.387539 24671 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.522359 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:07.524642 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:07.827952 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 749250us
W20260709 12:27:08.509020 22111 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:07.637486 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:08.509681 24711 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.942720 24599 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.017s
W20260709 12:27:08.510593 22111 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:08.510941 24599 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.005s	sys 0.037s
I20260709 12:27:08.510509 24711 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:08.511670 22111 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:08.469079 22137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.010s	sys 0.029s
W20260709 12:27:08.512444 22137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.011s	sys 0.029s
I20260709 12:27:07.563869 24594 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.465572 24515 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:08.439924 22732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.000s	sys 0.042s
I20260709 12:27:08.515461 24648 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:08.515839 22732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.004s	sys 0.044s
I20260709 12:27:08.515605 24515 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.516111 24648 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:07.569527 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:08.304380 24632 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:08.518603 24632 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.515048 24594 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:08.520254 22111 leader_election.cc:336] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:08.520785 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.521330 22111 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:08.527027 24720 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.527940 24720 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:08.532070 21952 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet bf83ee90e33b4083aebda67b32ca1149 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 85f0d4cf04de40aa9e25849fb2380466 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:07.872256 24639 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:08.532497 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:08.264305 22702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.005s	sys 0.007s
W20260709 12:27:07.937261 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 330753us
I20260709 12:27:08.537806 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:08.539317 24648 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:08.540316 24596 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.913870 24651 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:08.263441 22701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.006s	sys 0.006s
W20260709 12:27:08.634871 22701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.007s	sys 0.006s
W20260709 12:27:08.635334 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 1.05604e+06us
W20260709 12:27:08.635540 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 97811us
I20260709 12:27:07.551466 24498 consensus_queue.cc:1048] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.085s
I20260709 12:27:08.638263 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:08.639783 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:08.640465 24720 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.640556 22216 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:07.769829 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:08.641073 24720 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:08.641690 24720 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:08.642160 24720 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.642495 24596 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:07.658439 24666 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.516597 24629 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.644686 24666 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.646310 24629 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.604506 24567 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.647264 24666 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.647172 24567 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.520138 24628 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:07.664215 24674 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.650859 24628 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.651252 24674 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.651600 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:07.910957 24625 consensus_meta.cc:287] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.616s	user 0.002s	sys 0.008s
W20260709 12:27:08.263835 22144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.004s	sys 0.008s
W20260709 12:27:08.652956 22144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.004s	sys 0.008s
I20260709 12:27:08.549433 24457 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:07.968364 24600 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:07.524185 24626 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.605203 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 570) took 2857 ms. Trace:
I20260709 12:27:08.666877 22140 rpcz_store.cc:276] 0709 12:27:05.672698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.674304 (+  1606us) service_pool.cc:224] Handling call
0709 12:27:06.174376 (+500072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.860761 (+686385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.529794 (+1669033us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400140fd0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:08.529916 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076588416}
W20260709 12:27:08.606694 22702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.005s	sys 0.007s
I20260709 12:27:08.606760 22146 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:08.670574 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59944 (request call id 1977) took 1177 ms. Trace:
I20260709 12:27:07.892769 24685 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.671057 22146 rpcz_store.cc:276] 0709 12:27:07.493464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.497250 (+  3786us) service_pool.cc:224] Handling call
0709 12:27:08.532354 (+1035104us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:27:08.670514 (+138160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3798912}
I20260709 12:27:08.663925 24457 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.672297 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:08.672523 24515 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:08.672232 24457 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.575598 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56596 (request call id 592) took 1055 ms. Trace:
W20260709 12:27:08.567189 22111 leader_election.cc:336] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:08.673333 22143 rpcz_store.cc:276] 0709 12:27:07.520655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.521391 (+   736us) service_pool.cc:224] Handling call
0709 12:27:08.575527 (+1054136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:08.673623 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 106489us
I20260709 12:27:08.549340 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:27:08.505656 24575 consensus_meta.cc:287] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 1.046s	user 0.012s	sys 0.000s
I20260709 12:27:08.644110 24357 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.147722 24641 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.654057 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:08.654079 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1983) took 1158 ms. Trace:
I20260709 12:27:07.950829 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:08.658324 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:27:08.574630 24644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.019s	sys 0.020s
I20260709 12:27:08.661921 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:08.662292 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:08.663097 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:08.506084 24695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.023s
I20260709 12:27:08.042783 24668 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:08.699424 22731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35008 (request call id 565) took 1124 ms. Trace:
I20260709 12:27:08.704074 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:08.705557 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56596 (request call id 596) took 1182 ms. Trace:
W20260709 12:27:08.674285 22111 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.708292 22111 leader_election.cc:336] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:08.708801 22111 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:08.633338 21952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 101312us
I20260709 12:27:08.673120 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56596 (request call id 598) took 1128 ms. Trace:
I20260709 12:27:08.709143 22138 rpcz_store.cc:276] 0709 12:27:07.523317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.950554 (+427237us) service_pool.cc:224] Handling call
0709 12:27:08.705468 (+754914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.709618 22146 rpcz_store.cc:276] 0709 12:27:07.544836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.672044 (+1127208us) service_pool.cc:224] Handling call
0709 12:27:08.673065 (+  1021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.703583 22731 rpcz_store.cc:276] 0709 12:27:07.552033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.552143 (+   110us) service_pool.cc:224] Handling call
0709 12:27:08.676184 (+1124041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.886787 24428 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.644210 24720 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:08.705865 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 71519.4us
W20260709 12:27:08.670475 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 1.1178e+06us
I20260709 12:27:08.711602 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:08.712453 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:08.719549 22218 raft_consensus.cc:2468] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 2.
I20260709 12:27:08.714012 22140 pending_rounds.cc:85] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 1
I20260709 12:27:08.720455 22140 pending_rounds.cc:107] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:27:08.720727 22140 raft_consensus.cc:2889] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:08.710912 24628 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.635350 24648 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.655321 24567 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.630962 24639 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.707442 24668 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.708325 24575 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:08.703647 24644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.026s	sys 0.022s
I20260709 12:27:08.738272 22146 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:08.750831 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 590) took 1230 ms. Trace:
I20260709 12:27:08.751142 22146 rpcz_store.cc:276] 0709 12:27:07.520048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.710291 (+1190243us) service_pool.cc:224] Handling call
0709 12:27:08.738008 (+ 27717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.750585 (+ 12577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.750766 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.700042 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:08.659011 24651 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.708479 24671 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:08.707870 24695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.014s	sys 0.027s
I20260709 12:27:08.711421 24600 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:08.759716 22186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.029s	sys 0.035s
W20260709 12:27:08.770476 22186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.029s	sys 0.035s
I20260709 12:27:08.727185 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:08.679646 24707 consensus_queue.cc:1048] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:27:08.676896 24626 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:08.768936 22185 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:08.051844 24580 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.664654 24625 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.745929 24708 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.747267 24719 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:08.713320 24641 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.803897 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:08.804836 22214 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
W20260709 12:27:08.831977 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 61891.7us
W20260709 12:27:08.832746 22184 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.089s (SENT)
W20260709 12:27:08.810295 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.808974 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.828967 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:08.833931 22184 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:08.763321 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:08.765640 24711 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:08.772859 24671 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.855566 24671 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.856170 24671 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.857648 24651 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:08.858173 24651 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.858439 24629 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.858588 24651 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.859463 24457 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.859274 24629 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.860780 24651 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.754871 24428 consensus_queue.cc:1059] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:27:08.861078 24626 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.861663 22141 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.861773 24428 raft_consensus.cc:3055] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:08.862232 24629 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.862257 24428 raft_consensus.cc:740] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:08.863281 24668 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:08.863901 24712 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:08.864516 24713 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.864449 24712 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.864143 24428 consensus_queue.cc:260] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.865880 24428 raft_consensus.cc:3060] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:08.866542 24712 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:08.866678 24641 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:08.867185 22216 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.868016 24589 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:08.743243 24628 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.868499 24589 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.870523 24589 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:08.870869 24628 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:08.770114 24357 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:27:08.872268 24639 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:08.839651 24708 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.766183 24666 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.841094 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:08.842815 24674 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:08.843990 24701 log.cc:927] Time spent T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:27:08.830360 22733 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:08.706055 22144 rpcz_store.cc:276] 0709 12:27:07.495282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.517508 (+ 22226us) service_pool.cc:224] Handling call
0709 12:27:07.520551 (+  3043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.520732 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:07.551970 (+ 31238us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.653614 (+1101644us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.653750 (+   136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.653789 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:08.653849 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.653922 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.654028 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48950,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":27422,"spinlock_wait_cycles":265920896,"thread_start_us":1101144,"threads_started":1,"wal-append.queue_time_us":992746}
I20260709 12:27:08.897624 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:27:08.903192 24706 log.cc:927] Time spent T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.358s	user 0.002s	sys 0.000s
I20260709 12:27:08.903002 24732 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:27:08.907861 24710 log.cc:927] Time spent T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.399s	user 0.003s	sys 0.000s
W20260709 12:27:08.909427 24702 log.cc:927] Time spent T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Append to log took a long time: real 0.358s	user 0.002s	sys 0.000s
I20260709 12:27:08.856654 24671 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.959843 22736 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:08.928038 22216 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:08.749811 24648 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:08.874842 24716 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.944608 22737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35008 (request call id 567) took 1351 ms. Trace:
I20260709 12:27:08.953260 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 593) took 1432 ms. Trace:
I20260709 12:27:08.954314 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 589) took 1434 ms. Trace:
I20260709 12:27:08.838274 24580 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.939498 22141 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:08.799690 24600 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.971594 22138 rpcz_store.cc:276] 0709 12:27:07.519715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.710078 (+1190363us) service_pool.cc:224] Handling call
0709 12:27:08.710380 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.710612 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:08.729095 (+ 18483us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.953865 (+224770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.953937 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:08.954001 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.954095 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.954243 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67350,"prepare.queue_time_us":18601,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":68406,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3765,"thread_start_us":147754,"threads_started":1}
W20260709 12:27:08.956530 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 115486us
I20260709 12:27:08.963227 22737 rpcz_store.cc:276] 0709 12:27:07.593623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.593808 (+   185us) service_pool.cc:224] Handling call
0709 12:27:08.897416 (+1303608us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800034598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:27:08.944532 (+ 47116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23553408}
I20260709 12:27:08.975930 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:08.976730 22138 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:08.977981 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:08.971441 22144 rpcz_store.cc:276] 0709 12:27:07.520924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.945572 (+1424648us) service_pool.cc:224] Handling call
0709 12:27:08.952695 (+  7123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.952896 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.952925 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.952971 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:08.953004 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.953062 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.953199 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.979439 22138 raft_consensus.cc:2376] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7. Re-sending same reply.
I20260709 12:27:08.975430 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1980) took 1481 ms. Trace:
W20260709 12:27:08.979527 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 267987us
I20260709 12:27:08.981093 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:08.982564 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:08.983283 22138 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:08.976680 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:08.980576 22139 rpcz_store.cc:276] 0709 12:27:07.494398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.497063 (+  2665us) service_pool.cc:224] Handling call
0709 12:27:08.520137 (+1023074us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:08.520330 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.520528 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:08.525931 (+  5403us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.975032 (+449101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.975103 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:08.975162 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.975250 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.975375 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1177,"prepare.queue_time_us":4870,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":170035,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7775,"spinlock_wait_cycles":35637504,"thread_start_us":453803,"threads_started":3,"wal-append.queue_time_us":347418}
I20260709 12:27:08.986729 24628 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:08.984694 22111 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:08.990960 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 595) took 1469 ms. Trace:
I20260709 12:27:08.991462 22138 rpcz_store.cc:276] 0709 12:27:07.521385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.989969 (+1468584us) service_pool.cc:224] Handling call
0709 12:27:08.990333 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.990546 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.990582 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.990637 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:08.990684 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.990751 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.990895 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.949263 24666 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:08.957608 24729 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.996654 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 594) took 1475 ms. Trace:
I20260709 12:27:09.007438 22144 rpcz_store.cc:276] 0709 12:27:07.521142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.988663 (+1467521us) service_pool.cc:224] Handling call
0709 12:27:08.996338 (+  7675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.996449 (+   111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.996465 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.996499 (+    34us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:08.996518 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.996550 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.996611 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.962926 24711 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:09.010591 24649 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:09.015232 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.020546 22212 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:27:08.952247 22217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a"
dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37702
I20260709 12:27:08.987164 24628 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.021715 22217 raft_consensus.cc:606] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Received request to transfer leadership
W20260709 12:27:09.024374 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 182968us
I20260709 12:27:09.035343 22217 raft_consensus.cc:614] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:27:09.035709 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 297496us
I20260709 12:27:08.988716 24674 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:09.041999 24600 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.042554 22142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1978) took 1548 ms. Trace:
W20260709 12:27:09.135458 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 94863.4us
I20260709 12:27:09.135591 22701 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:09.034109 24510 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:08.957794 24732 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:09.135042 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 90050.8us
I20260709 12:27:09.137391 22142 rpcz_store.cc:276] 0709 12:27:07.493768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.496883 (+  3115us) service_pool.cc:224] Handling call
0709 12:27:09.041708 (+1544825us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:09.041980 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.042188 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.042217 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:09.042267 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:09.042314 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.042375 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.042488 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5332864}
I20260709 12:27:09.043295 24649 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:09.149326 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 107923us
W20260709 12:27:09.155643 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 136866us
I20260709 12:27:09.156998 22137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1979) took 1662 ms. Trace:
I20260709 12:27:09.157390 22137 rpcz_store.cc:276] 0709 12:27:07.494089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.495127 (+  1038us) service_pool.cc:224] Handling call
0709 12:27:07.495492 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.495810 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.495837 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.496327 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:27:08.512841 (+1016514us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:08.512883 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.512963 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.907166 (+394203us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:27:09.156698 (+249532us) raft_consensus.cc:1685] finished
0709 12:27:09.156719 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.156923 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1145,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":10917,"spinlock_wait_cycles":345689856,"thread_start_us":1016123,"threads_started":1,"wal-append.queue_time_us":1011913}
I20260709 12:27:09.148639 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:09.016881 24719 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:09.044596 24723 log.cc:927] Time spent T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:27:09.170140 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.038622 24628 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.034355 24651 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:09.145010 24701 log.cc:927] Time spent T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:27:09.176152 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.175806 24719 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.177433 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.173978 24457 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:27:09.176450 24722 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.035321 24711 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.181902 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.259702 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.219658 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:09.175927 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.243795 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.253862 22145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1981) took 1759 ms. Trace:
I20260709 12:27:09.156001 24727 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.046080 24741 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.292080 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:09.327409 22142 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:27:09.327474 22145 rpcz_store.cc:276] 0709 12:27:07.494713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.510633 (+ 15920us) service_pool.cc:224] Handling call
0709 12:27:09.252908 (+1742275us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b580015ff98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:09.253235 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.253463 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.253496 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:09.253549 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:09.253599 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.253668 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.253791 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5020544}
I20260709 12:27:09.219482 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:09.270990 22111 connection.cc:256] RPC call timeout handler was delayed by -1.8481559110005037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 12:27:09.332669 22111 connection.cc:256] RPC call timeout handler was delayed by -1.57995591100007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 12:27:09.333956 22111 connection.cc:256] RPC call timeout handler was delayed by -1.5583559110000351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 12:27:09.330729 22219 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.334345 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.335491 22111 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:09.229820 24690 log.cc:927] Time spent T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 2.061s	user 0.013s	sys 0.032s
W20260709 12:27:09.226649 24736 log.cc:927] Time spent T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:27:09.259873 24380 consensus_meta.cc:287] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 1.824s	user 0.012s	sys 0.000s
I20260709 12:27:09.181787 24625 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.214233 22732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 748) took 1817 ms. Trace:
I20260709 12:27:09.328588 24649 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.252653 24708 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.340163 24580 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.330279 24722 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.341327 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.343429 22138 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:09.378873 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.380793 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.202499 24651 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.247254 24719 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.262780 24568 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.243295 24666 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:09.373610 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 235723us
I20260709 12:27:09.216814 24599 raft_consensus.cc:2804] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.241869 24671 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.240991 24648 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:09.263756 24626 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:09.376047 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.161916 24510 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.157919 24674 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.214972 24732 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.380539 22142 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:09.383495 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.182466 24716 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.195s
I20260709 12:27:09.377357 24380 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:08.873111 24515 consensus_queue.cc:1175] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "be238c1de63840f9bb041e2f9ba58d2b" responder_term: 7 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:09.377130 22732 rpcz_store.cc:276] 0709 12:27:07.396947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.399919 (+  2972us) service_pool.cc:224] Handling call
0709 12:27:07.400343 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:07.400799 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.400829 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:07.401540 (+   711us) log.cc:844] Serialized 52 byte log entry
0709 12:27:08.516353 (+1114813us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:08.520788 (+  4435us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.521022 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.521105 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.213914 (+692809us) raft_consensus.cc:1685] finished
0709 12:27:09.213934 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.214137 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2532,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1073,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":236,"thread_start_us":1118423,"threads_started":2,"wal-append.queue_time_us":1273223}
I20260709 12:27:09.369959 24661 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:09.419792 22213 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:09.381994 22145 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:09.397078 22035 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:09.407852 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.413951 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.422219 22035 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:09.422408 22138 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
W20260709 12:27:09.387267 24714 log.cc:927] Time spent T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.851s	user 0.002s	sys 0.000s
I20260709 12:27:09.396270 24599 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.427269 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:09.428296 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 255512us
I20260709 12:27:09.428849 22140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 1985) took 1933 ms. Trace:
I20260709 12:27:09.429380 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.429804 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.403673 24725 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.434499 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.400846 24428 consensus_queue.cc:1059] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:27:09.436642 22145 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:09.429239 22140 rpcz_store.cc:276] 0709 12:27:07.495837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.704214 (+1208377us) service_pool.cc:224] Handling call
0709 12:27:08.704677 (+   463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:08.744177 (+ 39500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.744209 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:08.750693 (+  6484us) log.cc:844] Serialized 52 byte log entry
0709 12:27:08.981277 (+230584us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:09.022359 (+ 41082us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.044858 (+ 22499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.044932 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.428642 (+383710us) raft_consensus.cc:1685] finished
0709 12:27:09.428660 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.428781 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41064,"prepare.queue_time_us":39866,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":287711,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":32612,"thread_start_us":159975,"threads_started":1,"wal-append.queue_time_us":246981}
I20260709 12:27:09.436808 22701 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:09.428165 24688 raft_consensus.cc:2804] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:09.441828 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.442952 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.402904 24626 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.429733 24746 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.444378 22140 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:09.428359 24599 raft_consensus.cc:3060] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.443485 22217 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:09.445432 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.447695 22035 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:09.450064 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.450255 22035 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:09.450692 22217 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:09.442523 24649 raft_consensus.cc:2804] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.453343 24649 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:09.453764 24649 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.456501 24746 raft_consensus.cc:2804] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.456897 24746 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.466295 24746 raft_consensus.cc:3060] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.465641 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.470397 22145 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
I20260709 12:27:09.443197 24688 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:09.473093 22035 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:09.478011 22219 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 7.
I20260709 12:27:09.478410 22035 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:09.449579 24575 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:09.478582 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.480701 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:09.480975 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.428761 24661 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.481662 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.503149 22144 raft_consensus.cc:2393] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 7: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:09.481812 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.519730 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.522794 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.521878 22036 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:09.521922 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.523823 22145 raft_consensus.cc:2468] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:09.482904 24570 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.524379 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.479717 24688 raft_consensus.cc:3060] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.525422 24731 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.480655 24575 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.483354 24625 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:09.526266 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:09.525108 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.480748 24428 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.482551 24722 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.536706 22217 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:09.477208 24750 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.532034 24671 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.530848 22144 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:27:09.482690 24380 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 10 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.484508 24674 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.486408 24626 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.529296 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:09.539034 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:09.540259 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.531296 24570 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:09.545231 22111 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:09.551592 24570 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.550285 24729 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:09.556804 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
W20260709 12:27:09.558785 22184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.043s	sys 0.035s
W20260709 12:27:09.559217 22184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.043s	sys 0.035s
W20260709 12:27:09.559810 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 727042us
I20260709 12:27:09.563118 24570 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.538889 24428 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.536233 24575 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:09.571759 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:09.541780 24600 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:09.575155 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.542766 24750 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:09.578609 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.580396 22111 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:09.544296 24625 raft_consensus.cc:697] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:09.549135 24722 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.581200 22145 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
W20260709 12:27:09.590888 24594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.010s	sys 0.004s
W20260709 12:27:09.591357 24594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.010s	sys 0.004s
W20260709 12:27:09.593569 22111 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:09.544945 24671 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.594303 22111 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:09.577735 24649 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.578593 24626 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:09.584159 24750 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.589015 24457 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.578051 24716 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:09.578433 24632 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:09.576005 24428 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.615655 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 597) took 2091 ms. Trace:
I20260709 12:27:09.616151 22139 rpcz_store.cc:276] 0709 12:27:07.524624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.986960 (+1462336us) service_pool.cc:224] Handling call
0709 12:27:08.987234 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.996136 (+  8902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.996186 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.996250 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:08.996301 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.615413 (+619112us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b540018a454. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:09.615460 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.615595 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19871616}
I20260709 12:27:09.602576 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.599601 24626 raft_consensus.cc:697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:09.603685 22734 raft_consensus.cc:1240] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:09.605314 24688 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.606357 24649 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:09.606689 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.608175 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.599884 24719 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.601797 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:09.592780 24599 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.628669 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:09.629678 24661 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.613917 24716 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:09.618458 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:09.602207 22111 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:09.625102 22216 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:09.609829 24510 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.627087 22217 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.592375 24722 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:09.628055 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.649560 22214 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:09.650477 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:09.613644 24457 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:09.653647 24632 consensus_queue.cc:1059] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:09.654095 24457 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.655833 24510 raft_consensus.cc:3055] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:09.656260 24510 raft_consensus.cc:740] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:27:09.658768 24734 log.cc:927] Time spent T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.475s	user 0.002s	sys 0.000s
I20260709 12:27:09.660372 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.660729 24719 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.660974 22212 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:09.661585 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.662026 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.662223 22214 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 7.
I20260709 12:27:09.662608 22212 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:09.663121 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.663489 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.664218 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.634284 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.634897 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:09.635413 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.634845 22139 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:27:09.667011 22216 raft_consensus.cc:2468] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:09.667165 22212 raft_consensus.cc:1275] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:09.667416 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.668022 22139 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:09.668757 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.636421 24671 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:09.643251 24628 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.617475 22145 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:09.673928 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:09.669832 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 67661.2us
I20260709 12:27:09.633932 24625 consensus_queue.cc:237] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.638254 24746 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.678242 24746 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.678650 24628 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.679021 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:09.680799 22141 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59944 (request call id 1976) took 2187 ms (client timeout 1532 ms). Trace:
I20260709 12:27:09.683305 22146 raft_consensus.cc:1240] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 2. Current term is 3. Ops: []
W20260709 12:27:09.675166 22111 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:09.674592 22139 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
I20260709 12:27:09.680495 24510 consensus_queue.cc:260] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.675537 24578 consensus_queue.cc:1059] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.688119 22214 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:09.693106 22184 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:27:09.686431 22141 rpcz_store.cc:269] 0709 12:27:07.493130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.496367 (+  3237us) service_pool.cc:224] Handling call
0709 12:27:09.680630 (+2184263us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54002f30d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:09.680734 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790115072}
I20260709 12:27:09.687598 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.636582 24716 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.691298 22701 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:09.644611 24599 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.699595 24578 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.700002 24578 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:09.700374 24578 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.702445 24639 raft_consensus.cc:3055] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:09.702857 24639 raft_consensus.cc:740] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:09.703624 24639 consensus_queue.cc:260] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.704860 24639 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:09.705355 22017 auto_rebalancer.cc:893] Removing replace marker failed: Replica be238c1de63840f9bb041e2f9ba58d2b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:09.706033 22017 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:27:09.706401 22017 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:27:09.636579 24688 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:09.710175 24715 log.cc:927] Time spent T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 1.173s	user 0.000s	sys 0.005s
I20260709 12:27:09.711454 22211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1865) took 2188 ms. Trace:
I20260709 12:27:09.711797 22211 rpcz_store.cc:276] 0709 12:27:07.523259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.523397 (+   138us) service_pool.cc:224] Handling call
0709 12:27:07.553108 (+ 29711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.563115 (+ 10007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.563160 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:08.513893 (+950733us) log.cc:844] Serialized 26 byte log entry
0709 12:27:08.539777 (+ 25884us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:08.539820 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.539891 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.709591 (+1169700us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:27:09.711173 (+  1582us) raft_consensus.cc:1685] finished
0709 12:27:09.711195 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.711391 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14975,"raft.queue_time_us":25289,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":10310,"spinlock_wait_cycles":284685056,"thread_start_us":25530,"threads_started":1,"wal-append.queue_time_us":22983}
I20260709 12:27:09.713354 24674 consensus_queue.cc:1048] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:09.715559 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.654707 24722 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.694451 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.729919 22141 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:09.694983 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.731179 22139 raft_consensus.cc:2376] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5. Re-sending same reply.
I20260709 12:27:09.732331 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.686714 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:09.738772 22217 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:27:09.739725 22216 raft_consensus.cc:1240] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:27:09.751266 22215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1877) took 1092 ms. Trace:
I20260709 12:27:09.751746 22215 rpcz_store.cc:276] 0709 12:27:08.658760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.659182 (+   422us) service_pool.cc:224] Handling call
0709 12:27:08.659530 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.659841 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.659869 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:08.660288 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:27:08.985776 (+325488us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:09.005110 (+ 19334us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.005433 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.005558 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.700313 (+694755us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800329800. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208fc3f3 00007f1e208fe7c1 00007f1e208fe779 00007f1e208fe709 00007f1e208fe6d1 00007f1e208fd9cd 0000000000388634 0000000000388479 00007f1e208df83a
0709 12:27:09.716779 (+ 16466us) raft_consensus.cc:1685] finished
0709 12:27:09.751014 (+ 34235us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.751196 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17056,"prepare.queue_time_us":30674,"prepare.run_cpu_time_us":8801,"prepare.run_wall_time_us":98412,"raft.queue_time_us":740,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":41678,"spinlock_wait_cycles":32595200,"thread_start_us":259391,"threads_started":1,"wal-append.queue_time_us":480569}
W20260709 12:27:09.754740 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 79629.2us
W20260709 12:27:09.755486 22111 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:09.756023 22111 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:09.685356 24651 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.686230 24661 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:09.758966 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 109526us
I20260709 12:27:09.762590 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.764498 22141 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
W20260709 12:27:09.767185 20873 thread.cc:527] Waited for 1000ms trying to join with rpc worker (tid 22062)
I20260709 12:27:09.762121 24750 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.773686 24750 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.753973 24711 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.776010 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.777545 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.777896 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.778189 22141 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:09.778522 22143 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:09.779358 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.780109 22141 raft_consensus.cc:2468] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:09.779425 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.781309 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.782019 22142 raft_consensus.cc:2468] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
W20260709 12:27:09.770370 22111 consensus_peers.cc:597] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:09.708911 24626 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.789431 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.705402 24570 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:09.725435 24654 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:09.795332 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 121512us
I20260709 12:27:09.797003 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.798813 22143 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:09.801816 22111 leader_election.cc:336] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:09.802140 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.802307 22111 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:09.803359 22111 leader_election.cc:336] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:09.803777 22111 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:09.804759 22111 leader_election.cc:336] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:09.761669 24719 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:09.685128 24575 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:09.716246 24632 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:27:09.802752 22142 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:09.806813 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.781621 24510 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.763751 24725 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:09.805124 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:09.823462 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.828296 22143 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:09.794896 24654 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.829203 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.830971 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.842849 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:09.806209 24711 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.811009 24661 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:09.844357 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.862095 22143 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.847959 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.863020 22217 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
I20260709 12:27:09.856190 22141 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:09.829403 24741 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:09.813001 24752 raft_consensus.cc:3055] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:09.801874 24428 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.845116 24654 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.864974 24752 raft_consensus.cc:740] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:09.873189 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.870468 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:09.871599 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.875497 22733 raft_consensus.cc:2410] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:09.876457 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.878087 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.880235 24752 consensus_queue.cc:260] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:09.885598 24756 log.cc:927] Time spent T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:27:09.886296 24752 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.887256 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.887820 22142 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.895643 22220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1873) took 1257 ms. Trace:
I20260709 12:27:09.899531 22734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 573) took 1225 ms. Trace:
I20260709 12:27:09.899963 22734 rpcz_store.cc:276] 0709 12:27:08.674115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.676089 (+  1974us) service_pool.cc:224] Handling call
0709 12:27:09.596868 (+920779us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b5800034598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4eee 000000000036eb39 00007f1e289381e0 00007f1e28a010c4 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:09.597035 (+   167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.627031 (+ 29996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.899305 (+272274us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b5400304b54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:09.899471 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23158784}
I20260709 12:27:09.885449 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:09.903573 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.907975 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.909758 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.896055 22220 rpcz_store.cc:276] 0709 12:27:08.638180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.649819 (+ 11639us) service_pool.cc:224] Handling call
0709 12:27:08.650068 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.778152 (+128084us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:08.984901 (+206749us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.816139 (+831238us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b18003f2f80. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e235914bc 00007f1e208df48b 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e2358923a
0709 12:27:09.816375 (+   236us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:09.816433 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:09.816493 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.894737 (+ 78244us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18003f2f80. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208ca2a6 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419
0709 12:27:09.895448 (+   711us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540038ccd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:09.895487 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.895589 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3297,"prepare.queue_time_us":196923,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":97,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":11939,"spinlock_wait_cycles":313930112,"thread_start_us":180772,"threads_started":2,"wal-append.queue_time_us":190048}
I20260709 12:27:09.918789 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.919471 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.920113 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.920531 22731 raft_consensus.cc:2393] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:09.921339 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.922406 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.930199 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.930821 22142 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:09.938642 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.939790 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.942471 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.943602 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.946231 24578 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.948307 24578 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:09.935987 22728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.953338 24457 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:09.954365 24428 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.955556 24457 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:09.956403 22139 raft_consensus.cc:2393] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:09.962064 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.965787 22730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.970355 22143 raft_consensus.cc:2468] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:27:09.971076 22145 raft_consensus.cc:1240] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:09.973555 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:27:09.975044 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.975656 22185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.975988 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.979341 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:09.976925 22185 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:09.980002 22737 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 7.
I20260709 12:27:09.980566 22141 raft_consensus.cc:1240] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:09.974115 22145 raft_consensus.cc:2376] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3. Re-sending same reply.
I20260709 12:27:09.980014 22702 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
W20260709 12:27:09.988560 22183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.992952 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:10.019969 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:10.020815 22211 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.025131 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:10.025897 22185 leader_election.cc:336] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.028085 22217 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.032130 22218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37180 (request call id 478) took 1007 ms. Trace:
I20260709 12:27:10.032498 22218 rpcz_store.cc:276] 0709 12:27:09.025013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.025131 (+   118us) service_pool.cc:224] Handling call
0709 12:27:09.025422 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.424750 (+399328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.424795 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:09.424835 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:09.424870 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.031929 (+607059us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400345b54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:10.031974 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:10.032074 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917917568}
I20260709 12:27:10.028134 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:09.961031 24716 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.043634 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:10.022400 24557 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.494452 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:10.497906 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:10.495069 24596 consensus_queue.cc:1059] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:27:10.499552 22734 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:10.070132 22144 raft_consensus.cc:1240] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:10.485000 22138 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.316119 22211 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
W20260709 12:27:10.259897 24722 consensus_meta.cc:287] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.004s
I20260709 12:27:10.016340 24639 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:10.453482 24752 consensus_meta.cc:287] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.002s
I20260709 12:27:10.162698 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:10.364265 22217 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 8.
I20260709 12:27:10.155519 22146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56596 (request call id 591) took 2635 ms. Trace:
I20260709 12:27:10.154661 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:10.514657 22146 rpcz_store.cc:276] 0709 12:27:07.520341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.752093 (+1231752us) service_pool.cc:224] Handling call
0709 12:27:09.683132 (+931039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.686605 (+  3473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.155290 (+468685us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54002f30d0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:27:10.155452 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140273408}
I20260709 12:27:10.493191 22143 raft_consensus.cc:1240] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:10.199870 22111 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:10.515568 22137 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:27:10.515843 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 316046us
W20260709 12:27:10.494484 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 468576us
W20260709 12:27:10.516781 22185 leader_election.cc:336] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.517163 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.494676 24743 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.048328 24575 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 9 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:10.508986 22702 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 126 similar messages]
I20260709 12:27:10.191589 24654 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.490568 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:10.500365 24557 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.516534 22111 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:10.505290 22701 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:10.521644 22185 leader_election.cc:336] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.518523 21965 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 4 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:10.500381 24626 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:10.499568 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:10.534153 22146 raft_consensus.cc:1275] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:10.518898 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:10.504778 24732 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:10.514846 24722 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.538493 22145 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:10.510923 24639 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.531379 24748 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:10.541467 22142 raft_consensus.cc:1240] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:10.543489 22735 raft_consensus.cc:1240] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Rejecting Update request from peer be238c1de63840f9bb041e2f9ba58d2b for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:27:10.530803 24761 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:10.535818 22185 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.538852 24649 raft_consensus.cc:2804] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:10.534999 24557 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:10.559960 22185 leader_election.cc:336] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.560441 22185 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.562182 22138 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:10.564008 21965 catalog_manager.cc:5697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.565896 22137 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 9.
I20260709 12:27:10.567109 22143 raft_consensus.cc:1240] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 7. Current term is 9. Ops: []
I20260709 12:27:10.548028 24639 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:10.569836 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.570461 22185 leader_election.cc:336] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.570837 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.539077 24749 consensus_queue.cc:1059] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:27:10.574774 22185 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.578693 22185 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.579093 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:10.580085 22185 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.559255 24761 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:10.573614 24674 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.583877 21966 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48096 (request call id 303) took 10821 ms. Trace:
I20260709 12:27:10.584041 24674 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.547821 24732 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.586444 24732 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:10.586920 24761 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.541831 24626 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.565282 24743 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:10.571439 24649 raft_consensus.cc:697] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:10.591710 24649 consensus_queue.cc:237] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:10.593288 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.577394 21965 catalog_manager.cc:5697] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 4, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:10.614735 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 103501us
I20260709 12:27:10.614852 21965 catalog_manager.cc:5697] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 3 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
W20260709 12:27:10.618077 22185 leader_election.cc:336] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.615875 22036 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:10.615567 24648 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:10.619650 24766 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:10.619745 24648 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.620304 24766 raft_consensus.cc:697] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:10.621222 24766 consensus_queue.cc:237] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:10.621717 24716 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:10.621951 24648 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:10.622910 24716 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.623973 24716 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:10.624369 24716 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.625573 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.575466 24578 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.616676 21965 catalog_manager.cc:5697] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.626776 22036 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:10.631568 22036 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:10.627336 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 121674us
W20260709 12:27:10.626613 22185 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.634788 22036 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.632007 21965 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.584247 21966 rpcz_store.cc:276] 0709 12:26:59.762759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.763016 (+   257us) service_pool.cc:224] Handling call
0709 12:27:10.583817 (+10820801us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:05.028277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:05.032469 (+  4192us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:05.032511 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:27:05.032524 (+    13us) tablet.cc:662] Decoding operations
0709 12:27:05.076319 (+ 43795us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:05.100778 (+ 24459us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:05.100818 (+    40us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:27:05.215283 (+114465us) tablet.cc:701] Row locks acquired
0709 12:27:05.215361 (+    78us) write_op.cc:260] PREPARE: finished
0709 12:27:05.215562 (+   201us) write_op.cc:270] Start()
0709 12:27:05.215733 (+   171us) write_op.cc:276] Timestamp: P: 1783600025215484 usec, L: 0
0709 12:27:05.215759 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:27:05.218435 (+  2676us) log.cc:844] Serialized 8386 byte log entry
0709 12:27:07.024425 (+1805990us) op_driver.cc:464] REPLICATION: finished
0709 12:27:07.315339 (+290914us) write_op.cc:301] APPLY: starting
0709 12:27:07.315481 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:07.315909 (+   428us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:07.323706 (+  7797us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:07.411122 (+ 87416us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:07.411526 (+   404us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:27:07.411568 (+    42us) write_op.cc:312] APPLY: finished
0709 12:27:07.412048 (+   480us) log.cc:844] Serialized 145 byte log entry
0709 12:27:08.843413 (+1431365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:08.843678 (+   265us) write_op.cc:454] Released schema lock
0709 12:27:08.843768 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:08.844226 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:08.844270 (+    44us) write_op.cc:454] Released schema lock
0709 12:27:08.904731 (+ 60461us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
Metrics: {"mutex_wait_us":1341845,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":244319,"apply.run_cpu_time_us":47430,"apply.run_wall_time_us":1539520,"num_ops":21,"prepare.queue_time_us":368241,"prepare.run_cpu_time_us":25372,"prepare.run_wall_time_us":252592,"raft.queue_time_us":1189526,"raft.run_cpu_time_us":70124,"raft.run_wall_time_us":340649,"replication_time_us":1740290,"spinlock_wait_cycles":252338560,"thread_start_us":2104016,"threads_started":5,"wal-append.queue_time_us":1263141,"wal-append.run_cpu_time_us":67189,"wal-append.run_wall_time_us":3353389}]]}
W20260709 12:27:10.640450 22185 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.647039 22185 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.647646 22185 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.633466 24599 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:27:10.653432 22185 leader_election.cc:336] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.654314 22185 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:10.656239 22185 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.657094 22185 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.657915 22185 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.660880 22185 leader_election.cc:336] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.661842 22185 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.667151 22185 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.667755 22185 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.678038 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 161573us
W20260709 12:27:10.669661 22185 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.679708 22185 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.680151 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.656369 24766 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:10.678171 24722 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:10.680891 24766 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:10.681555 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 172581us
W20260709 12:27:10.681764 24763 log.cc:927] Time spent T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:27:10.681811 24766 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.686025 24626 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:10.686657 24626 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:10.688437 24573 raft_consensus.cc:3055] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:10.689682 24575 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.688899 24573 raft_consensus.cc:740] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:10.690776 24722 consensus_queue.cc:1048] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:10.691507 24573 consensus_queue.cc:260] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.695551 24750 raft_consensus.cc:3055] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:10.695987 24750 raft_consensus.cc:740] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:10.654855 24765 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.697476 24765 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.697063 24750 consensus_queue.cc:260] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.655586 24578 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.697907 24765 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.680855 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:10.718995 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:10.725148 22185 leader_election.cc:336] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.725780 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.726703 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:10.731014 22702 leader_election.cc:336] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.732200 22702 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:10.736984 22185 leader_election.cc:336] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:10.726830 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 191133us
I20260709 12:27:10.728080 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.693089 24573 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:10.728555 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 95912.8us
I20260709 12:27:10.729179 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.722425 24722 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.738503 22185 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.739295 22138 raft_consensus.cc:2393] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:10.706382 24764 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.761132 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:10.706137 24654 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:10.717695 24575 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:10.726716 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 91994.1us
I20260709 12:27:10.771225 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.765533 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:10.745841 22035 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:10.697064 24766 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.729995 24750 raft_consensus.cc:3060] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.786870 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:10.784036 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.788146 22142 raft_consensus.cc:2410] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:27:10.784102 24575 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.792618 24766 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:10.792655 24575 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:10.798694 24772 consensus_queue.cc:1059] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:10.810504 24707 raft_consensus.cc:3055] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:10.811096 24707 raft_consensus.cc:740] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:10.814074 24743 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.814795 24743 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:10.740303 24674 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:10.818078 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 72284.3us
I20260709 12:27:10.725562 24626 consensus_queue.cc:1059] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:27:10.820302 22035 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:10.821278 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 50171.8us
I20260709 12:27:10.758803 24642 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.812187 24707 consensus_queue.cc:260] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.729830 24648 consensus_queue.cc:1059] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:27:10.759315 24722 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:10.773030 24578 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.837517 24750 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:10.835880 24767 log.cc:927] Time spent T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:27:10.857287 22035 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:10.834465 24599 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:10.855189 22185 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:10.839630 24722 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.873047 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.888908 22035 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.849877 24771 raft_consensus.cc:3055] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:10.898746 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.899413 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.900105 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.900780 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.901316 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.901950 22144 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:10.902923 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.909274 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:10.916491 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.915800 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.919986 22146 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:27:10.920032 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:10.893095 24752 raft_consensus.cc:2804] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.905854 24771 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
W20260709 12:27:10.931262 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 162286us
I20260709 12:27:10.912039 24750 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:10.934762 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:10.941226 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:10.942301 22212 raft_consensus.cc:2410] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:10.917691 24774 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:10.908516 24716 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.930352 24743 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:10.924049 24752 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:10.921579 22216 raft_consensus.cc:1240] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:27:10.937706 24748 raft_consensus.cc:3055] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:10.947705 24750 raft_consensus.cc:697] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:10.932159 24761 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:10.951406 24781 consensus_queue.cc:1059] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:27:10.943683 24649 consensus_queue.cc:1059] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:27:10.947032 24749 consensus_queue.cc:1059] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:27:10.983453 24750 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.959766 24752 raft_consensus.cc:3060] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.991482 24392 consensus_queue.cc:1059] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:10.993479 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:10.993569 24771 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:10.994922 24771 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.995692 22138 raft_consensus.cc:1240] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:10.971598 24707 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:11.001889 24749 raft_consensus.cc:3055] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:11.002314 24749 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:11.003185 24749 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.004415 24749 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.962931 24743 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.005566 24743 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.006203 24732 raft_consensus.cc:3055] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:11.006587 24732 raft_consensus.cc:740] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:11.007427 24732 consensus_queue.cc:260] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:10.973205 24557 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.008695 24732 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.954998 24748 raft_consensus.cc:740] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:11.009305 22702 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:11.009815 24748 consensus_queue.cc:260] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.011173 24748 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.011890 24557 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:11.014060 24589 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:11.014648 24589 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.993033 24392 raft_consensus.cc:3055] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:11.015555 24392 raft_consensus.cc:740] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:11.016772 24392 consensus_queue.cc:260] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:11.020355 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.020920 24765 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.023216 24765 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:10.988791 22184 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:10.949301 24599 raft_consensus.cc:697] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:10.999392 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:11.000721 24781 raft_consensus.cc:3055] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:11.007891 24743 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:11.015106 24589 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.999223 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:11.034619 24761 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:11.040324 24752 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.027720 24392 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:10.979024 24639 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.025684 22184 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.026649 24648 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:11.061694 24648 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:11.062146 24648 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.063061 24639 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.066067 22184 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:11.025547 22185 leader_election.cc:336] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.074586 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.075415 24674 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:11.075804 24674 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:11.076181 24674 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:11.081382 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 84782.5us
I20260709 12:27:11.028757 24716 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.027101 24781 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:11.090456 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:11.030018 24599 consensus_queue.cc:237] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.070927 24589 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.071748 24648 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.109256 24648 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.072956 24743 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:11.113140 24589 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:11.113932 22736 raft_consensus.cc:2393] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:11.082401 24639 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.126204 24781 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.128994 24781 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.024911 22212 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
W20260709 12:27:11.212373 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 321789us
I20260709 12:27:11.225476 24743 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:11.226294 24793 log.cc:927] Time spent T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:27:11.226646 24743 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.096601 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:11.227757 22035 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:11.228847 22216 raft_consensus.cc:2393] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:11.114248 24722 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.231412 24791 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:11.232919 24791 raft_consensus.cc:697] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:27:11.175458 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.179541 24752 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.198778 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:11.203855 22701 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:11.211167 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:27:11.220125 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 350764us
I20260709 12:27:11.222787 22184 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.235942 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:11.234572 24791 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.246245 24743 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:11.260881 22143 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.232937 24722 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.262300 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:11.262930 24573 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.264766 24639 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:11.262473 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 59016.5us
I20260709 12:27:11.237218 22137 raft_consensus.cc:1240] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:11.274323 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 51843.8us
W20260709 12:27:11.284206 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.280570 22211 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.280097 22035 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.255308 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.289430 22184 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.291925 24575 raft_consensus.cc:2804] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:11.292773 24575 raft_consensus.cc:697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:11.299130 24575 consensus_queue.cc:237] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.300169 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.302569 24639 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.311925 24766 consensus_queue.cc:1059] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:11.312811 24789 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:11.313702 24766 raft_consensus.cc:3055] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:11.314240 24766 raft_consensus.cc:740] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:11.315397 24766 consensus_queue.cc:260] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.284979 24674 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.320556 22184 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.331097 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:11.340384 22211 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:11.347199 22036 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:11.349936 24732 consensus_queue.cc:1059] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:11.358572 24732 raft_consensus.cc:3055] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:11.362464 24639 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.362743 24732 raft_consensus.cc:740] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:11.365895 24765 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:11.366505 24765 raft_consensus.cc:697] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:11.367611 24765 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.368367 22036 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:11.369714 24596 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:11.364792 24732 consensus_queue.cc:260] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:11.370132 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 57029.2us
I20260709 12:27:11.370343 24596 raft_consensus.cc:697] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:11.371179 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.371587 24732 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.371937 24639 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:11.372835 22036 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:11.371946 24596 consensus_queue.cc:237] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:11.377236 22185 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.377596 24575 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:11.378243 24575 raft_consensus.cc:697] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 8 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:11.379596 24575 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.381662 24648 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:11.382112 24648 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.382517 24648 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.399394 24722 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:11.400409 24722 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.402997 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:11.403363 24722 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:11.409936 22035 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:11.411576 24775 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:11.412335 24775 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 9 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:11.400916 22184 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.414309 24674 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:11.415122 24775 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.416693 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:11.414299 24766 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.426185 22735 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 9.
W20260709 12:27:11.425966 22185 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:11.429044 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 71794.4us
W20260709 12:27:11.441107 22185 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.445658 22701 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:11.447887 24743 raft_consensus.cc:2764] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:27:11.448513 24573 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.451100 22211 raft_consensus.cc:1240] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:11.458671 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:11.462178 22215 raft_consensus.cc:1240] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:11.464591 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:11.482352 22220 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.427934 24648 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:11.479470 22185 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.487049 22143 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 8.
I20260709 12:27:11.487861 22142 raft_consensus.cc:1275] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:11.502454 24765 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.505237 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:11.505038 24765 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.506053 22146 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.524454 24648 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:11.525391 24797 log.cc:927] Time spent T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.233s	user 0.000s	sys 0.005s
W20260709 12:27:11.532334 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.532522 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:11.533418 24596 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.534052 24596 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.534427 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:11.535737 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.536116 24790 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:11.536918 24790 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.537405 24575 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:11.538230 24575 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.539781 24790 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:11.541548 22185 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.546826 24575 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.549475 24392 consensus_queue.cc:1048] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:11.503242 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:27:11.562922 24800 log.cc:927] Time spent T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.003s
I20260709 12:27:11.563303 24727 consensus_queue.cc:1059] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:11.565702 24781 raft_consensus.cc:3055] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:11.566246 24781 raft_consensus.cc:740] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:11.567488 24781 consensus_queue.cc:260] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.568585 22144 raft_consensus.cc:1240] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:11.569507 24789 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.569690 24781 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.570159 24789 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.572436 24789 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:11.573623 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.575067 24790 consensus_queue.cc:1059] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:27:11.576133 22702 leader_election.cc:336] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.576001 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.577580 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:11.578323 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:11.583300 24596 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.583535 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:11.591599 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:11.597451 24771 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:11.598328 24771 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.600782 24771 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:11.515363 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 114579us
I20260709 12:27:11.596832 22111 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.610363 22146 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:11.614049 22220 raft_consensus.cc:2468] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 8.
W20260709 12:27:11.622090 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.624577 22735 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:11.576153 24790 raft_consensus.cc:3055] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:11.633898 22035 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:11.627820 24790 raft_consensus.cc:740] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:27:11.639745 22702 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.641427 22137 raft_consensus.cc:3055] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:11.642527 22137 raft_consensus.cc:740] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:11.632503 24771 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:11.641554 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.648389 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.652769 24639 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.650137 24752 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:11.673771 24557 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:11.660199 24766 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:11.673125 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44430.2us
I20260709 12:27:11.682504 24775 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.683399 24775 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.684954 24766 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:11.689321 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 60587.7us
I20260709 12:27:11.676828 24765 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.674968 24752 raft_consensus.cc:697] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:11.699131 24790 consensus_queue.cc:260] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.700277 22184 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:11.705744 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 76870.5us
W20260709 12:27:11.708379 22702 leader_election.cc:336] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.708854 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.711838 24727 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.714035 22184 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.715312 24648 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.714059 24790 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:11.716218 24648 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.724084 24752 consensus_queue.cc:237] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.730909 24775 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.736732 22184 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:11.738046 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 57958.6us
I20260709 12:27:11.744442 22729 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:11.744684 22138 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0"
dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59926
I20260709 12:27:11.745582 22138 raft_consensus.cc:606] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 12:27:11.746009 22138 raft_consensus.cc:614] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:11.746928 24639 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.747061 22184 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.748574 22184 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:11.754395 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 46049.3us
I20260709 12:27:11.756417 24791 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.759125 24648 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.759747 24791 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.759933 21963 catalog_manager.cc:5697] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:11.762177 24791 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.764036 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:11.763983 22137 consensus_queue.cc:260] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.764945 22146 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 8: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:11.765375 22137 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.766880 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:11.767504 24768 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.752384 24775 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.763542 21963 catalog_manager.cc:5697] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 4 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:11.754374 24743 raft_consensus.cc:2749] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.768211 24775 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.775543 24775 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:11.768208 24768 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.754525 24766 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.774350 21963 catalog_manager.cc:5697] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
W20260709 12:27:11.781138 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 77572.9us
W20260709 12:27:11.784085 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:11.786188 22702 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.791381 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:11.796162 22017 auto_rebalancer.cc:893] Removing replace marker failed: Replica 85f0d4cf04de40aa9e25849fb2380466 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:11.797657 22017 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:27:11.797945 22017 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:27:11.802227 22184 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.790647 24768 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.808290 24639 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:11.809152 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.810165 24771 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.798727 22141 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 4.
I20260709 12:27:11.814242 22035 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:11.814342 24743 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:11.815191 22184 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.815428 24750 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:11.815905 24750 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.816216 24743 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:11.816314 24750 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:11.821369 22184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.826426 22145 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:11.826615 22036 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:11.828456 22702 leader_election.cc:336] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.832667 24813 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.839228 24813 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:11.840212 24766 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:11.841774 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.843730 24813 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:11.846776 24768 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:11.847543 24790 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.847582 22036 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.849026 22145 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:11.838213 21963 catalog_manager.cc:5697] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 5 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.854549 22036 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.855716 21965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48106 (request call id 275) took 10560 ms. Trace:
I20260709 12:27:11.858552 24766 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:11.866250 24813 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:11.857892 24775 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.886504 22215 raft_consensus.cc:1275] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:27:11.884317 22702 leader_election.cc:336] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:11.890079 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:11.891665 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.893561 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.895254 22137 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:27:11.902287 22145 raft_consensus.cc:3055] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:11.902721 22145 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:11.903617 22145 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.900718 22137 pending_rounds.cc:85] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 3
W20260709 12:27:11.912364 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 74627.4us
I20260709 12:27:11.912631 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.909514 22137 pending_rounds.cc:107] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:27:11.915505 22137 raft_consensus.cc:2889] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.916293 22145 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.916587 22732 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:11.918709 24750 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:11.919371 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.909049 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.921452 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:11.921660 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:11.922015 22139 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:11.922247 22215 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.924578 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.910442 24781 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:11.925400 22732 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 8: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:11.886518 21963 catalog_manager.cc:5697] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 4 to 6, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 6 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:11.930120 24812 log.cc:927] Time spent T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:27:11.925529 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:11.935153 24771 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.935935 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:11.935081 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 75655.1us
I20260709 12:27:11.936619 22145 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:27:11.940752 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.937042 22145 pending_rounds.cc:85] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 4
I20260709 12:27:11.942685 22145 pending_rounds.cc:107] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:27:11.942960 22145 raft_consensus.cc:2889] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.936730 24768 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:27:11.944218 20873 tablet_replica.cc:333] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:11.945276 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.945729 20873 raft_consensus.cc:2243] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Raft consensus shutting down.
W20260709 12:27:11.950884 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.953979 20873 raft_consensus.cc:2272] T 93141c9281524e9aaffe4907f7e32041 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.955587 22139 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:11.957013 22035 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:11.963974 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:11.971702 22215 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:11.972326 22220 raft_consensus.cc:1240] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:11.974140 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 48817.9us
I20260709 12:27:11.973789 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:11.856149 21965 rpcz_store.cc:276] 0709 12:27:01.294988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.297557 (+  2569us) service_pool.cc:224] Handling call
0709 12:27:11.855468 (+10557911us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:10.920791 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:10.970451 (+ 49660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:10.970490 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:27:10.970511 (+    21us) tablet.cc:662] Decoding operations
0709 12:27:10.971412 (+   901us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:10.971495 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:10.971525 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:27:10.972103 (+   578us) tablet.cc:701] Row locks acquired
0709 12:27:10.972123 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:27:10.972267 (+   144us) write_op.cc:270] Start()
0709 12:27:10.972398 (+   131us) write_op.cc:276] Timestamp: P: 1783600030972220 usec, L: 0
0709 12:27:10.972420 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:27:10.973104 (+   684us) log.cc:844] Serialized 2506 byte log entry
0709 12:27:11.132226 (+159122us) op_driver.cc:464] REPLICATION: finished
0709 12:27:11.490296 (+358070us) write_op.cc:301] APPLY: starting
0709 12:27:11.490493 (+   197us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:11.490779 (+   286us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:11.490952 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:11.590097 (+ 99145us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:11.590439 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:27:11.590482 (+    43us) write_op.cc:312] APPLY: finished
0709 12:27:11.590913 (+   431us) log.cc:844] Serialized 53 byte log entry
0709 12:27:11.592240 (+  1327us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:11.592455 (+   215us) write_op.cc:454] Released schema lock
0709 12:27:11.592525 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:11.593099 (+   574us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:11.593130 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1672232,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":346929,"apply.run_cpu_time_us":7767,"apply.run_wall_time_us":102839,"num_ops":6,"prepare.queue_time_us":190443,"prepare.run_cpu_time_us":35953,"prepare.run_wall_time_us":220006,"raft.queue_time_us":1083,"raft.run_cpu_time_us":58012,"raft.run_wall_time_us":333642,"replication_time_us":159636,"thread_start_us":437539,"threads_started":4,"wal-append.queue_time_us":147710}]]}
I20260709 12:27:11.967188 24766 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:12.015856 22141 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:12.016902 22139 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:12.024933 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.026175 21963 catalog_manager.cc:5697] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:12.032757 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:12.033814 22211 raft_consensus.cc:2393] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 4: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:12.037701 24771 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.047869 22139 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:27:12.048246 22139 pending_rounds.cc:85] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 4
I20260709 12:27:12.050969 22139 pending_rounds.cc:107] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:27:12.046151 20873 tablet_replica.cc:333] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:12.051245 22139 raft_consensus.cc:2889] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:12.021426 24766 raft_consensus.cc:697] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:12.057510 22702 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:12.062146 24810 log.cc:927] Time spent T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:27:12.066694 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:12.068478 24722 raft_consensus.cc:2764] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:12.073472 22111 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:12.055653 21963 catalog_manager.cc:5697] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 4 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.083745 22036 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.085875 24781 raft_consensus.cc:2804] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:12.086727 24781 raft_consensus.cc:697] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 8 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:12.088205 24781 consensus_queue.cc:237] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.097695 24392 consensus_queue.cc:1059] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:12.100883 22732 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:12.100802 24392 raft_consensus.cc:3055] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:12.101464 24392 raft_consensus.cc:740] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:12.069407 24722 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:27:12.103853 24766 consensus_queue.cc:237] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:12.102443 24392 consensus_queue.cc:260] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.118646 22036 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:12.119747 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 74756.5us
I20260709 12:27:12.100519 21963 catalog_manager.cc:5697] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.120116 22036 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:12.127745 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 58627.7us
I20260709 12:27:12.054334 24768 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:27:12.136622 24771 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.110351 20873 raft_consensus.cc:2243] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:12.150343 22111 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:12.147989 21963 catalog_manager.cc:5697] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.145910 24790 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.137406 24557 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.171983 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:12.173435 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 75332.6us
I20260709 12:27:12.177670 24750 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:12.180758 24392 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.150292 24789 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:12.129532 24575 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:27:12.209704 22212 raft_consensus.cc:1275] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:12.149375 24765 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:27:12.169224 24722 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:12.166906 24775 raft_consensus.cc:3060] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:12.166473 24771 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.204749 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:12.206032 22217 raft_consensus.cc:1240] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:12.206490 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:12.207644 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:12.207818 22702 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:12.209242 24557 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:12.215270 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.229599 20873 raft_consensus.cc:2272] T 0f24f68619f14d9e9de4306dd59b5709 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:12.239312 22217 raft_consensus.cc:1240] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:12.240242 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:12.241845 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.242535 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:12.244477 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:12.245316 22218 raft_consensus.cc:2393] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 in current term 8: Already voted for candidate ed678a3f9e3d4e0ba5801f1663548796 in this term.
I20260709 12:27:12.238315 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99368f219dd84b6994a569b62a8579d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:12.249473 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 120905us
I20260709 12:27:12.240386 21963 catalog_manager.cc:5697] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 9, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 9 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.261407 24774 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:27:12.271487 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:12.264531 21963 catalog_manager.cc:5697] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 4, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.280308 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:12.281140 22216 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 3.
I20260709 12:27:12.282346 20873 tablet_replica.cc:333] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:12.283322 24557 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:12.286724 24771 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:12.287376 24771 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:12.287876 24771 raft_consensus.cc:697] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:12.292239 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:12.277344 24575 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:12.294080 22216 raft_consensus.cc:2393] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 5: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:12.293853 24575 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.294567 22217 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:12.295379 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:12.295928 22216 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:12.296216 22213 raft_consensus.cc:1275] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:12.296795 24575 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:12.311158 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:12.297573 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:12.297520 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:12.304941 21963 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.293859 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:12.306949 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.323151 21963 catalog_manager.cc:5697] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 5 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:12.283346 20873 raft_consensus.cc:2243] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:12.308389 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:12.297963 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:12.316668 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:12.315985 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.330084 22111 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.325227 20873 raft_consensus.cc:2272] T e5f28925d2fc4ec39e677a2be96ca259 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:12.288986 24771 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.303182 22214 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:27:12.312407 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:12.348099 21963 catalog_manager.cc:5697] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 4, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 4 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:12.352383 22734 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:12.345357 20873 tablet_replica.cc:333] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
W20260709 12:27:12.358708 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 213080us
W20260709 12:27:12.357694 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 167886us
I20260709 12:27:12.380028 22732 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:12.381788 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:12.359781 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 239710us
I20260709 12:27:12.360533 22216 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:12.324268 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:12.385483 24766 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:12.388263 24822 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:12.394105 22137 raft_consensus.cc:1275] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:12.371455 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:12.375842 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:12.397092 22035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.397483 22139 raft_consensus.cc:1275] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:12.368461 21963 catalog_manager.cc:5697] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 5 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:12.402493 22212 raft_consensus.cc:2393] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 8: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
W20260709 12:27:12.401878 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.364172 24775 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.369043 24639 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.440666 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.442855 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:12.440913 24639 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.454106 24639 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:12.461153 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 52785.2us
I20260709 12:27:12.462749 20873 raft_consensus.cc:2243] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:12.466451 22139 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:12.469369 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 46490.7us
I20260709 12:27:12.469658 21963 catalog_manager.cc:5697] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 6, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 6 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:12.471673 24575 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:12.471740 21963 catalog_manager.cc:5697] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.422549 24829 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:12.475853 24648 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:12.491032 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 133099us
I20260709 12:27:12.497139 21963 catalog_manager.cc:5697] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 4, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:12.506237 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.478627 24722 raft_consensus.cc:697] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
W20260709 12:27:12.520849 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.523685 20873 raft_consensus.cc:2272] T 7a5597e9e8004903a03d0ac57b864069 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:12.485589 24765 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:27:12.530887 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:12.531970 21963 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:12.537091 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 212900us
I20260709 12:27:12.537700 22036 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.528573 24790 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.554028 20873 tablet_replica.cc:333] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:12.516558 24829 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:12.536969 22111 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:12.542052 24599 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:27:12.542928 24824 consensus_queue.cc:1048] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:27:12.555123 20873 raft_consensus.cc:2243] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:12.563084 22184 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.564112 24648 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:12.564534 24648 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:12.564754 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:12.564980 24648 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.565786 24639 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:12.566676 24790 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.567219 24790 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.570366 24790 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:12.571316 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:12.570014 22184 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:12.590737 20873 raft_consensus.cc:2272] T 522ffe0721f94fd69f4df0687f606515 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:12.610980 22734 raft_consensus.cc:1240] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:27:12.573029 24752 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:12.554752 24722 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:12.629765 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 59815.8us
I20260709 12:27:12.630716 22184 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:12.632328 22184 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.605530 24822 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.633798 24849 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.633665 24822 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:12.634367 24835 log.cc:927] Time spent T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:27:12.634627 24849 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.635411 24849 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:12.635795 24849 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:12.635946 24822 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:12.636179 24849 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:12.637499 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.637662 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:12.638262 22734 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
W20260709 12:27:12.639889 24842 log.cc:927] Time spent T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:27:12.641438 20873 tablet_replica.cc:333] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:12.642271 20873 raft_consensus.cc:2243] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:27:12.649488 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 119651us
W20260709 12:27:12.650368 22111 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:12.650794 22111 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:12.655073 22702 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:12.609640 24829 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:12.639740 22184 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:12.681448 24752 raft_consensus.cc:697] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:12.682138 24841 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.682677 24752 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:12.683506 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 43856.3us
W20260709 12:27:12.686793 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 96444.3us
I20260709 12:27:12.688794 22036 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:12.712663 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.649041 24848 log.cc:927] Time spent T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:27:12.723670 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 57963.3us
W20260709 12:27:12.724752 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.734357 22036 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.735599 22036 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:12.729096 24829 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.742220 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:12.731086 24599 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.749722 22036 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.726401 24648 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.757056 22734 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
I20260709 12:27:12.742501 24768 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.754841 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.728786 24849 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:12.763022 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 112714us
I20260709 12:27:12.743693 24752 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.764984 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:12.775683 22734 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:12.766248 24849 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:12.738631 24750 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:27:12.782720 22036 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.784065 22734 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:12.791947 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:12.792114 22111 leader_election.cc:336] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:12.794178 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:12.817512 22111 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:12.837369 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:12.794553 24599 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:12.868446 22036 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.851413 24813 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.874035 24827 consensus_queue.cc:1048] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:27:12.874611 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:12.875026 24824 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.875864 24824 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:12.877007 22216 raft_consensus.cc:1240] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:12.877964 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.873912 24826 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.784833 24765 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:27:12.878942 24826 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:12.881331 24826 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:12.881451 22036 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:12.882323 24826 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:12.840152 24853 log.cc:927] Time spent T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:27:12.873884 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:12.888028 24648 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:12.761531 24790 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:12.837850 24768 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:12.874101 24775 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:12.896474 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 72809.5us
I20260709 12:27:12.834728 24766 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.838754 24752 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:27:12.903040 22185 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:12.929416 22216 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:12.934918 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c387a77990f741e2ae187b3f92c6d472" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:12.935510 22218 raft_consensus.cc:1275] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:27:12.942854 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.901386 24813 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:12.960443 22212 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:12.974319 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 210561us
I20260709 12:27:12.974866 22701 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:12.975473 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 48724.4us
I20260709 12:27:13.018307 22215 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:12.983640 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:13.021919 22111 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.026464 22036 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:13.050397 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:13.052944 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:13.056511 24862 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:13.057232 24862 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.059592 24862 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.060096 24854 consensus_queue.cc:1059] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
W20260709 12:27:13.061776 24857 log.cc:927] Time spent T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:27:13.061790 24859 raft_consensus.cc:3055] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:13.062537 24859 raft_consensus.cc:740] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:13.063529 24859 consensus_queue.cc:260] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:13.064321 24861 log.cc:927] Time spent T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:27:13.066423 24859 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.073283 24766 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:13.076082 24866 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:13.076686 24866 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.077057 24866 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:13.093570 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.093825 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 65266us
I20260709 12:27:13.094937 24836 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:13.096153 24790 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:13.098294 24858 log.cc:927] Time spent T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 12:27:13.101063 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 89300.6us
I20260709 12:27:13.128510 20873 raft_consensus.cc:2272] T 5e3e126e4f1f4d82991ffddf4599b103 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.050587 24599 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:27:13.050820 24791 consensus_queue.cc:1048] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:27:13.112006 24648 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:13.157244 22111 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.161721 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:13.167589 24648 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.191567 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:13.178365 24843 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:13.193929 24829 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:13.216461 24648 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.222365 20873 tablet_replica.cc:333] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:13.223318 20873 raft_consensus.cc:2243] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.224092 20873 raft_consensus.cc:2272] T f84b376f41e049819a74ea69b90cd298 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:13.225819 24867 log.cc:927] Time spent T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:27:13.230408 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.230870 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.200881 24851 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:13.236303 22138 raft_consensus.cc:1275] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:27:13.099810 24832 consensus_queue.cc:1175] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "85f0d4cf04de40aa9e25849fb2380466" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 12:27:13.095630 24836 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.275573 22737 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:13.298676 22211 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:13.309875 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:13.311944 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 63140.8us
I20260709 12:27:13.314678 24836 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.314915 20873 tablet_replica.cc:333] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:13.316043 20873 raft_consensus.cc:2243] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.316784 20873 raft_consensus.cc:2272] T 66ecbcd398b0449b86b36309434ca3d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.326948 24775 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:13.330451 24599 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:13.339830 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:13.345569 24750 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:13.355427 24765 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:13.369989 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.372825 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.362450 24888 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:13.409893 24765 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.441016 24765 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.402999 24750 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.441890 24750 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:13.444113 24750 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:13.444999 24832 consensus_queue.cc:1048] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:13.445442 20873 tablet_replica.cc:333] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:13.446367 20873 raft_consensus.cc:2243] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.446475 24880 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:13.447247 20873 pending_rounds.cc:70] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: Trying to abort 1 pending ops.
W20260709 12:27:13.447422 24864 log.cc:927] Time spent T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.608s	user 0.004s	sys 0.000s
I20260709 12:27:13.447147 24880 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.447593 20873 pending_rounds.cc:77] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7: Aborting op as it isn't in flight: id { term: 3 index: 6 } timestamp: 7305625648136830976 op_type: NO_OP noop_request { }
I20260709 12:27:13.448014 20873 raft_consensus.cc:2889] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:13.448391 20873 raft_consensus.cc:2272] T 1fec8474cec64acca2f6f9303db0b0af P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.449306 24648 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:13.449889 24648 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:13.451336 24866 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.451848 24648 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:13.452354 24648 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:13.452762 24648 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:13.495296 24845 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:13.523376 24880 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.609491 24880 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:13.610124 24880 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:13.611770 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 477720us
I20260709 12:27:13.630308 24889 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.630941 24889 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.633677 24889 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:13.647130 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.634299 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:13.690115 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.688309 22111 leader_election.cc:336] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.691502 22111 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:13.693351 24900 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:13.693435 24648 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:13.688822 24880 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:13.650864 24866 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.725597 20873 tablet_replica.cc:333] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:13.726517 20873 raft_consensus.cc:2243] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.607569 24845 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.728844 24845 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.708614 24880 raft_consensus.cc:493] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:13.713902 24841 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:13.714695 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.716187 24813 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.731721 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:13.703958 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.752596 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 735429us
I20260709 12:27:13.752526 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:13.755517 22217 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
W20260709 12:27:13.754478 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:13.790634 22111 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.796459 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:13.797326 22736 raft_consensus.cc:2393] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 5: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:13.800177 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:13.801033 24887 log.cc:927] Time spent T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.379s	user 0.000s	sys 0.003s
W20260709 12:27:13.803769 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 199506us
I20260709 12:27:13.810142 22138 raft_consensus.cc:1275] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:13.826810 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:13.827945 22138 raft_consensus.cc:2410] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:13.833323 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:13.833937 22736 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:13.840302 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 87842.5us
W20260709 12:27:13.841100 22111 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.841828 24866 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:13.842182 22111 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.842599 22111 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:13.847252 22036 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:13.848146 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:13.848763 22142 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
W20260709 12:27:13.857395 22701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.858484 20873 raft_consensus.cc:2272] T 790bdc35efb4419cb67fd1a718e2b584 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.859902 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:13.871752 22212 raft_consensus.cc:1240] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer ed678a3f9e3d4e0ba5801f1663548796 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:13.872550 22731 raft_consensus.cc:2393] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 6: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:13.878051 22734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:13.754350 24841 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:13.881223 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:13.756500 24880 raft_consensus.cc:515] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.893342 24791 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.893821 24765 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:13.894378 24765 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.893537 20873 tablet_replica.cc:333] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:13.894831 24765 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:13.894079 24791 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:13.895504 24902 log.cc:927] Time spent T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:27:13.896919 24791 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:13.873302 24869 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:13.898185 20873 raft_consensus.cc:2243] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:13.897945 24869 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:13.898715 24880 leader_election.cc:290] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.899026 20873 raft_consensus.cc:2272] T bf83ee90e33b4083aebda67b32ca1149 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:13.900202 24869 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:13.901950 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.871580 24826 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.001s	sys 0.034s
I20260709 12:27:13.842443 24866 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.833032 24845 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.903760 24845 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:13.904335 24866 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:13.878929 24843 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:13.832562 24851 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:13.902633 24826 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.001s	sys 0.034s
W20260709 12:27:13.916798 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 74673.3us
I20260709 12:27:13.918040 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:13.926189 22212 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:13.929762 24851 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.946029 22732 consensus_queue.cc:237] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:13.947430 24851 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:13.948086 22036 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:13.945307 22035 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:13.953522 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:13.958384 20873 tablet_replica.cc:333] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:13.964749 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:13.964238 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "790bdc35efb4419cb67fd1a718e2b584" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:13.923180 24766 consensus_queue.cc:1048] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 12:27:13.976850 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.976711 20873 raft_consensus.cc:2243] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:13.962625 24900 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:13.973598 24899 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:13.991782 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.010829 22736 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
W20260709 12:27:14.005267 22185 leader_election.cc:336] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.988700 24843 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:13.990685 24856 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.017467 22185 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:13.993196 24899 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.002393 24905 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.053022 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:14.051113 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:14.057422 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 115799us
I20260709 12:27:14.065071 22219 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:27:14.048768 22185 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:13.990423 24900 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.067536 22214 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:27:14.043752 24878 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:14.069010 22111 leader_election.cc:336] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.044307 24899 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:14.074339 24791 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.074507 24900 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:14.075033 24900 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:14.074945 24791 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.075537 24900 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.077415 22111 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:14.068945 24889 consensus_queue.cc:1059] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:27:14.078776 24765 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:14.079798 24911 log.cc:927] Time spent T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:27:14.079516 22111 leader_election.cc:336] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.080888 24900 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:14.078778 24889 raft_consensus.cc:3055] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:14.081619 24900 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:14.081758 24889 raft_consensus.cc:740] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:14.077114 24791 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:14.082779 24889 consensus_queue.cc:260] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.080943 24765 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:14.081050 22111 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:14.088526 24900 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:14.096697 22702 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:14.098021 24846 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:14.098564 24846 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.044669 24843 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:14.104863 22111 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.105392 22111 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:14.098281 24899 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:14.109249 24841 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:14.096237 24889 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:14.114940 24900 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.100649 24846 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:14.127777 24899 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:14.048154 24856 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.130788 24856 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:14.132187 24910 log.cc:927] Time spent T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:27:14.133008 20873 raft_consensus.cc:2272] T 34d1a2cd4888492fad01161b84e51d77 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.135864 22185 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:14.141358 22111 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.141916 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:14.146039 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 200798us
I20260709 12:27:14.146831 22035 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:14.143806 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.149533 24900 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.149245 24879 raft_consensus.cc:2804] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:14.185150 22702 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:14.186200 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 64805.7us
W20260709 12:27:14.186928 22111 leader_election.cc:336] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.187475 22111 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:14.187628 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:14.160326 22729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35008 (request call id 608) took 1292 ms. Trace:
I20260709 12:27:14.188253 22219 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:27:14.191361 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44598.1us
W20260709 12:27:14.188836 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:14.237749 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:14.234436 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 45637.6us
W20260709 12:27:14.240954 22702 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:14.186873 24854 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:14.245786 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:14.246402 22143 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:14.246541 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:14.244100 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 57225us
I20260709 12:27:14.247162 22141 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:14.280748 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:14.281375 22145 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:14.282090 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.284873 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 335906us
I20260709 12:27:14.244660 24599 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:14.278995 22111 leader_election.cc:336] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:14.283974 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:14.243093 24879 raft_consensus.cc:697] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 9 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:14.270457 24854 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.331784 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:14.294873 22111 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:14.313434 22184 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.495s (SENT)
W20260709 12:27:14.325081 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.332948 22184 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:14.336125 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:14.336869 22211 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:14.280087 24900 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:14.335675 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:14.290812 24913 log.cc:927] Time spent T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 12:27:14.293632 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:14.341681 22213 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:14.344652 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 51062.7us
W20260709 12:27:14.345582 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:14.325774 24880 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:14.379020 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:14.486346 20873 tablet_replica.cc:333] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
W20260709 12:27:14.485522 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 106576us
W20260709 12:27:14.482645 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.335882 24854 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:14.443432 22143 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 8.
I20260709 12:27:14.343267 24866 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:14.504137 20873 raft_consensus.cc:2243] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:14.500134 22702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.499758 22211 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 8.
I20260709 12:27:14.458057 24878 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:14.524441 24878 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:14.525157 24822 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.525715 24822 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.527261 24878 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:14.527755 24822 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:14.528295 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.531067 24822 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.531678 24822 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.523874 24905 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.532936 24905 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.533915 24822 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:14.534605 24932 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:14.535151 24905 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:14.536954 24839 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.537627 24839 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.540329 24839 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:14.541455 24879 consensus_queue.cc:237] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:14.521548 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 208153us
I20260709 12:27:14.422169 24933 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.545091 24845 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:14.523839 20873 raft_consensus.cc:2272] T d935d1f5ca454cf6b73d0e33d7a7f51a P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:14.483425 24918 log.cc:927] Time spent T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 12:27:14.484007 24921 log.cc:927] Time spent T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 12:27:14.484632 24916 log.cc:927] Time spent T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:27:14.535180 24932 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:14.553053 22185 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.347167 24843 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:14.533911 24925 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:27:14.507957 22145 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
W20260709 12:27:14.569059 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:14.573071 22185 leader_election.cc:336] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.575239 22185 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:14.576622 22185 leader_election.cc:336] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.577097 22185 leader_election.cc:304] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:14.574697 20873 tablet_replica.cc:333] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
W20260709 12:27:14.579702 22185 leader_election.cc:336] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.503978 24880 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:14.584600 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 306976us
W20260709 12:27:14.582707 22185 leader_election.cc:336] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:14.589243 22111 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.588279 20873 raft_consensus.cc:2243] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.589553 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:14.589571 22111 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:14.592283 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:14.593068 22145 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:27:14.605772 22185 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:14.606782 22185 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:14.626717 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:14.628274 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:14.577586 24843 raft_consensus.cc:493] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:14.581082 24866 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:14.581626 24845 raft_consensus.cc:2749] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.633255 22146 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:14.604765 24856 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.604420 24933 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.638899 20873 raft_consensus.cc:2272] T c387a77990f741e2ae187b3f92c6d472 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:14.639557 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 50335.9us
W20260709 12:27:14.641994 22111 leader_election.cc:336] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:14.613190 24878 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.651435 22036 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:14.674803 24878 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:14.675081 24879 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.675402 24878 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:14.675995 24879 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:14.675689 22036 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:14.696621 24575 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:27:14.697077 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.697254 24575 raft_consensus.cc:697] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 8 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:14.698189 24575 consensus_queue.cc:237] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:14.699251 24846 consensus_meta.cc:287] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.011s
I20260709 12:27:14.699744 24846 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.636106 24843 raft_consensus.cc:515] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:14.649724 24856 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.072383 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:15.025727 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 382225us
W20260709 12:27:15.070112 22700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.106258 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 464253us
I20260709 12:27:14.832662 22735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:15.001055 22213 consensus_meta.cc:287] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.004s
I20260709 12:27:15.110409 22213 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
W20260709 12:27:14.728602 22184 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.594s (SENT)
I20260709 12:27:15.111505 22184 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:15.045933 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.708082 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:14.832477 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:14.704576 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:14.746793 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 110493us
I20260709 12:27:14.233979 22729 rpcz_store.cc:276] 0709 12:27:12.853306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.854525 (+  1219us) service_pool.cc:224] Handling call
0709 12:27:12.876070 (+ 21545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.917403 (+ 41333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.925339 (+  7936us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.932314 (+  6975us) log.cc:844] Serialized 26 byte log entry
0709 12:27:13.722608 (+790294us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b18001a1ee0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208dee07 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e235890d1 00007f1e239a4a0f
0709 12:27:13.923706 (+201098us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:13.932037 (+  8331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.954453 (+ 22416us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.133118 (+178665us) raft_consensus.cc:1685] finished
0709 12:27:14.133145 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.145897 (+ 12752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28293,"raft.queue_time_us":42916,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":10239,"spinlock_wait_cycles":21972096,"thread_start_us":156122,"threads_started":1,"wal-append.queue_time_us":1024676}
W20260709 12:27:15.126147 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 397593us
W20260709 12:27:15.109581 22111 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.127918 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:15.129298 22111 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.131093 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:15.132570 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.673224 24822 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:15.130303 22701 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:15.141214 22702 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:14.840593 24943 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.819753 24878 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:14.823932 24880 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:14.821614 24768 raft_consensus.cc:493] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.125073 24851 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:14.747218 24933 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:14.839423 24889 consensus_meta.cc:287] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.000s
I20260709 12:27:15.134989 24869 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:15.142132 24938 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:15.157454 22036 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:15.140012 24932 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:15.156201 22184 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.713s (SENT)
I20260709 12:27:15.180817 22184 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:15.151682 22185 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.159641 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:15.160843 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:15.161428 24945 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:15.162199 24828 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:15.162220 24843 leader_election.cc:290] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:15.163025 24957 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.154857 24856 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:15.164465 24879 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:15.165087 24851 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.162477 24824 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:15.199741 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:15.167897 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:15.200409 22211 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:27:15.200587 22138 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:27:15.169842 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:15.170053 24854 consensus_meta.cc:287] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
W20260709 12:27:15.170236 24941 log.cc:927] Time spent T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.474s	user 0.020s	sys 0.026s
W20260709 12:27:15.172672 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.173568 22111 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.188570 24945 raft_consensus.cc:493] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.160846 24768 raft_consensus.cc:515] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:15.190274 22185 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.197540 22732 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:15.202762 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:15.209537 22213 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.194432 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:15.189859 24828 raft_consensus.cc:493] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.211759 22218 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:27:15.222064 22111 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.154580 24943 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.206754 24854 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.206944 24824 raft_consensus.cc:697] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Becoming Leader. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
I20260709 12:27:15.229893 22111 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:15.210146 24945 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.233428 20873 tablet_replica.cc:333] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:15.213322 24828 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.180141 24933 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:15.238300 20873 raft_consensus.cc:2243] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:15.237152 24957 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.242332 24898 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:15.246833 24851 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:15.248569 24904 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.249782 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:15.253780 20873 raft_consensus.cc:2272] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:15.253862 22185 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.256572 24824 consensus_queue.cc:237] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:15.229893 24879 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:27:15.265833 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:15.263619 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.264604 22213 raft_consensus.cc:2468] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:15.255525 24822 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.268869 24822 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:15.278913 24854 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:15.282639 22185 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:15.289633 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:15.294749 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 93196.8us
W20260709 12:27:15.299829 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 44995.7us
I20260709 12:27:15.301684 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:15.255257 24898 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.307861 22035 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:15.308226 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:15.249121 24904 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.328667 24789 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:15.332803 22184 leader_election.cc:336] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.795s (SENT)
I20260709 12:27:15.333305 22184 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:15.311633 24954 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:15.343827 22702 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:15.344949 24854 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:15.346102 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:15.346565 22214 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:15.346268 22702 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:15.330211 24822 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:15.315135 24898 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.345436 24854 raft_consensus.cc:493] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.817737 24859 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.909552 24854 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:15.523218 22702 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 137 similar messages]
I20260709 12:27:15.909687 24859 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.456115 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:15.510090 24933 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:15.374979 22214 raft_consensus.cc:2468] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:27:15.913115 22216 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:15.913313 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:15.442763 24904 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:15.425948 24957 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:15.915371 24957 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:15.425845 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 102411us
W20260709 12:27:15.908748 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 575929us
I20260709 12:27:15.415730 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:15.369449 24943 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:15.357522 24920 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.020s	sys 0.008s
I20260709 12:27:15.358741 24942 raft_consensus.cc:2804] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:15.456827 24889 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:15.919202 22142 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
W20260709 12:27:15.674388 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.929654 24920 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.551s	user 0.040s	sys 0.036s
W20260709 12:27:15.967025 24940 log.cc:927] Time spent T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 1.201s	user 0.003s	sys 0.018s
I20260709 12:27:15.967193 24942 raft_consensus.cc:697] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:15.368662 24880 raft_consensus.cc:2749] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:15.968325 24942 consensus_queue.cc:237] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:15.969012 22139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 2106) took 1731 ms. Trace:
I20260709 12:27:15.969512 22139 rpcz_store.cc:276] 0709 12:27:14.237668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.238386 (+   718us) service_pool.cc:224] Handling call
0709 12:27:14.238707 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.289766 (+ 51059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.289821 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.296051 (+  6230us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.569841 (+273790us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:14.591570 (+ 21729us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.594120 (+  2550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.594211 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.966332 (+1372121us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:27:15.968709 (+  2377us) raft_consensus.cc:1685] finished
0709 12:27:15.968810 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.968930 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2268,"prepare.queue_time_us":60911,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":195392,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6880,"spinlock_wait_cycles":14578304,"thread_start_us":238100,"threads_started":2,"wal-append.queue_time_us":291835}
I20260709 12:27:15.830530 24845 raft_consensus.cc:493] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:15.918541 24957 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:15.912003 24859 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:15.689059 24900 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:16.010525 22137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.045s	sys 0.049s
I20260709 12:27:15.591981 24768 leader_election.cc:290] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:16.016052 22137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.045s	sys 0.050s
W20260709 12:27:15.988263 24856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.011s	sys 0.016s
I20260709 12:27:15.986110 24933 raft_consensus.cc:493] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:15.969271 24889 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:16.025681 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.032600 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 113125us
I20260709 12:27:16.032760 20873 tablet_replica.cc:333] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
W20260709 12:27:16.033659 22184 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.626s (SENT)
W20260709 12:27:16.020202 24856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.011s	sys 0.016s
I20260709 12:27:16.034050 22184 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:16.012621 24957 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:16.041872 20873 raft_consensus.cc:2243] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:16.042816 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 519608us
W20260709 12:27:16.048321 22184 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.645s (SENT)
I20260709 12:27:16.048794 22184 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:16.030339 24880 raft_consensus.cc:493] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:16.023108 24943 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:27:16.018734 24845 raft_consensus.cc:515] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.019143 24900 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:16.072279 24944 log.cc:927] Time spent T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.997s	user 0.003s	sys 0.015s
I20260709 12:27:16.072706 24889 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:16.056602 24880 raft_consensus.cc:515] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.044647 24869 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.044052 24929 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:16.133149 20873 raft_consensus.cc:2272] T 8d4304a0cf75473e8fd1d5791213f0a3 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.038720 24933 raft_consensus.cc:515] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.045379 24957 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:16.230767 22144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.000s	sys 0.011s
W20260709 12:27:16.233587 22144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.000s	sys 0.012s
W20260709 12:27:16.231901 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 183595us
I20260709 12:27:16.234238 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:16.234688 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.231580 22731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.004s	sys 0.012s
W20260709 12:27:16.239056 22731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.004s	sys 0.012s
I20260709 12:27:16.234990 22702 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:16.158772 24869 raft_consensus.cc:493] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:16.240897 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:16.269776 22218 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:27:16.270448 22144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 2117) took 1003 ms. Trace:
W20260709 12:27:16.233268 24973 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:27:16.136082 24929 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:16.235742 24975 log.cc:927] Time spent T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:27:16.270939 22144 rpcz_store.cc:276] 0709 12:27:15.266877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.267417 (+   540us) service_pool.cc:224] Handling call
0709 12:27:15.267607 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.267739 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:15.421542 (+153803us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.269674 (+848132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.269818 (+   144us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:16.269976 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.270156 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.270364 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11469,"prepare.queue_time_us":29997,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":26,"thread_start_us":947647,"threads_started":2}
I20260709 12:27:16.240348 24841 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:16.236939 24856 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:16.309594 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b8db04a690435f8c84aba1b0f5ec2b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.308972 24856 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.312624 24841 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:16.284086 22146 raft_consensus.cc:1275] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:16.291090 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:16.346942 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 112045us
W20260709 12:27:16.325368 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 295788us
I20260709 12:27:16.316628 22036 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.292832 22138 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59944 (request call id 2112) took 1042 ms. Trace:
W20260709 12:27:16.380576 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 64015.1us
I20260709 12:27:16.305984 22213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37718 (request call id 1986) took 1010 ms. Trace:
I20260709 12:27:16.382251 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.379320 22702 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:16.347270 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.302969 20873 tablet_replica.cc:333] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:16.382553 22213 rpcz_store.cc:276] 0709 12:27:15.296012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.298880 (+  2868us) service_pool.cc:224] Handling call
0709 12:27:16.305209 (+1006329us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b580001c598. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:27:16.305433 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.305636 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.305666 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.305711 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:16.305744 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.305802 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.305906 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8989952}
W20260709 12:27:16.303567 24974 log.cc:927] Time spent T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:27:16.307013 24972 log.cc:927] Time spent T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.837s	user 0.000s	sys 0.006s
W20260709 12:27:16.288261 24949 log.cc:927] Time spent T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 1.465s	user 0.022s	sys 0.046s
W20260709 12:27:16.378327 24945 consensus_meta.cc:287] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 1.138s	user 0.009s	sys 0.003s
I20260709 12:27:16.423766 24945 raft_consensus.cc:515] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.289835 24880 leader_election.cc:290] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.393342 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9f4c2d15b547e18ff1bfcfd082ae32" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.380525 22138 rpcz_store.cc:276] 0709 12:27:15.249951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.250585 (+   634us) service_pool.cc:224] Handling call
0709 12:27:15.250838 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.261861 (+ 11023us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:15.320851 (+ 58990us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.440933 (+120082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:15.440990 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:15.441037 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.292546 (+851509us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54002e5254. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:16.292611 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.292756 (+   145us) inbound_call.cc:177] Queueing success response
0709 12:27:16.306405 (+ 13649us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
Metrics: {"mutex_wait_us":7841,"prepare.queue_time_us":35620,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":104,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":43465472,"thread_start_us":159388,"threads_started":2,"wal-append.queue_time_us":148792}
I20260709 12:27:16.393978 24983 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:16.427250 24983 raft_consensus.cc:493] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.427800 24983 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.394934 24957 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.283679 24846 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.292472 24854 raft_consensus.cc:515] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.345736 24575 raft_consensus.cc:493] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.317642 24879 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:16.304873 24845 leader_election.cc:290] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.399492 24929 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.400352 22702 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:16.400691 24900 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.441111 22214 raft_consensus.cc:1275] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:16.315570 24841 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.402408 20873 raft_consensus.cc:2243] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.315665 24774 raft_consensus.cc:493] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.315778 24765 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.438014 24879 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:16.453588 24765 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.455315 24879 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:16.455700 24765 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.385614 24768 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:16.405671 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:16.387461 24947 raft_consensus.cc:2804] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:16.451920 24859 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:16.457127 24933 leader_election.cc:290] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.415791 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.280256 24869 raft_consensus.cc:515] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } attrs { replace: true } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.460703 24869 leader_election.cc:290] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.457253 24947 raft_consensus.cc:697] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:16.462350 24947 consensus_queue.cc:237] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.464754 24983 raft_consensus.cc:515] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.465552 22211 raft_consensus.cc:1275] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:16.431067 22036 leader_election.cc:304] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:16.431543 24828 consensus_meta.cc:287] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Time spent flushing consensus metadata: real 1.190s	user 0.017s	sys 0.000s
I20260709 12:27:16.419238 24856 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:16.448237 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 47964.5us
I20260709 12:27:16.447468 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:16.448160 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:16.452711 20873 raft_consensus.cc:2272] T 31f3273ca74242e9b116e3e87078ccef P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.475854 22216 raft_consensus.cc:2410] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:16.476146 24768 raft_consensus.cc:2749] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:16.476822 24828 raft_consensus.cc:515] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.452607 24774 raft_consensus.cc:515] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.479691 24828 leader_election.cc:290] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.479784 24774 leader_election.cc:290] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.443727 24845 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.481937 24845 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:16.438318 24575 raft_consensus.cc:515] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.483821 24878 raft_consensus.cc:493] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:16.484017 24845 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:16.475677 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:16.484292 24575 leader_election.cc:290] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.484356 24878 raft_consensus.cc:515] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.486570 24878 leader_election.cc:290] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.467401 24854 leader_election.cc:290] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.490419 24841 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.492985 22215 raft_consensus.cc:2410] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:16.497354 24898 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:16.503944 22141 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:16.505838 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:16.471184 24859 raft_consensus.cc:493] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:16.509354 24986 log.cc:927] Time spent T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:27:16.509680 24859 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.510761 22731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35006 (request call id 827) took 1152 ms. Trace:
I20260709 12:27:16.511132 22731 rpcz_store.cc:276] 0709 12:27:15.358414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.358627 (+   213us) service_pool.cc:224] Handling call
0709 12:27:15.359040 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:15.359496 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.359537 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:15.473220 (+113683us) log.cc:844] Serialized 52 byte log entry
0709 12:27:16.240935 (+767715us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:16.240981 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.241049 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.510549 (+269500us) raft_consensus.cc:1685] finished
0709 12:27:16.510569 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.510703 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":761353,"threads_started":1,"wal-append.queue_time_us":944935}
W20260709 12:27:16.514998 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:16.518353 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.522166 22220 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Refusing update from remote peer c9a50b2f586448c49281a6618c40a1f7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:27:16.516829 22702 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.523443 22702 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:16.524652 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.533708 24964 log.cc:927] Time spent T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: Append to log took a long time: real 1.108s	user 0.005s	sys 0.007s
W20260709 12:27:16.535615 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 87142.5us
I20260709 12:27:16.559129 24752 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:16.542827 24982 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.563437 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.564390 24945 leader_election.cc:290] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.564603 22036 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:16.534024 24942 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 5 to 7, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:16.569366 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:16.569958 22146 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.570892 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:16.572083 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:16.572647 22141 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:27:16.561312 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.467305 24983 leader_election.cc:290] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.576668 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
W20260709 12:27:16.576784 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 1.2761e+06us
I20260709 12:27:16.577284 22144 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.574608 22143 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 5 to 7, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:16.589707 22184 leader_election.cc:336] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.564s (SENT)
I20260709 12:27:16.591948 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bed3f011bde43719e0a7ce10da0401a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.593611 22111 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.594446 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:16.591605 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:16.596889 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:16.598881 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:16.601513 22185 leader_election.cc:336] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.602198 22185 leader_election.cc:304] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.604638 24990 raft_consensus.cc:2749] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.604676 24843 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:16.606841 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec8474cec64acca2f6f9303db0b0af" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:16.593478 24752 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:16.592831 24768 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:16.610984 22146 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:16.632612 22701 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:16.605836 24750 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:27:16.613843 22036 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.640523 22141 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
I20260709 12:27:16.640894 22036 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.641669 22701 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:16.643438 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.618323 20873 tablet_replica.cc:333] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:16.596313 24775 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:27:16.628300 21963 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48108 (request call id 306) took 6761 ms. Trace:
W20260709 12:27:16.636576 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:16.638114 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 44586us
I20260709 12:27:16.645342 22220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:16.649473 22220 raft_consensus.cc:3060] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.651602 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d4294bcbec49ad88c8ce7c879b596d" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:16.648324 22185 leader_election.cc:336] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.646914 21963 rpcz_store.cc:276] 0709 12:27:09.866895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.893318 (+ 26423us) service_pool.cc:224] Handling call
0709 12:27:16.628216 (+6734898us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:13.237052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:13.285715 (+ 48663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:13.285769 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:27:13.285783 (+    14us) tablet.cc:662] Decoding operations
0709 12:27:13.436298 (+150515us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:13.436379 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:13.436416 (+    37us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:27:13.654217 (+217801us) tablet.cc:701] Row locks acquired
0709 12:27:13.654281 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:27:13.654492 (+   211us) write_op.cc:270] Start()
0709 12:27:13.654685 (+   193us) write_op.cc:276] Timestamp: P: 1783600033654416 usec, L: 0
0709 12:27:13.654717 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:27:13.655650 (+   933us) log.cc:844] Serialized 7466 byte log entry
0709 12:27:14.295139 (+639489us) op_driver.cc:464] REPLICATION: finished
0709 12:27:15.329875 (+1034736us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e208df0ac 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2741fef0
0709 12:27:15.451446 (+121571us) write_op.cc:301] APPLY: starting
0709 12:27:15.451557 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:15.452130 (+   573us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:15.452163 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:15.714799 (+262636us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:15.816044 (+101245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:27:15.823279 (+  7235us) write_op.cc:312] APPLY: finished
0709 12:27:15.888285 (+ 65006us) log.cc:844] Serialized 132 byte log entry
0709 12:27:16.015288 (+127003us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:16.028318 (+ 13030us) write_op.cc:454] Released schema lock
0709 12:27:16.034672 (+  6354us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:16.074736 (+ 40064us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:16.074770 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":235541,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":1119094,"apply.run_cpu_time_us":18796,"apply.run_wall_time_us":597359,"num_ops":19,"prepare.queue_time_us":126241,"prepare.run_cpu_time_us":46410,"prepare.run_wall_time_us":579527,"raft.queue_time_us":236422,"raft.run_cpu_time_us":77533,"raft.run_wall_time_us":1778710,"replication_time_us":616451,"spinlock_wait_cycles":4404608,"thread_start_us":2095785,"threads_started":5,"wal-append.queue_time_us":485115,"wal-append.run_cpu_time_us":36496,"wal-append.run_wall_time_us":1233103}]]}
I20260709 12:27:16.660864 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:16.655339 22185 leader_election.cc:304] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.664845 20873 raft_consensus.cc:2243] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.666311 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:16.667021 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:16.667083 22213 raft_consensus.cc:3060] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.667687 22215 raft_consensus.cc:3060] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.670207 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
W20260709 12:27:16.668457 22185 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.671056 22218 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.650230 24948 raft_consensus.cc:2804] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:16.670320 22702 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.650206 24934 raft_consensus.cc:2804] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:16.650484 24752 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.650128 24946 raft_consensus.cc:2749] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:16.674820 22702 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:16.675680 22036 leader_election.cc:304] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:16.673708 22185 leader_election.cc:336] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.678321 22220 raft_consensus.cc:2468] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
I20260709 12:27:16.680006 21967 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 3 to 6, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 6 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.691278 22185 leader_election.cc:304] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.685467 20873 raft_consensus.cc:2272] T a81d7a413cca41acba7ba36bb13ce654 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.693116 22036 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:16.695813 22185 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.650516 24945 consensus_queue.cc:1048] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:27:16.669545 24994 raft_consensus.cc:2749] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.697784 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.699636 24822 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.700039 24948 raft_consensus.cc:697] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:16.702114 20873 tablet_replica.cc:333] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:16.665218 24813 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:27:16.722144 20873 raft_consensus.cc:2243] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:16.712320 22215 raft_consensus.cc:2468] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:16.725270 22213 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:16.727888 22702 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:16.694167 24899 raft_consensus.cc:2749] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:16.695130 24983 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.695447 24934 raft_consensus.cc:697] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:16.697515 24990 raft_consensus.cc:2749] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.731251 21967 catalog_manager.cc:5697] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 2 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.723497 24879 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:16.732329 24947 raft_consensus.cc:2804] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:16.742352 24934 consensus_queue.cc:237] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.743182 24947 raft_consensus.cc:697] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:16.744145 24947 consensus_queue.cc:237] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.745756 24948 consensus_queue.cc:237] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.746290 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:16.747117 24933 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:16.747502 24933 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:16.747964 24933 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:16.752306 22702 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.752844 22702 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:16.753957 22702 leader_election.cc:336] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:16.754374 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:16.754653 20873 raft_consensus.cc:2272] T 99368f219dd84b6994a569b62a8579d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.758323 24983 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.759079 24983 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.762349 22144 raft_consensus.cc:2468] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:16.762800 24843 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:16.690910 24859 raft_consensus.cc:515] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.771315 24843 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:16.775859 22215 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:16.777756 22111 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:16.768378 20873 tablet_replica.cc:333] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:16.781927 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:16.782197 20873 raft_consensus.cc:2243] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:16.782550 22215 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.786651 22111 leader_election.cc:304] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:16.783846 21967 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.776954 24843 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.801676 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:16.801548 21967 catalog_manager.cc:5697] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 3 to 5, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.802973 22144 raft_consensus.cc:3060] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.800894 24929 consensus_queue.cc:1059] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:27:16.818145 20873 raft_consensus.cc:2272] T b43429b68f624c25ae86dad7e60ceb15 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:16.738701 24942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:33746 (request call id 0) took 3072 ms. Trace:
I20260709 12:27:16.829331 22144 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:16.830534 22701 leader_election.cc:304] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:16.831681 24948 raft_consensus.cc:2804] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:16.832281 24948 raft_consensus.cc:697] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:16.833335 24948 consensus_queue.cc:237] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:16.777400 24859 leader_election.cc:290] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:16.837659 24979 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.777446 24945 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:27:16.859472 22144 raft_consensus.cc:3055] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:16.949085 22218 raft_consensus.cc:2468] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 7.
W20260709 12:27:17.078579 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 292279us
I20260709 12:27:17.080143 22144 raft_consensus.cc:740] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:16.838004 24900 raft_consensus.cc:2764] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:27:16.971127 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.822579 24942 rpcz_store.cc:276] 0709 12:27:13.656992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.657201 (+   209us) service_pool.cc:224] Handling call
0709 12:27:13.945234 (+288033us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5800633ed0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239450aa 00007f1e239c7447 00007f1e239e470a 00007f1e239e576a 00007f1e239e491b 00007f1e239f003c 00007f1e239ef6b3 00007f1e239e79fa 00007f1e289af4c9 00007f1e21f2bc54
0709 12:27:14.049066 (+103832us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4c00099580. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e21cb5a20 00007f1e21cc6a29 00007f1e21c8c644 00007f1e21cb3f2d 00007f1e21cb3b93 00007f1e239421af 00007f1e23941f3e 00007f1e239c7888 00007f1e239e475c 00007f1e239e576a 00007f1e239e491b
0709 12:27:14.068342 (+ 19276us) log.cc:844] Serialized 494 byte log entry
0709 12:27:15.259178 (+1190836us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4c00099580. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e21cb5a20 00007f1e21cc6a29 00007f1e21cc713f 00007f1e21c8b2ab 00007f1e21cb8f3c 00007f1e21cb93fe 00007f1e21f4650b 00007f1e23945381 00007f1e2394326b 00007f1e23949d53 00007f1e23949cd9
0709 12:27:15.580511 (+321333us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b540046cba0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e23969b26 00007f1e2396349a 00007f1e23962714 00007f1e23942eaa 00007f1e23949d53 00007f1e23949cd9 00007f1e23949c69 00007f1e23949c31 00007f1e23948dfd 0000000000388634
0709 12:27:16.729024 (+1148513us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2404,"raft.queue_time_us":364470,"raft.run_cpu_time_us":43692,"raft.run_wall_time_us":1892875,"spinlock_wait_cycles":762767104,"thread_start_us":518635,"threads_started":2,"wal-append.queue_time_us":388224,"wal-append.run_cpu_time_us":1818,"wal-append.run_wall_time_us":1076413}
I20260709 12:27:16.861712 22215 raft_consensus.cc:2468] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 6.
I20260709 12:27:17.039539 24933 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:16.931499 21967 catalog_manager.cc:5697] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:16.842413 24929 raft_consensus.cc:3055] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:16.842742 24879 raft_consensus.cc:493] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:16.955407 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:17.082501 22144 consensus_queue.cc:260] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:17.078979 20873 tablet_replica.cc:333] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:17.102017 22144 raft_consensus.cc:3060] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:16.878959 22220 raft_consensus.cc:2955] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 5 to 7, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:17.075614 25005 log.cc:927] Time spent T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:27:17.101873 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 146499us
W20260709 12:27:16.916226 24999 log.cc:927] Time spent T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:17.077998 24750 raft_consensus.cc:493] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.114991 20873 raft_consensus.cc:2243] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:17.134775 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.135730 22138 raft_consensus.cc:2410] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:27:17.150748 22144 raft_consensus.cc:1275] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:27:17.151391 22144 pending_rounds.cc:85] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 7
I20260709 12:27:17.151741 22144 pending_rounds.cc:107] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:27:17.152112 22144 raft_consensus.cc:2889] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:17.105113 24929 raft_consensus.cc:740] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:17.181113 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.184242 20873 raft_consensus.cc:2272] T ed9f4c2d15b547e18ff1bfcfd082ae32 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:17.154183 24843 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:17.183300 21967 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:17.174993 24926 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.194790 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.114812 24879 raft_consensus.cc:515] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:17.198096 22138 raft_consensus.cc:2368] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:17.236574 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.197398 24843 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:17.252467 24929 consensus_queue.cc:260] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:17.253729 24929 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:17.254422 24843 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:17.204057 24926 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:17.257884 24933 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:17.258708 24898 raft_consensus.cc:493] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.259655 20873 tablet_replica.cc:333] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:17.259235 24898 raft_consensus.cc:515] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:17.260587 20873 raft_consensus.cc:2243] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:17.261787 24898 leader_election.cc:290] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:17.259255 24926 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:17.274420 24879 leader_election.cc:290] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:17.275735 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.276610 22145 raft_consensus.cc:2410] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9a50b2f586448c49281a6618c40a1f7 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:17.296713 22137 raft_consensus.cc:1240] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Rejecting Update request from peer c9a50b2f586448c49281a6618c40a1f7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:17.302475 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.143271 24750 raft_consensus.cc:515] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:17.339859 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.340371 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.345594 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.346452 22137 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:17.306399 24954 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:17.398407 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.358376 24774 raft_consensus.cc:493] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.409299 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 212689us
I20260709 12:27:17.415997 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:17.419088 22137 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
I20260709 12:27:17.387357 24933 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:17.428231 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:17.430279 22036 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:17.436905 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:17.467653 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.399443 24946 consensus_queue.cc:1059] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:27:17.489643 22137 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:17.492336 20873 raft_consensus.cc:2272] T 299ade5c6c9e48928f5602c43824af92 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:17.501782 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:17.397938 24954 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:17.428669 24774 raft_consensus.cc:515] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:17.527087 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf83ee90e33b4083aebda67b32ca1149 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:27:17.429524 24933 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:17.568895 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.570293 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.570657 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.571025 22137 raft_consensus.cc:2368] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:17.551558 24774 leader_election.cc:290] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:17.551578 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 73341.1us
I20260709 12:27:17.473371 24822 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:17.565551 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.543115 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.571414 22138 raft_consensus.cc:2368] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 6. Current term is 7.
I20260709 12:27:17.574779 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.575471 22138 raft_consensus.cc:2368] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:17.577744 22141 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:27:17.578825 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 107983us
I20260709 12:27:17.583968 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:17.584379 21953 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 150449us
I20260709 12:27:17.584838 22217 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:17.586704 22220 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:17.503144 24856 consensus_queue.cc:1048] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:27:17.565207 24979 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:17.598078 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed5fd823f34d34b4fd87d49e53edb0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.606451 22142 raft_consensus.cc:2368] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:17.599545 22138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.600008 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.601234 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:17.588042 25009 log.cc:927] Time spent T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:27:17.612336 22138 raft_consensus.cc:2410] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:27:17.608908 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.613221 22146 raft_consensus.cc:3060] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:17.619518 22702 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466
I20260709 12:27:17.620946 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.621596 22142 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:17.622500 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.622565 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.621627 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.625075 22140 raft_consensus.cc:2376] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8. Re-sending same reply.
I20260709 12:27:17.630594 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "285ef7a597884d3a8a0ad5e993a8eb93" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:17.632351 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.699748 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 127502us
I20260709 12:27:17.696760 24750 leader_election.cc:290] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:17.692876 25001 log.cc:927] Time spent T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:27:17.723682 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 104571us
I20260709 12:27:17.725361 24982 raft_consensus.cc:2804] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:17.725936 24982 raft_consensus.cc:697] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:17.726807 24982 consensus_queue.cc:237] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:17.729059 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.729925 22140 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:17.733979 24933 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:17.774294 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:17.823355 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.825275 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.832571 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.833474 22145 raft_consensus.cc:2410] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:17.834758 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.858923 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.860662 22137 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:17.753147 22146 raft_consensus.cc:2468] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
I20260709 12:27:17.884315 24954 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:17.618352 24979 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:17.886626 24979 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:17.886312 24859 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:27:17.894848 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.920053 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 184415us
I20260709 12:27:17.929111 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.934494 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.966784 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.972656 22143 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:17.972822 22137 raft_consensus.cc:1275] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:17.975459 22217 raft_consensus.cc:1275] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:17.984264 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.987092 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.989913 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:17.992192 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a703fed624441fb4eb00f38f0ff80d" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:17.992890 22146 raft_consensus.cc:2368] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 6. Current term is 7.
I20260709 12:27:17.923799 24943 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:27:17.993757 22137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:17.994921 22035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 352888us
I20260709 12:27:17.998378 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:17.987659 22141 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:18.004958 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.005539 22140 raft_consensus.cc:3060] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:18.011107 20873 tablet_replica.cc:333] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.018764 22141 raft_consensus.cc:1275] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:18.019080 20873 raft_consensus.cc:2243] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:18.024405 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 495696us
W20260709 12:27:18.029434 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 103039us
I20260709 12:27:18.030089 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2012f4a3900141a5b86022143147dd81" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.031011 22143 raft_consensus.cc:2368] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:18.018533 22035 leader_election.cc:304] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.040942 25029 consensus_queue.cc:1048] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:18.044757 20873 raft_consensus.cc:2272] T 2bed3f011bde43719e0a7ce10da0401a P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.046393 22211 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:18.048810 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.049474 22141 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:18.052397 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b9f971fd394d129cd62de001799b21" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:18.052703 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.053162 22143 raft_consensus.cc:2368] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:18.053297 22146 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:18.048517 25026 raft_consensus.cc:2749] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:18.015053 25013 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:27:18.056030 22141 raft_consensus.cc:1275] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:18.063786 24828 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:27:18.066807 22185 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.068245 24856 consensus_queue.cc:1048] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:18.079269 25014 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.079872 25014 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.082162 25014 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:18.097292 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:18.098136 22141 raft_consensus.cc:2376] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9. Re-sending same reply.
W20260709 12:27:18.091416 22110 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.103410 22140 raft_consensus.cc:1275] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:27:18.103940 22140 pending_rounds.cc:85] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 5
I20260709 12:27:18.104234 22140 pending_rounds.cc:107] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:18.104535 22140 raft_consensus.cc:2889] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:18.108387 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:18.115708 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.096518 25026 raft_consensus.cc:493] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.118659 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.099711 24900 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
W20260709 12:27:18.122078 25036 log.cc:927] Time spent T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:27:18.121888 24900 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.111999 25023 consensus_queue.cc:1048] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:27:18.123284 25037 log.cc:927] Time spent T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:27:18.117612 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:18.126296 24900 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:18.127462 24575 raft_consensus.cc:3055] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:18.131467 24575 raft_consensus.cc:740] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c9a50b2f586448c49281a6618c40a1f7, State: Running, Role: LEADER
W20260709 12:27:18.132095 22184 leader_election.cc:336] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.938s (SENT)
I20260709 12:27:18.132349 24575 consensus_queue.cc:260] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.133731 24575 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.135217 22036 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.137743 24768 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.132735 22184 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.108440 25014 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.145566 22184 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.596s (SENT)
I20260709 12:27:18.146500 22184 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:18.148718 22185 leader_election.cc:336] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.148948 22213 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:18.149885 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f77cd08fd9014998aebc07bff003d1a8" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.153640 24982 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:18.140928 25026 raft_consensus.cc:515] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.148132 24954 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.155077 24954 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.156150 25026 leader_election.cc:290] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:18.159132 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.166693 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:18.170760 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.176016 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.185777 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.198993 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f575e2f52433abc7aeff041ddb880" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.213923 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d56621ac1d470dac3f492c5c1b5256" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.145057 25014 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:18.222311 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 76833.7us
W20260709 12:27:18.223215 22184 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 2.492s (SENT)
I20260709 12:27:18.223784 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.224735 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.225183 22035 leader_election.cc:304] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.225704 22143 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
W20260709 12:27:18.249334 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.254410 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c609d086e32e4033b7376f770a2790a6" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.269927 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.269517 25045 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.278571 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.279501 22036 leader_election.cc:304] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:18.279700 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 82059.1us
I20260709 12:27:18.279364 22143 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:18.283053 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.283715 22144 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
W20260709 12:27:18.289285 22184 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.581s (SENT)
I20260709 12:27:18.289776 22184 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.269471 24768 raft_consensus.cc:2749] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.298552 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.299533 22144 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:18.286412 24946 raft_consensus.cc:2749] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:18.314716 22737 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:18.315410 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40fdb108e6f14522a9ef82da47fc0b74" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.316196 22729 raft_consensus.cc:1240] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:18.327822 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.330863 25048 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:18.331780 22184 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Timed out: RequestConsensusVote RPC to 127.20.98.66:42771 timed out after 1.711s (SENT)
I20260709 12:27:18.332248 22184 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.333941 25048 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.334533 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.343663 22211 raft_consensus.cc:1240] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:18.344208 22218 raft_consensus.cc:1240] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:18.350066 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a9ba8203ae4024af5885277061c1a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:18.365669 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 85235.4us
I20260709 12:27:18.347924 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821557b36d67456997b35682a066dbc9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:18.343595 25038 log.cc:927] Time spent T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:27:18.369429 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4304a0cf75473e8fd1d5791213f0a3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:18.350425 25028 log.cc:927] Time spent T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:27:18.349938 24900 raft_consensus.cc:493] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.374022 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b958cd7e995415696872e37e9c3062b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.379767 22736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.378240 24900 raft_consensus.cc:515] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.383889 24900 leader_election.cc:290] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:18.397217 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.398048 22219 raft_consensus.cc:2393] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 6: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:18.398630 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.403679 22211 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:18.398768 22219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.406566 22215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.398972 22218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.408007 22218 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:18.399037 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ecbcd398b0449b86b36309434ca3d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.409281 25014 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:18.412734 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.421962 22141 raft_consensus.cc:3055] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:18.422197 22146 raft_consensus.cc:1275] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:18.422430 22141 raft_consensus.cc:740] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:18.433449 20873 tablet_replica.cc:333] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.434333 20873 raft_consensus.cc:2243] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.435317 20873 raft_consensus.cc:2272] T ec2973e4920541d9ba2cb2c911dbab09 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.440255 20873 tablet_replica.cc:333] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.440090 25013 consensus_queue.cc:1048] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:18.425944 22111 connection.cc:256] RPC call timeout handler was delayed by -4.4455969500004358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 12:27:18.441201 22212 raft_consensus.cc:1217] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
W20260709 12:27:18.441517 22111 connection.cc:256] RPC call timeout handler was delayed by -4.0387969500006875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 12:27:18.441787 22212 raft_consensus.cc:1240] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Rejecting Update request from peer 85f0d4cf04de40aa9e25849fb2380466 for earlier term 3. Current term is 5. Ops: [3.6-3.6]
W20260709 12:27:18.441895 22111 connection.cc:256] RPC call timeout handler was delayed by -3.0217969499999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3326s for a response
I20260709 12:27:18.442516 22111 leader_election.cc:304] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:18.443467 24856 consensus_queue.cc:1048] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:18.443691 22111 leader_election.cc:304] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:18.441213 20873 raft_consensus.cc:2243] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.445220 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.423202 22141 consensus_queue.cc:260] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.446468 20873 raft_consensus.cc:2272] T 2610abde2b26405b8b88ae11fb975d64 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.446762 22141 raft_consensus.cc:3060] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:18.447154 22109 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.450033 20873 tablet_replica.cc:333] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.456284 22111 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:18.461113 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 72353us
W20260709 12:27:18.461872 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 69902.2us
I20260709 12:27:18.463735 22141 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:27:18.464116 22141 pending_rounds.cc:85] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Aborting all ops after (but not including) 7
I20260709 12:27:18.464327 22141 pending_rounds.cc:107] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:27:18.464560 22141 raft_consensus.cc:2889] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:18.467265 20873 raft_consensus.cc:2243] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.472661 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66fbf1879e84a19b490058938a4bc34" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.473205 22139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf83ee90e33b4083aebda67b32ca1149" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.474130 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.476648 22140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.477264 22140 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
W20260709 12:27:18.477593 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:18.477625 22111 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.478163 22111 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:18.478312 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:18.480458 20873 raft_consensus.cc:2272] T 62526c368b43448e83c05dfd4e5aeaf3 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.482091 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.476372 24957 raft_consensus.cc:2764] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:27:18.479642 24979 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:18.490756 22185 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:18.493523 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:18.495343 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.479761 24946 raft_consensus.cc:493] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.509533 22111 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:18.510622 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 44491.2us
W20260709 12:27:18.511744 22111 consensus_peers.cc:597] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.511863 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:18.488732 24979 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.496354 24900 raft_consensus.cc:2764] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:27:18.519766 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.520401 22737 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:27:18.524340 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.528506 22184 leader_election.cc:400] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 6. Current term is 7.
I20260709 12:27:18.528862 22184 leader_election.cc:403] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:27:18.529862 22184 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.531289 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.533092 22184 leader_election.cc:400] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:18.533464 22184 leader_election.cc:403] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:18.535669 20873 tablet_replica.cc:333] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.536588 20873 raft_consensus.cc:2243] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.513358 24946 raft_consensus.cc:515] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.540408 22212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.519829 24979 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.543020 22184 leader_election.cc:400] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:18.554177 22184 leader_election.cc:403] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:18.543079 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.531944 22217 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:27:18.555804 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e89ee7eb571454eb9956953ae2c7c5d" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.549576 20873 raft_consensus.cc:2272] T a8619cc30f64448bb01e0e927ff038d1 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.512692 24859 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:27:18.570779 25059 raft_consensus.cc:2749] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:18.574071 20873 tablet_replica.cc:333] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.530897 25048 raft_consensus.cc:2749] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 6. Current term is 7.
I20260709 12:27:18.575048 20873 raft_consensus.cc:2243] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.581709 20873 raft_consensus.cc:2272] T 40fdb108e6f14522a9ef82da47fc0b74 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.540769 25014 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.553117 25015 raft_consensus.cc:2749] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:18.522661 25045 consensus_queue.cc:1048] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 12:27:18.607632 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 64732.7us
I20260709 12:27:18.609594 22184 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.611377 22184 leader_election.cc:304] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.626941 22184 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:18.627595 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 115300us
I20260709 12:27:18.628104 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:18.629705 22112 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.630026 22184 leader_election.cc:304] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:18.630596 22111 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.630998 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.631213 22184 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:18.636380 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 81019.2us
W20260709 12:27:18.636898 22111 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.627353 25059 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.629385 25048 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:18.633251 25015 raft_consensus.cc:2749] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.634814 25014 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:18.648521 20873 tablet_replica.cc:333] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.660053 20873 raft_consensus.cc:2243] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:18.644685 25060 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:18.667486 22111 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.669699 22111 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.654070 24954 raft_consensus.cc:2749] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771) with higher term. Message: Invalid argument: T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b for earlier term 5. Current term is 6.
I20260709 12:27:18.652281 25043 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:18.671060 25066 raft_consensus.cc:2749] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:18.679708 25056 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:18.696368 20873 raft_consensus.cc:2272] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.700520 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.701597 24946 leader_election.cc:290] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:18.703290 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b7dc5b82134cd492412751a2d63d9f" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:18.677910 25045 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:18.724908 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 57451.9us
W20260709 12:27:18.738806 22111 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.739410 22111 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:18.740815 22111 leader_election.cc:336] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.741417 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:18.743238 22111 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.743316 22035 leader_election.cc:304] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:18.745092 22035 raft_consensus.cc:2686] T f7b7dc5b82134cd492412751a2d63d9f P c9a50b2f586448c49281a6618c40a1f7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:27:18.754513 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:18.755122 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:18.757506 22034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.654414 25059 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.742112 25045 raft_consensus.cc:493] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.744666 25060 raft_consensus.cc:2749] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:18.765591 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 183997us
I20260709 12:27:18.747509 24900 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:18.778173 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 147007us
I20260709 12:27:18.779031 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.780179 22184 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.767095 25045 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.782606 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.783859 25043 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:18.789746 25043 raft_consensus.cc:493] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.790169 25043 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.794463 25045 raft_consensus.cc:515] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.796742 25059 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:18.782506 25066 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:18.805431 25045 leader_election.cc:290] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:18.814911 20873 tablet_replica.cc:333] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.815879 20873 raft_consensus.cc:2243] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.816653 20873 raft_consensus.cc:2272] T 6a3d458721d04ad184247f1a1926d3fa P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:18.819386 20873 tablet_replica.cc:333] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.820241 20873 raft_consensus.cc:2243] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.821435 20873 raft_consensus.cc:2272] T 2b5c193cc2e540dbbc926df1219ef72b P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:18.823071 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:18.824298 22185 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:18.826531 22111 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:18.828163 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 55680.1us
I20260709 12:27:18.783982 22184 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.787174 24979 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.834913 24979 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:18.835476 24979 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.832681 25013 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.832659 22111 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.836658 25013 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.837373 24900 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:18.837977 22111 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:18.838753 24900 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.784873 25051 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.839164 24900 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.839306 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:18.839457 25051 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.840001 24900 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.841849 24957 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.842263 24957 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.842648 24957 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.840051 25051 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.838778 25013 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:18.847158 22111 leader_election.cc:304] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:18.854002 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 70078.1us
I20260709 12:27:18.856194 22184 leader_election.cc:304] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.857609 21963 catalog_manager.cc:5697] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 8, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 8 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:18.863548 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:18.868639 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:18.862746 25068 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:18.870023 25056 raft_consensus.cc:2804] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.870642 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.872663 22111 leader_election.cc:304] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:18.865799 25071 raft_consensus.cc:2749] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.869366 24979 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:18.877959 20873 tablet_replica.cc:333] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:18.870447 25068 raft_consensus.cc:493] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.874617 25045 raft_consensus.cc:2749] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.878700 25068 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:18.876528 25060 raft_consensus.cc:2749] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.880365 20873 raft_consensus.cc:2243] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:18.873823 25056 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.874722 25059 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:18.876719 24979 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.889595 24979 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.891752 25068 raft_consensus.cc:515] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.874341 22184 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.904132 24900 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.905795 21963 catalog_manager.cc:5697] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.907886 21963 catalog_manager.cc:5697] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 6 to 7, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 7 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.909330 21963 catalog_manager.cc:5697] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.910686 25056 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:18.911536 24900 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:18.912371 22036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.918727 25056 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.921038 25056 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:18.910665 21963 catalog_manager.cc:5697] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 4 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.922866 21963 catalog_manager.cc:5697] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.927349 24957 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.934635 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:18.935482 22146 raft_consensus.cc:2393] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed678a3f9e3d4e0ba5801f1663548796 in current term 6: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:18.936332 25051 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:18.943236 21967 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40564 (request call id 201) took 12002 ms (client timeout 15000 ms). Trace:
W20260709 12:27:18.945730 22037 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:18.945770 21967 rpcz_store.cc:269] 0709 12:27:06.940611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.951193 (+ 10582us) service_pool.cc:224] Handling call
0709 12:27:08.844160 (+1892967us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540032f354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23953090 00007f1e239f1f3a 00007f1e297a7e9c 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:27:18.943169 (+10099009us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:17.737589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:17.959144 (+221555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:17.959182 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:27:17.959200 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:17.960012 (+   812us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:17.960091 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:17.960122 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:27:17.960668 (+   546us) tablet.cc:701] Row locks acquired
0709 12:27:17.960687 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:27:17.960840 (+   153us) write_op.cc:270] Start()
0709 12:27:17.960991 (+   151us) write_op.cc:276] Timestamp: P: 1783600037960790 usec, L: 0
0709 12:27:17.961015 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:27:18.013966 (+ 52951us) log.cc:844] Serialized 2430 byte log entry
0709 12:27:18.388902 (+374936us) op_driver.cc:464] REPLICATION: finished
0709 12:27:18.524184 (+135282us) write_op.cc:301] APPLY: starting
0709 12:27:18.524289 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:18.555581 (+ 31292us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:18.592616 (+ 37035us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:18.661333 (+ 68717us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:18.687306 (+ 25973us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b540032f354. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e632a 00007f1e2396bf14 00007f1e2396bec3 00007f1e2396be38 00007f1e2396bdf3 00007f1e2396b0dc 00007f1e23994e16 00007f1e2397ccbb 00007f1e2396739d 00007f1e2396ad75
0709 12:27:18.718581 (+ 31275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:27:18.718639 (+    58us) write_op.cc:312] APPLY: finished
0709 12:27:18.718882 (+   243us) log.cc:844] Serialized 53 byte log entry
0709 12:27:18.719045 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:18.719191 (+   146us) write_op.cc:454] Released schema lock
0709 12:27:18.719239 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:18.719637 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:18.719664 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1310066,"reported_tablets":26,"spinlock_wait_cycles":521044224,"child_traces":[["op",{"apply.queue_time_us":124340,"apply.run_cpu_time_us":3521,"apply.run_wall_time_us":198786,"num_ops":6,"prepare.queue_time_us":273812,"prepare.run_cpu_time_us":10929,"prepare.run_wall_time_us":349535,"raft.queue_time_us":188701,"raft.run_cpu_time_us":32163,"raft.run_wall_time_us":339168,"replication_time_us":406300,"spinlock_wait_cycles":16225664,"thread_start_us":371425,"threads_started":4,"wal-append.queue_time_us":27162}]]}
W20260709 12:27:18.963681 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 89411.4us
I20260709 12:27:18.964656 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:18.965032 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:18.970564 24957 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:18.971161 25045 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:18.971570 25045 raft_consensus.cc:493] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.971899 25045 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:18.975179 24979 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:18.976320 25051 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:18.976876 25051 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:18.977473 24979 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:18.981156 25051 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:18.983605 25051 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:18.986093 22213 raft_consensus.cc:1275] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:18.924599 21963 catalog_manager.cc:5697] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 1 to 4, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 4 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.990361 21963 catalog_manager.cc:5697] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.991740 21963 catalog_manager.cc:5697] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:18.994398 25068 leader_election.cc:290] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:18.995498 25068 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:18.968408 22111 leader_election.cc:336] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.000185 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:19.000821 22733 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:19.003795 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:19.005379 24954 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:19.005827 24954 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.006186 24954 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.000234 22111 leader_election.cc:304] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:19.007663 22111 leader_election.cc:336] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.008069 22111 leader_election.cc:304] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:19.009330 24979 raft_consensus.cc:2749] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.009636 25056 raft_consensus.cc:2749] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:19.010330 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 45356.7us
I20260709 12:27:19.009232 25023 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:19.013584 25023 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:19.015637 25023 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:18.992928 21963 catalog_manager.cc:5697] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 6 to 7, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 7 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:19.017885 25043 raft_consensus.cc:515] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:19.009065 22111 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.018973 22111 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.019767 25056 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:19.019985 22111 leader_election.cc:336] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.020450 22111 leader_election.cc:304] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:19.020931 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:19.021438 22111 leader_election.cc:336] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.021873 22111 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.018426 21963 catalog_manager.cc:5697] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:19.023793 21963 catalog_manager.cc:5697] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 6, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 6 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:19.026427 21963 catalog_manager.cc:5697] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 8, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 8 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:19.028789 21963 catalog_manager.cc:5697] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:19.031287 22111 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.033267 21963 catalog_manager.cc:5697] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:19.034978 21963 catalog_manager.cc:5697] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 5, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 5 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.034145 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.030776 24979 raft_consensus.cc:2749] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.042774 21963 catalog_manager.cc:5697] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 5 to 7, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:19.043342 22111 leader_election.cc:336] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.043982 22111 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:19.045125 22111 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.046149 22111 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.047043 22111 leader_election.cc:336] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.051196 24900 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.045912 24957 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:19.053821 22733 consensus_queue.cc:237] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:19.048180 22111 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.056077 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:19.057502 22111 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.058094 22111 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.058318 20873 raft_consensus.cc:2272] T 28acb7e5630c4b1da2fa7d2abca24a62 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.059490 22111 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.030547 25056 raft_consensus.cc:2749] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:19.061193 21963 catalog_manager.cc:5697] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 6 to 9, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 9 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.063678 21963 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 6, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 6 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:19.060544 24957 raft_consensus.cc:2749] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:19.065378 21953 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet bf83ee90e33b4083aebda67b32ca1149 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 7
I20260709 12:27:19.057718 24979 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.059959 22111 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.017920 25045 raft_consensus.cc:515] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:19.075913 22111 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.076761 22111 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.077872 22111 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.080149 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:19.082916 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51286e1e6cac4310b4960b85e10b91cd" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:19.083458 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:19.084017 22213 raft_consensus.cc:3060] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.086205 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f24f68619f14d9e9de4306dd59b5709" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:19.087054 22146 raft_consensus.cc:2393] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 4: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:19.088089 22211 raft_consensus.cc:2393] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 85f0d4cf04de40aa9e25849fb2380466 in current term 7: Already voted for candidate be238c1de63840f9bb041e2f9ba58d2b in this term.
I20260709 12:27:19.088860 20873 tablet_replica.cc:333] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
W20260709 12:27:19.088955 22185 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.089736 20873 raft_consensus.cc:2243] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.090068 21963 catalog_manager.cc:5697] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 2 to 3, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:19.095856 20873 raft_consensus.cc:2272] T 97b8db04a690435f8c84aba1b0f5ec2b P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.096300 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3e126e4f1f4d82991ffddf4599b103" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:19.096872 22217 raft_consensus.cc:3060] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.099668 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5f28925d2fc4ec39e677a2be96ca259" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:19.101467 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b43429b68f624c25ae86dad7e60ceb15" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:19.102031 22142 raft_consensus.cc:3060] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.103411 22184 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.103727 22213 raft_consensus.cc:2468] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:19.110795 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:19.111588 22143 raft_consensus.cc:2393] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate be238c1de63840f9bb041e2f9ba58d2b in current term 7: Already voted for candidate 85f0d4cf04de40aa9e25849fb2380466 in this term.
I20260709 12:27:19.077714 25056 raft_consensus.cc:2749] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.112865 22217 raft_consensus.cc:2468] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:19.118148 22142 raft_consensus.cc:2468] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
W20260709 12:27:19.124698 22111 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.105062 25051 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:19.125243 22111 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.140385 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.147518 22111 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:19.148315 22184 leader_election.cc:304] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:19.124457 24900 raft_consensus.cc:2749] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.122546 25043 leader_election.cc:290] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:19.148610 22111 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:19.150116 25066 raft_consensus.cc:2804] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:19.158522 22185 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.159710 22185 leader_election.cc:336] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.160501 22111 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.142248 25056 raft_consensus.cc:2749] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:19.168732 22145 raft_consensus.cc:3060] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.173457 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e08d44df7b4ab4a3721b9aeb2aaa24" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:19.174280 22737 raft_consensus.cc:3060] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.174502 22733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31f3273ca74242e9b116e3e87078ccef" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:19.175118 22733 raft_consensus.cc:3060] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.146399 24954 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:19.150214 25068 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.181300 24954 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:19.153862 24979 raft_consensus.cc:2804] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:19.161326 22111 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.156088 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d1a2cd4888492fad01161b84e51d77" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:19.184994 22143 raft_consensus.cc:3060] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.167965 24957 raft_consensus.cc:2804] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:19.187126 22731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "299ade5c6c9e48928f5602c43824af92" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:19.190114 22111 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.190618 22731 raft_consensus.cc:3060] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.190563 25066 raft_consensus.cc:697] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:19.194542 25066 consensus_queue.cc:237] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.197522 24979 raft_consensus.cc:697] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:19.198559 24979 consensus_queue.cc:237] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.199697 25045 leader_election.cc:290] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:19.201578 22145 raft_consensus.cc:2468] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
W20260709 12:27:19.209404 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 48092.6us
W20260709 12:27:19.210378 22111 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.211103 22111 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.212495 22111 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.214787 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93141c9281524e9aaffe4907f7e32041" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:19.215569 22144 raft_consensus.cc:3060] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:19.223213 22185 leader_election.cc:336] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:19.225833 25077 log.cc:927] Time spent T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:19.258926 22184 leader_election.cc:304] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.259516 20873 tablet_replica.cc:333] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:19.204522 24957 raft_consensus.cc:697] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:19.218918 25056 raft_consensus.cc:2749] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.264689 20873 raft_consensus.cc:2243] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:19.269460 25068 raft_consensus.cc:2804] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:19.270072 25068 raft_consensus.cc:697] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:19.271703 24854 consensus_queue.cc:1048] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:27:19.283039 22213 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:19.285907 22737 raft_consensus.cc:2468] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
W20260709 12:27:19.295145 22185 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.319268 22143 raft_consensus.cc:2468] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
I20260709 12:27:19.319571 22731 raft_consensus.cc:2468] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:19.270984 25068 consensus_queue.cc:237] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:19.333005 22702 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.305864 22144 raft_consensus.cc:2468] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
I20260709 12:27:19.329138 22146 raft_consensus.cc:1275] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:19.330027 22184 leader_election.cc:304] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.330209 22185 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.331763 22733 raft_consensus.cc:2468] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:19.339833 24942 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:19.354576 22184 leader_election.cc:304] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:19.354782 22702 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:19.355724 22185 leader_election.cc:336] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.325135 24946 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.325963 25056 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.369072 22111 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.374091 22111 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.358515 25045 raft_consensus.cc:2804] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:19.361945 24954 raft_consensus.cc:2804] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:19.380123 25059 raft_consensus.cc:2804] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:19.381681 24900 raft_consensus.cc:2804] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:19.364408 25035 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.364662 25043 raft_consensus.cc:2804] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:19.367843 24957 consensus_queue.cc:237] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.368736 24943 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.375325 25056 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:19.369236 24946 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:19.399978 25045 raft_consensus.cc:697] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:19.401716 24954 raft_consensus.cc:697] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:19.399839 25035 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.441542 25045 consensus_queue.cc:237] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.403165 24854 consensus_queue.cc:1048] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:27:19.456056 25056 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:19.458138 25035 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:19.458688 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:19.459494 22143 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 6.
I20260709 12:27:19.463680 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
I20260709 12:27:19.486588 20873 raft_consensus.cc:2272] T cd094bd2058d4b6d9810ece12a93d849 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.488191 22702 leader_election.cc:336] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.488782 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.475405 25026 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:19.514122 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 104501us
I20260709 12:27:19.484902 25059 raft_consensus.cc:697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:19.521114 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:19.523646 22737 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:19.475446 24954 consensus_queue.cc:237] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:19.507968 24945 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:19.507941 25026 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.533969 20873 tablet_replica.cc:333] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:19.538729 20873 raft_consensus.cc:2243] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.513814 25043 raft_consensus.cc:697] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 9 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:19.541870 25043 consensus_queue.cc:237] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.550980 20873 raft_consensus.cc:2272] T 285ef7a597884d3a8a0ad5e993a8eb93 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.540655 25026 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:19.569458 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 44303.7us
I20260709 12:27:19.574505 24946 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:19.577778 25059 consensus_queue.cc:237] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:19.594430 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:19.595566 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:19.600095 20873 tablet_replica.cc:333] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:19.608537 25085 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:19.609061 25085 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.609426 25085 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:19.627465 22036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 192022us
I20260709 12:27:19.635627 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:19.589160 24957 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.636384 22211 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 5.
I20260709 12:27:19.637807 22217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:19.638478 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2100de7ab7b84cf39a4370858e9b6927" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:19.646170 25091 log.cc:927] Time spent T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:27:19.673324 22111 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.645444 24900 raft_consensus.cc:697] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:19.678900 25056 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.681955 22036 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9a50b2f586448c49281a6618c40a1f7; no voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:19.683025 22143 raft_consensus.cc:1275] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:19.644781 24957 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.692544 25026 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.724002 20873 raft_consensus.cc:2243] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.725955 20873 raft_consensus.cc:2272] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.726495 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:19.727120 22213 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:19.727645 25026 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Requested vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:19.728349 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:19.728946 22146 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:19.717273 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:19.704589 25095 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:19.733759 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:27:19.734589 22111 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.735370 25098 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:19.735814 25098 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.736208 25098 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.718437 25068 consensus_queue.cc:1048] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:19.737061 22146 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
I20260709 12:27:19.718868 25056 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.738408 22035 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7; no voters: 
W20260709 12:27:19.738997 22035 raft_consensus.cc:2686] T d57c1d6eaa044fe58248b797147f51d0 P c9a50b2f586448c49281a6618c40a1f7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:19.740480 25056 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:19.714805 24905 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:19.742739 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "c9a50b2f586448c49281a6618c40a1f7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:19.743341 22213 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:27:19.743938 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 85718.4us
I20260709 12:27:19.719297 24957 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:19.746438 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:19.747138 22211 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 3.
I20260709 12:27:19.746475 22143 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:19.722982 25085 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:19.750051 22185 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.752457 25085 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:19.730376 20873 tablet_replica.cc:333] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:19.762949 20873 raft_consensus.cc:2243] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.761708 22111 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:19.764801 24957 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:19.765202 24957 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.765605 24957 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.769783 20873 raft_consensus.cc:2272] T 821557b36d67456997b35682a066dbc9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.769807 22111 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.768886 25068 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.772828 25068 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.775053 25068 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:19.778229 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84b376f41e049819a74ea69b90cd298" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796"
I20260709 12:27:19.778802 22737 raft_consensus.cc:3060] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.785333 25068 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.786047 25068 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:19.772352 22111 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.790261 22144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:19.790526 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:19.790933 22144 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:19.791195 22143 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:19.792557 22737 raft_consensus.cc:2468] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:19.792946 22213 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a50b2f586448c49281a6618c40a1f7 in term 7.
W20260709 12:27:19.794337 22185 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.796674 24900 consensus_queue.cc:237] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:19.803193 22184 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.794701 25068 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:19.823145 22184 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:19.827834 25051 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:19.828276 25051 raft_consensus.cc:493] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.828671 25051 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:19.828881 22111 consensus_peers.cc:597] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.833840 22213 raft_consensus.cc:2955] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:19.835788 22143 raft_consensus.cc:1275] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:19.838188 22111 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:19.839035 25085 raft_consensus.cc:2804] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:19.840505 22211 raft_consensus.cc:1275] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:19.838037 25051 raft_consensus.cc:515] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:19.843715 22185 leader_election.cc:336] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.844419 20873 tablet_replica.cc:333] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:19.845224 20873 raft_consensus.cc:2243] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.845780 20873 raft_consensus.cc:2272] T 2100de7ab7b84cf39a4370858e9b6927 P c9a50b2f586448c49281a6618c40a1f7 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:19.853904 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:19.843312 25068 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:19.851293 25043 consensus_queue.cc:1048] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:27:19.851379 25085 raft_consensus.cc:697] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:19.867471 25085 consensus_queue.cc:237] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:19.853849 25059 consensus_queue.cc:1048] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:27:19.871098 21953 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66ecbcd398b0449b86b36309434ca3d1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:19.877655 25068 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.878139 25068 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:19.878770 22185 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.800714 25098 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.883797 25098 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:19.885629 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62526c368b43448e83c05dfd4e5aeaf3" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:19.886250 22211 raft_consensus.cc:3060] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.890604 25051 leader_election.cc:290] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:19.893977 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2973e4920541d9ba2cb2c911dbab09" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:19.894603 22145 raft_consensus.cc:3060] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.895372 22211 raft_consensus.cc:2468] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 7.
I20260709 12:27:19.852546 24957 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:19.863157 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:19.899071 22111 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:27:19.907609 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 44668.1us
I20260709 12:27:19.906165 22145 raft_consensus.cc:2468] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
W20260709 12:27:19.901501 22185 leader_election.cc:336] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.919008 22184 leader_election.cc:304] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:19.920341 22111 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:19.924211 25056 raft_consensus.cc:2804] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:19.925863 25056 raft_consensus.cc:697] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:19.926762 25056 consensus_queue.cc:237] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.931200 20873 tablet_replica.cc:333] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:19.932422 20873 raft_consensus.cc:2243] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:19.942737 20873 raft_consensus.cc:2272] T cb9f575e2f52433abc7aeff041ddb880 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:19.937800 25045 raft_consensus.cc:2804] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:19.946435 21965 catalog_manager.cc:5697] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.961774 21965 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 7 to 9, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 9 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:19.979828 21965 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 4 to 5, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:19.968087 24954 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.981455 21965 catalog_manager.cc:5697] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 4 to 5, leader changed from be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:19.982296 24954 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.968639 25051 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:19.988692 25051 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.991151 25051 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:19.995468 22185 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:19.970122 24957 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:19.971781 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5597e9e8004903a03d0ac57b864069" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:19.974555 22733 raft_consensus.cc:1275] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:19.997695 25068 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:19.978761 21963 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48108 (request call id 307) took 1934 ms. Trace:
I20260709 12:27:19.997619 22211 raft_consensus.cc:3060] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.999966 25068 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:19.999037 21963 rpcz_store.cc:276] 0709 12:27:18.059262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.059470 (+   208us) service_pool.cc:224] Handling call
0709 12:27:19.978671 (+1919201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:19.434361 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:19.434919 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:19.434950 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:27:19.434967 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:19.527922 (+ 92955us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:19.528038 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:19.528079 (+    41us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:27:19.530002 (+  1923us) tablet.cc:701] Row locks acquired
0709 12:27:19.530026 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:27:19.530229 (+   203us) write_op.cc:270] Start()
0709 12:27:19.530383 (+   154us) write_op.cc:276] Timestamp: P: 1783600039530166 usec, L: 0
0709 12:27:19.530411 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:27:19.593010 (+ 62599us) log.cc:844] Serialized 7886 byte log entry
0709 12:27:19.793658 (+200648us) op_driver.cc:464] REPLICATION: finished
0709 12:27:19.865622 (+ 71964us) write_op.cc:301] APPLY: starting
0709 12:27:19.865711 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:19.866098 (+   387us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:19.866233 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:19.874869 (+  8636us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:19.875188 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:27:19.875233 (+    45us) write_op.cc:312] APPLY: finished
0709 12:27:19.875718 (+   485us) log.cc:844] Serialized 139 byte log entry
0709 12:27:19.876573 (+   855us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:19.876764 (+   191us) write_op.cc:454] Released schema lock
0709 12:27:19.876820 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:19.881401 (+  4581us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:19.881435 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75995,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":71716,"apply.run_cpu_time_us":4357,"apply.run_wall_time_us":15715,"num_ops":20,"prepare.queue_time_us":200566,"prepare.run_cpu_time_us":7526,"prepare.run_wall_time_us":209252,"replication_time_us":263082,"thread_start_us":134271,"threads_started":2}]]}
I20260709 12:27:20.002774 25045 raft_consensus.cc:697] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:20.003752 25045 consensus_queue.cc:237] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.005323 25088 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.005972 25088 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.008208 25088 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:20.008670 22211 raft_consensus.cc:2468] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:19.986145 21965 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 5 to 6, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.010812 21965 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 4 to 5, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 5 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:20.013188 21965 catalog_manager.cc:5697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 3, leader changed from ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) to c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65). New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:20.013659 25087 consensus_queue.cc:1048] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:20.030383 22211 raft_consensus.cc:1275] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:20.015653 21965 catalog_manager.cc:5697] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:20.032362 21965 catalog_manager.cc:5697] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
W20260709 12:27:20.033066 22185 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.023780 22111 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:20.036630 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:20.036248 21965 catalog_manager.cc:5697] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c9a50b2f586448c49281a6618c40a1f7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:20.039009 20873 tablet_replica.cc:333] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.039937 20873 raft_consensus.cc:2243] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.040607 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2610abde2b26405b8b88ae11fb975d64" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:20.041214 22145 raft_consensus.cc:3060] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.045037 20873 raft_consensus.cc:2272] T e3caebc0658346798308160a170ffc71 P c9a50b2f586448c49281a6618c40a1f7 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.047389 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:20.048987 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:20.039502 24957 raft_consensus.cc:2804] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:27:20.054558 21953 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 69817.1us
I20260709 12:27:20.062204 22145 raft_consensus.cc:2468] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
W20260709 12:27:20.062830 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:20.064944 22111 consensus_peers.cc:597] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:20.065587 22111 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:20.066493 22111 consensus_peers.cc:597] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.054543 25043 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.072510 20873 tablet_replica.cc:333] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.070016 25085 consensus_queue.cc:1048] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 12:27:20.085278 22185 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.075734 20873 raft_consensus.cc:2243] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.087641 24954 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:20.107410 21953 catalog_manager.cc:4755] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bf83ee90e33b4083aebda67b32ca1149: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:27:20.064608 24957 raft_consensus.cc:697] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:20.114838 24957 consensus_queue.cc:237] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.102778 25056 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.119331 25056 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.137537 22733 raft_consensus.cc:1275] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:27:20.145112 24900 consensus_queue.cc:1048] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:20.158985 22185 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.159608 22185 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:20.161041 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:20.162381 22185 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.177505 25087 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.201018 22146 raft_consensus.cc:1275] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:20.207162 22146 raft_consensus.cc:1275] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:20.210721 22184 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:20.212872 25051 raft_consensus.cc:2804] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:20.213392 25051 raft_consensus.cc:697] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:20.214273 25051 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.216470 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:20.217201 22145 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:20.220817 25068 consensus_queue.cc:1048] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:20.226220 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 62947.5us
W20260709 12:27:20.228396 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:20.229099 25056 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:20.232120 25068 consensus_queue.cc:1048] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:20.234737 20873 raft_consensus.cc:2272] T 8a5dc4546d94416ab0e98aa60a0074b9 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:20.238018 22185 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.239164 20873 tablet_replica.cc:333] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.240064 20873 raft_consensus.cc:2243] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:20.241199 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:20.245260 20873 raft_consensus.cc:2272] T 33d4294bcbec49ad88c8ce7c879b596d P c9a50b2f586448c49281a6618c40a1f7 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:20.247880 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:20.248210 20873 tablet_replica.cc:333] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.250804 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:20.251574 22216 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:20.252712 22111 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:20.253738 25056 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:20.254163 25056 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.254549 25056 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.266198 22184 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:20.249089 20873 raft_consensus.cc:2243] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:20.269955 25068 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:20.273849 25068 raft_consensus.cc:493] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.274377 25068 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:20.289007 22111 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.293947 21967 catalog_manager.cc:5697] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.309404 21967 catalog_manager.cc:5697] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.311534 21967 catalog_manager.cc:5697] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 6 to 7, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 7 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.315321 21967 catalog_manager.cc:5697] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 3 to 5, leader changed from 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.321485 21967 catalog_manager.cc:5697] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.284999 25056 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.333211 21965 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48106 (request call id 276) took 2022 ms. Trace:
I20260709 12:27:20.287793 25068 raft_consensus.cc:515] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.334049 21967 catalog_manager.cc:5697] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.353525 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8619cc30f64448bb01e0e927ff038d1" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:20.336462 21965 rpcz_store.cc:276] 0709 12:27:18.310733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.310963 (+   230us) service_pool.cc:224] Handling call
0709 12:27:20.333123 (+2022160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:20.064138 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:20.077106 (+ 12968us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:20.077146 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:27:20.077161 (+    15us) tablet.cc:662] Decoding operations
0709 12:27:20.078137 (+   976us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:20.078191 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:20.078221 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:27:20.079096 (+   875us) tablet.cc:701] Row locks acquired
0709 12:27:20.079137 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:27:20.079300 (+   163us) write_op.cc:270] Start()
0709 12:27:20.079416 (+   116us) write_op.cc:276] Timestamp: P: 1783600040079251 usec, L: 0
0709 12:27:20.079439 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:20.080086 (+   647us) log.cc:844] Serialized 3960 byte log entry
0709 12:27:20.088841 (+  8755us) op_driver.cc:464] REPLICATION: finished
0709 12:27:20.089460 (+   619us) write_op.cc:301] APPLY: starting
0709 12:27:20.089573 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:20.089930 (+   357us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:20.090060 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:20.091484 (+  1424us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:20.091846 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:27:20.091925 (+    79us) write_op.cc:312] APPLY: finished
0709 12:27:20.092335 (+   410us) log.cc:844] Serialized 77 byte log entry
0709 12:27:20.092584 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:20.092774 (+   190us) write_op.cc:454] Released schema lock
0709 12:27:20.092846 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:20.108227 (+ 15381us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:20.108283 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6788,"reported_tablets":41,"spinlock_wait_cycles":4352,"child_traces":[["op",{"apply.queue_time_us":328,"apply.run_cpu_time_us":3804,"apply.run_wall_time_us":9195,"num_ops":10,"prepare.queue_time_us":1989,"prepare.run_cpu_time_us":3939,"prepare.run_wall_time_us":26902,"replication_time_us":9202}]]}
I20260709 12:27:20.341797 20873 pending_rounds.cc:70] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Trying to abort 1 pending ops.
I20260709 12:27:20.354903 20873 pending_rounds.cc:77] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7: Aborting op as it isn't in flight: id { term: 9 index: 10 } timestamp: 7305625671711805440 op_type: NO_OP noop_request { }
I20260709 12:27:20.355288 20873 raft_consensus.cc:2889] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:20.355648 20873 raft_consensus.cc:2272] T c609d086e32e4033b7376f770a2790a6 P c9a50b2f586448c49281a6618c40a1f7 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.342128 25085 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.354233 22145 raft_consensus.cc:3060] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.356515 22731 raft_consensus.cc:1275] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:20.351142 25068 leader_election.cc:290] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:20.368016 20873 tablet_replica.cc:333] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.368836 20873 raft_consensus.cc:2243] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.368193 22145 raft_consensus.cc:2468] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:20.359562 25085 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.380596 25085 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:20.360985 24900 consensus_queue.cc:1048] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 12:27:20.385977 22185 leader_election.cc:336] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.393628 25056 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:20.407876 21963 catalog_manager.cc:5697] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 6 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.421308 21963 catalog_manager.cc:5697] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } }
I20260709 12:27:20.410881 22184 leader_election.cc:304] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:20.423321 25051 raft_consensus.cc:2804] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:20.423851 25051 raft_consensus.cc:697] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:20.424775 25051 consensus_queue.cc:237] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.419827 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:20.427381 22211 raft_consensus.cc:3060] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.428663 21963 catalog_manager.cc:5697] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 7 to 9, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 9 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.430473 21963 catalog_manager.cc:5697] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 6 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.431756 22731 raft_consensus.cc:1275] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:20.409518 20873 raft_consensus.cc:2272] T a029fe9d29df4ca38adc92d96e055bbd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.418562 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:20.435624 22216 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 4.
I20260709 12:27:20.437737 20873 tablet_replica.cc:333] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.438568 20873 raft_consensus.cc:2243] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.439622 20873 raft_consensus.cc:2272] T f8bfdf52fab442f6ab7ed33f99c33cf5 P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.447034 21963 catalog_manager.cc:5697] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 7 to 8, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 8 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.449617 22211 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:20.450963 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:20.452167 22111 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:20.453883 24957 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:20.462320 24957 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.448729 21963 catalog_manager.cc:5697] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 4 to 6, VOTER c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) evicted. New cstate: current_term: 5 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:20.458923 22185 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.462870 20873 tablet_replica.cc:333] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.462877 24957 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.464912 21963 catalog_manager.cc:5697] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 6 to 7, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 7 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.469920 21963 catalog_manager.cc:5697] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 7, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 7 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.466249 20873 raft_consensus.cc:2243] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.469836 24900 raft_consensus.cc:2804] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:20.478312 24900 raft_consensus.cc:697] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:20.479233 24900 consensus_queue.cc:237] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.485775 20873 raft_consensus.cc:2272] T bbe117f2cdc04fab8acb64e91252db18 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.494316 22211 raft_consensus.cc:1275] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:20.516685 24957 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.520117 20873 tablet_replica.cc:333] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.533424 20873 raft_consensus.cc:2243] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:20.537288 20873 raft_consensus.cc:2272] T 51286e1e6cac4310b4960b85e10b91cd P c9a50b2f586448c49281a6618c40a1f7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.537074 25059 consensus_queue.cc:1048] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 12:27:20.547900 22702 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 209 similar messages]
I20260709 12:27:20.538818 24957 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:20.568197 20873 tablet_replica.cc:333] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.569012 20873 raft_consensus.cc:2243] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:27:20.573028 22111 consensus_peers.cc:597] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:20.573693 22111 consensus_peers.cc:597] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.573902 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28acb7e5630c4b1da2fa7d2abca24a62" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:20.574548 22211 raft_consensus.cc:3060] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.587476 22211 raft_consensus.cc:2468] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
W20260709 12:27:20.588960 22111 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:20.590193 22111 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.590335 20873 raft_consensus.cc:2272] T 68525dff5d9a48b9906b79db6bffb969 P c9a50b2f586448c49281a6618c40a1f7 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:20.591091 22111 consensus_peers.cc:597] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.593931 22111 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:20.597160 24957 consensus_queue.cc:1048] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:20.605618 24900 raft_consensus.cc:2804] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:20.607976 24900 raft_consensus.cc:697] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:20.611047 24900 consensus_queue.cc:237] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:20.612125 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:20.613735 20873 tablet_replica.cc:333] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7: stopping tablet replica
I20260709 12:27:20.613317 21967 catalog_manager.cc:5697] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 3 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:20.614516 20873 raft_consensus.cc:2243] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:20.614903 21967 catalog_manager.cc:5697] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:20.619514 25087 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.620246 25087 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.623386 20873 raft_consensus.cc:2272] T 8800ea1c1a5648149433c4b68674d692 P c9a50b2f586448c49281a6618c40a1f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:20.625871 25087 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:20.627928 22185 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.661206 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:20.661898 22142 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
W20260709 12:27:20.662834 22111 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.663007 22143 raft_consensus.cc:1275] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:20.693085 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:20.693867 25087 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:20.694260 25087 raft_consensus.cc:493] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.694612 25087 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.697160 25066 consensus_queue.cc:1048] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 12:27:20.713768 22111 consensus_peers.cc:597] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.719034 21965 catalog_manager.cc:5697] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.726384 21965 catalog_manager.cc:5697] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 4 to 5, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 5 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.728145 21965 catalog_manager.cc:5697] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 6 to 7, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 7 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:20.752840 25066 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.759464 25066 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:20.733322 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:20.731896 25051 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
W20260709 12:27:20.745124 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:20.750450 25087 raft_consensus.cc:515] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:20.731683 22111 consensus_peers.cc:597] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:20.766389 25051 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.771023 22143 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:20.775488 25088 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:20.776623 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.777518 25066 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:20.783053 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:20.785542 22143 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:20.758720 21965 catalog_manager.cc:5697] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.795174 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d458721d04ad184247f1a1926d3fa" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:20.795822 22142 raft_consensus.cc:3060] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.796831 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:20.799329 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:20.800910 25088 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:20.804353 25088 raft_consensus.cc:493] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.807114 25088 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.790207 21965 catalog_manager.cc:5697] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 3 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:20.869553 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 64251.1us
I20260709 12:27:20.870061 22142 raft_consensus.cc:2468] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
I20260709 12:27:20.872481 22211 raft_consensus.cc:1275] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:20.875710 22184 leader_election.cc:304] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:20.780946 25051 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:20.879632 25066 raft_consensus.cc:2804] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:20.871543 25087 leader_election.cc:290] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:20.880872 24957 consensus_queue.cc:1048] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:27:20.891746 25066 raft_consensus.cc:697] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:27:20.908593 22185 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:20.910210 22185 leader_election.cc:336] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.904712 25066 consensus_queue.cc:237] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:20.922307 22185 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.922741 22185 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:20.924784 25045 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.933959 25088 raft_consensus.cc:515] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:20.956449 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:20.967629 24957 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:20.979478 24957 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:20.981431 24957 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:20.983091 22185 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:20.989558 21967 catalog_manager.cc:5697] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 7 to 8, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 8 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.991415 21967 catalog_manager.cc:5697] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 6 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.994383 25088 leader_election.cc:290] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:20.995184 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:20.995965 22216 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 8.
W20260709 12:27:20.998915 22111 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:20.999615 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:20.995278 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522ffe0721f94fd69f4df0687f606515" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:21.000764 22145 raft_consensus.cc:3060] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:21.000272 22185 leader_election.cc:336] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.008951 22145 raft_consensus.cc:2468] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
I20260709 12:27:21.024411 25059 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:21.024955 25059 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.025362 25059 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.034873 25059 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.040923 22184 leader_election.cc:304] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:21.043326 25112 raft_consensus.cc:2804] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:21.043566 25059 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:21.050894 25112 raft_consensus.cc:697] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:21.046382 21963 catalog_manager.cc:5697] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 7 to 8, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 8 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:21.051932 25112 consensus_queue.cc:237] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.079511 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:21.080158 22216 raft_consensus.cc:3060] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.087879 22216 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 9.
I20260709 12:27:21.094293 21963 catalog_manager.cc:5697] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 6 to 8, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 8 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:21.097754 25056 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.098413 25056 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:21.100319 22143 raft_consensus.cc:1275] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:21.100555 25056 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:21.104835 22211 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:21.107378 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:21.107772 25112 consensus_queue.cc:1048] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:21.112857 22111 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:21.113679 25056 raft_consensus.cc:2804] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:21.114185 25056 raft_consensus.cc:697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:21.115042 25056 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:21.147150 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:21.139433 25059 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:27:21.163661 22216 raft_consensus.cc:1275] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:21.186944 21967 catalog_manager.cc:5697] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 4 to 5, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 5 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:21.201933 22111 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:21.206115 22111 leader_election.cc:336] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.213058 22111 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:21.218948 24900 raft_consensus.cc:2749] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:21.226559 22111 consensus_peers.cc:597] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:21.230325 24900 consensus_queue.cc:1048] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 12:27:21.255553 22111 consensus_peers.cc:597] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:21.295089 25013 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.295691 25013 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:21.297897 25066 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.298487 25066 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.300712 25066 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.303366 25013 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.350744 21967 catalog_manager.cc:5697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 8 to 9, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 9 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.360064 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:21.367456 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:21.361745 22143 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 7.
I20260709 12:27:21.389830 22184 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:21.392896 25132 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:21.393484 25132 raft_consensus.cc:493] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.393960 25132 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.368834 22145 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 9.
I20260709 12:27:21.401149 22701 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:21.405092 21953 catalog_manager.cc:4755] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 66ecbcd398b0449b86b36309434ca3d1: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:27:21.414068 25013 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:21.414716 25013 raft_consensus.cc:493] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.416417 25013 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:21.431052 22185 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:21.434782 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:21.442696 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:21.446152 22702 leader_election.cc:336] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:21.456396 25056 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.457520 25056 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:21.461571 22702 connection.cc:769] client connection to 127.20.98.65:40323 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:27:21.473449 25056 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:21.476922 22213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:21.490773 25132 raft_consensus.cc:515] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.491735 22145 raft_consensus.cc:1275] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:21.496662 25112 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.501349 25112 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.505326 25112 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:21.518117 22111 connection.cc:769] client connection to 127.20.98.65:40323 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:27:21.518903 22111 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:27:21.519486 22111 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:21.521044 25056 raft_consensus.cc:2749] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:21.523268 22037 connection.cc:466] server connection from 127.0.0.1:54730 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1734) could send its response
I20260709 12:27:21.517282 25088 consensus_queue.cc:1048] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:27:21.529031 22213 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:21.529851 25132 leader_election.cc:290] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.530979 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:21.550700 25013 raft_consensus.cc:515] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:21.554476 20873 connection.cc:466] server connection from 127.0.0.1:54730 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54730 (request call id 1732) could send its response
W20260709 12:27:21.555181 20873 connection.cc:466] server connection from 127.0.0.1:54730 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54730 (request call id 1733) could send its response
W20260709 12:27:21.558326 22185 connection.cc:769] client connection to 127.20.98.65:40323 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 12:27:21.581571 24900 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:21.582741 22146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57c1d6eaa044fe58248b797147f51d0" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:21.583402 22146 raft_consensus.cc:3060] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.583591 25013 leader_election.cc:290] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.586591 22145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3caebc0658346798308160a170ffc71" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:21.587199 22145 raft_consensus.cc:3060] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.580929 22143 raft_consensus.cc:1275] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:21.601859 25132 consensus_queue.cc:1048] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:21.604179 22146 raft_consensus.cc:2468] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
I20260709 12:27:21.608853 22145 raft_consensus.cc:2468] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 10.
I20260709 12:27:21.611832 22701 leader_election.cc:304] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:21.612792 25023 raft_consensus.cc:2804] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:21.614549 25023 raft_consensus.cc:697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 10 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:21.615960 25023 consensus_queue.cc:237] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:21.610921 22184 leader_election.cc:304] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:27:21.618527 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:21.620635 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:21.622660 22702 leader_election.cc:336] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.635281 25066 raft_consensus.cc:2804] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:21.635957 25066 raft_consensus.cc:697] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:21.637252 25066 consensus_queue.cc:237] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.712724 25132 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.714121 25132 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:21.717500 22111 consensus_peers.cc:597] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:21.726826 25132 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.732508 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:21.734638 25056 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.735723 25056 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.738325 25056 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:21.738512 24900 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.739341 24900 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.742023 24900 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:21.743811 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
W20260709 12:27:21.746650 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:21.747792 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.749063 22185 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:21.750218 24900 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.750312 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:21.751006 24900 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.751516 25088 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.752146 25088 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.753337 24900 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:21.753995 22111 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.754462 22111 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:21.754690 25088 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.754815 25142 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:21.756131 22185 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:21.760353 25056 raft_consensus.cc:2749] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:21.758215 21963 catalog_manager.cc:5697] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 9 to 10, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 10 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:21.756834 22185 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:21.764853 22185 leader_election.cc:336] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.767184 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:21.767879 22211 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
W20260709 12:27:21.770215 22111 leader_election.cc:336] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.770725 22111 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:21.774514 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:21.773478 25056 raft_consensus.cc:2749] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:21.775068 22142 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:21.782343 25056 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.782692 22111 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:21.785444 25056 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:21.787902 25056 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:21.788048 22184 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:21.789513 25132 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:21.789973 25132 raft_consensus.cc:493] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.790396 25132 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:21.790891 22111 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.788508 24957 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:21.796686 24957 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.797271 24957 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:21.798193 22111 leader_election.cc:336] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.806020 25132 raft_consensus.cc:515] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.809419 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029fe9d29df4ca38adc92d96e055bbd" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:21.810017 22143 raft_consensus.cc:3060] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.819017 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:21.823706 22143 raft_consensus.cc:2468] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 6.
I20260709 12:27:21.824035 24957 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.827466 22184 leader_election.cc:304] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:21.828032 24957 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:21.828954 25066 raft_consensus.cc:2804] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:21.829591 25066 raft_consensus.cc:697] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:21.831208 25066 consensus_queue.cc:237] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.834940 25132 leader_election.cc:290] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:21.837067 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:21.839084 22211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5dc4546d94416ab0e98aa60a0074b9" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:21.839687 22211 raft_consensus.cc:3060] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.834187 21963 catalog_manager.cc:5697] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 8, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 8 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:21.846792 22185 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.847270 22185 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:21.848011 25132 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:21.848304 22185 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.850672 22111 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: c9a50b2f586448c49281a6618c40a1f7, ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:21.851588 24957 raft_consensus.cc:2749] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:21.848019 22211 raft_consensus.cc:2468] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:21.861364 22111 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:21.862136 24957 raft_consensus.cc:2804] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:21.862619 24957 raft_consensus.cc:697] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:21.863612 24957 consensus_queue.cc:237] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:21.877455 22111 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:21.881667 22185 leader_election.cc:336] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.886646 25132 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.887316 25132 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.889536 25132 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.898371 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:21.899041 22142 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 3.
I20260709 12:27:21.905406 22184 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
I20260709 12:27:21.906350 25132 raft_consensus.cc:2804] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.906821 25132 raft_consensus.cc:493] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.907279 25132 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:21.914880 22185 leader_election.cc:336] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.915740 21963 catalog_manager.cc:5697] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.929019 24957 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.936664 24957 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:21.938969 24957 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:21.954725 24945 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.955479 24945 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:21.958099 24945 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:21.959220 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:21.959918 22143 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 3.
I20260709 12:27:21.961243 22701 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
W20260709 12:27:21.964550 22702 leader_election.cc:336] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:21.965559 24945 raft_consensus.cc:2804] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:21.966003 24945 raft_consensus.cc:493] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:21.966382 24945 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:21.974647 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:22.004251 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:22.005218 22216 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 5.
I20260709 12:27:21.954136 25132 raft_consensus.cc:515] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:22.027403 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: 
W20260709 12:27:22.036648 22185 leader_election.cc:336] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:22.043467 24945 raft_consensus.cc:515] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:22.046556 24945 leader_election.cc:290] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:22.046742 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbe117f2cdc04fab8acb64e91252db18" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:22.047353 22143 raft_consensus.cc:3060] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.050763 21963 catalog_manager.cc:5697] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 6 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.059223 22143 raft_consensus.cc:2468] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 4.
I20260709 12:27:22.060585 22701 leader_election.cc:304] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, ed678a3f9e3d4e0ba5801f1663548796; no voters: 
I20260709 12:27:22.061985 24945 raft_consensus.cc:2804] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:22.062777 24945 raft_consensus.cc:697] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Becoming Leader. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Running, Role: LEADER
I20260709 12:27:22.064881 24945 consensus_queue.cc:237] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:22.073956 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 46615.3us
I20260709 12:27:22.073585 24957 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:22.077926 24957 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:22.078317 24957 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.075423 25066 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:22.081810 25066 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:22.094743 25066 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:22.095505 25132 leader_election.cc:290] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:22.088967 24957 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:22.104704 24957 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:22.127987 22185 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:22.129083 22142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8800ea1c1a5648149433c4b68674d692" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:22.129848 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
I20260709 12:27:22.130687 22143 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 8.
I20260709 12:27:22.130021 22142 raft_consensus.cc:3060] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.138360 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bfdf52fab442f6ab7ed33f99c33cf5" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b"
I20260709 12:27:22.138949 22216 raft_consensus.cc:3060] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:22.139727 22111 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:22.146800 21963 catalog_manager.cc:5697] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: term changed from 3 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "ed678a3f9e3d4e0ba5801f1663548796" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.151281 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:22.153239 25045 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:22.153640 25045 raft_consensus.cc:493] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Starting leader election (detected failure of leader c9a50b2f586448c49281a6618c40a1f7)
I20260709 12:27:22.154035 25045 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:22.154229 22185 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:22.162369 22111 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:22.173194 22146 raft_consensus.cc:1275] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:22.173707 22216 raft_consensus.cc:2468] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f0d4cf04de40aa9e25849fb2380466 in term 6.
I20260709 12:27:22.179755 25045 raft_consensus.cc:515] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:22.183066 25045 leader_election.cc:290] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: Requested vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:22.180881 22702 leader_election.cc:336] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:22.184306 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:22.184854 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.186427 22142 raft_consensus.cc:2468] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 4.
I20260709 12:27:22.188151 25066 consensus_queue.cc:1048] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:22.190876 22142 raft_consensus.cc:1275] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 10 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:22.192420 24945 consensus_queue.cc:1048] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:27:22.199743 22185 leader_election.cc:336] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:22.202030 22184 leader_election.cc:304] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:22.203485 25066 raft_consensus.cc:2804] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:22.204025 25066 raft_consensus.cc:697] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
I20260709 12:27:22.205068 25066 consensus_queue.cc:237] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:22.208359 22143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68525dff5d9a48b9906b79db6bffb969" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466"
I20260709 12:27:22.209013 22143 raft_consensus.cc:3060] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:22.219879 22143 raft_consensus.cc:2468] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
I20260709 12:27:22.221190 22111 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:22.223104 25056 raft_consensus.cc:2804] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:22.223680 25056 raft_consensus.cc:697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Becoming Leader. State: Replica: 85f0d4cf04de40aa9e25849fb2380466, State: Running, Role: LEADER
I20260709 12:27:22.225412 25056 consensus_queue.cc:237] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:22.221010 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:22.251767 22184 leader_election.cc:304] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b; no voters: c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:22.262844 25132 raft_consensus.cc:2804] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:22.263549 25132 raft_consensus.cc:697] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 9 LEADER]: Becoming Leader. State: Replica: be238c1de63840f9bb041e2f9ba58d2b, State: Running, Role: LEADER
W20260709 12:27:22.268385 22185 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.264611 25132 consensus_queue.cc:237] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:22.295758 22185 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:22.305444 22185 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.328871 22142 raft_consensus.cc:1275] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:22.343143 21963 catalog_manager.cc:5697] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 3 to 4, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 4 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.342347 25088 consensus_queue.cc:1048] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:27:22.359226 22216 raft_consensus.cc:1275] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:22.363736 21967 catalog_manager.cc:5697] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: term changed from 5 to 6, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:22.371815 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:22.372491 25059 consensus_queue.cc:1048] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 12:27:22.387399 22111 consensus_peers.cc:597] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.450791 21967 catalog_manager.cc:5697] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: term changed from 8 to 9, leader changed from c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65) to be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67). New cstate: current_term: 9 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:22.453513 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:22.493224 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:22.531193 22111 consensus_peers.cc:597] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:22.545258 22111 consensus_peers.cc:597] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.566805 22143 raft_consensus.cc:1275] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer ed678a3f9e3d4e0ba5801f1663548796: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:22.568418 25167 consensus_queue.cc:1048] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:22.568904 20873 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22092)
W20260709 12:27:22.569029 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:22.589936 22017 auto_rebalancer.cc:629] Failed to schedule move for tablet f8bfdf52fab442f6ab7ed33f99c33cf5: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:27:22.602768 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:22.604950 22185 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:22.611335 22145 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:22.630095 22216 raft_consensus.cc:1275] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:22.636025 24900 consensus_queue.cc:1048] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:27:22.640066 22185 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.662719 22143 raft_consensus.cc:1275] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:22.666065 25170 consensus_queue.cc:1048] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:27:22.670151 22111 consensus_peers.cc:597] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:22.682456 21953 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 49665.8us
W20260709 12:27:22.685753 21953 catalog_manager.cc:4755] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bf83ee90e33b4083aebda67b32ca1149: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:22.729861 22185 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:22.743050 22185 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.749074 22211 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:22.790311 24957 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:27:22.839687 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:22.858937 22111 consensus_peers.cc:597] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd094bd2058d4b6d9810ece12a93d849. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:22.860021 22111 consensus_peers.cc:597] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:22.910902 24957 raft_consensus.cc:2955] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:27:22.930166 22143 raft_consensus.cc:1275] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:22.951241 22216 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
W20260709 12:27:22.997665 22111 consensus_peers.cc:597] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:23.001468 22111 consensus_peers.cc:597] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:23.033345 22216 raft_consensus.cc:2955] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:27:23.044211 25132 consensus_queue.cc:1048] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:23.084309 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2610abde2b26405b8b88ae11fb975d64. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:23.086225 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:23.114607 22185 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:23.136969 21963 catalog_manager.cc:5697] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 7, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 9 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.143710 22142 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:23.186051 25142 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:27:23.206238 22111 consensus_peers.cc:597] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:23.211385 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:23.233727 22111 consensus_peers.cc:597] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:23.243444 22111 consensus_peers.cc:597] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:23.287778 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 103914us
I20260709 12:27:23.350592 25184 ts_tablet_manager.cc:933] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:23.364780 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:23.367581 25170 raft_consensus.cc:2955] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
W20260709 12:27:23.373391 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:23.389693 22142 raft_consensus.cc:2955] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:27:23.391860 25184 tablet_copy_client.cc:323] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:27:23.402110 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet cd094bd2058d4b6d9810ece12a93d849 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:27:23.402698 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet cd094bd2058d4b6d9810ece12a93d849 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-cd094bd2058d4b6d9810ece12a93d849
I20260709 12:27:23.406653 22146 consensus_queue.cc:237] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:23.411104 22156 tablet_copy_source_session.cc:215] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:23.418687 25184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd094bd2058d4b6d9810ece12a93d849. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:23.447880 22111 consensus_peers.cc:597] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:23.503772 21967 catalog_manager.cc:5697] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 7, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 8 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:27:23.518370 22216 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:23.522523 24957 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:27:23.529853 22111 consensus_peers.cc:597] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:23.531258 22111 consensus_peers.cc:597] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 -> Peer ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299): Couldn't send request to peer ed678a3f9e3d4e0ba5801f1663548796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b5c193cc2e540dbbc926df1219ef72b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:23.551164 25059 raft_consensus.cc:2955] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:27:23.557184 22211 raft_consensus.cc:2955] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } } }
I20260709 12:27:23.562014 25189 ts_tablet_manager.cc:933] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:23.565249 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:23.569466 20873 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22092)
I20260709 12:27:23.588155 25189 tablet_copy_client.cc:323] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.67:39245
I20260709 12:27:23.591979 22229 tablet_copy_service.cc:140] P be238c1de63840f9bb041e2f9ba58d2b: Received BeginTabletCopySession request for tablet 2610abde2b26405b8b88ae11fb975d64 from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:37180)
I20260709 12:27:23.592594 22229 tablet_copy_service.cc:161] P be238c1de63840f9bb041e2f9ba58d2b: Beginning new tablet copy session on tablet 2610abde2b26405b8b88ae11fb975d64 from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:37180: session id = ed678a3f9e3d4e0ba5801f1663548796-2610abde2b26405b8b88ae11fb975d64
I20260709 12:27:23.594149 21967 catalog_manager.cc:5697] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index -1 to 5, NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) added. New cstate: current_term: 5 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.608070 22229 tablet_copy_source_session.cc:215] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:27:23.609314 22185 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:23.619714 22111 consensus_peers.cc:597] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:23.624361 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2610abde2b26405b8b88ae11fb975d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:23.631842 25184 tablet_copy_client.cc:806] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:23.632865 25184 tablet_copy_client.cc:670] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:23.656621 25184 tablet_copy_client.cc:538] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:27:23.665509 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:23.676005 22185 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:23.680685 25184 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
I20260709 12:27:23.713917 25189 tablet_copy_client.cc:806] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:23.714685 25189 tablet_copy_client.cc:670] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:23.731267 25189 tablet_copy_client.cc:538] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:23.744397 25189 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
W20260709 12:27:23.849123 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:23.867486 25189 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:23.868580 25189 tablet_bootstrap.cc:492] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:27:23.876526 25184 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:23.877681 25184 tablet_bootstrap.cc:492] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:27:23.878407 25184 ts_tablet_manager.cc:1403] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.198s	user 0.044s	sys 0.032s
I20260709 12:27:23.886425 25184 raft_consensus.cc:359] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:23.887373 25184 raft_consensus.cc:740] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:27:23.888094 25184 consensus_queue.cc:260] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:23.890970 25184 ts_tablet_manager.cc:1434] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:27:23.891373 25189 ts_tablet_manager.cc:1403] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.135s	user 0.035s	sys 0.025s
I20260709 12:27:23.905361 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-cd094bd2058d4b6d9810ece12a93d849 received from {username='slave'} at 127.0.0.1:56596
I20260709 12:27:23.905958 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-cd094bd2058d4b6d9810ece12a93d849 on tablet cd094bd2058d4b6d9810ece12a93d849 with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:23.907943 25189 raft_consensus.cc:359] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:23.908857 25189 raft_consensus.cc:740] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:27:23.917647 25189 consensus_queue.cc:260] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:23.920982 25189 ts_tablet_manager.cc:1434] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:27:23.922878 22229 tablet_copy_service.cc:342] P be238c1de63840f9bb041e2f9ba58d2b: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2610abde2b26405b8b88ae11fb975d64 received from {username='slave'} at 127.0.0.1:37180
I20260709 12:27:23.923324 22229 tablet_copy_service.cc:434] P be238c1de63840f9bb041e2f9ba58d2b: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2610abde2b26405b8b88ae11fb975d64 on tablet 2610abde2b26405b8b88ae11fb975d64 with peer ed678a3f9e3d4e0ba5801f1663548796
W20260709 12:27:23.938532 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:23.948207 22737 raft_consensus.cc:1217] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
W20260709 12:27:23.983124 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:23.998936 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:24.029740 22185 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:24.048249 25189 ts_tablet_manager.cc:933] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: Initiating tablet copy from peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:24.075162 25189 tablet_copy_client.cc:323] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Beginning tablet copy session from remote peer at address 127.20.98.66:42771
I20260709 12:27:24.077037 22156 tablet_copy_service.cc:140] P 85f0d4cf04de40aa9e25849fb2380466: Received BeginTabletCopySession request for tablet 2b5c193cc2e540dbbc926df1219ef72b from peer ed678a3f9e3d4e0ba5801f1663548796 ({username='slave'} at 127.0.0.1:56596)
I20260709 12:27:24.077651 22156 tablet_copy_service.cc:161] P 85f0d4cf04de40aa9e25849fb2380466: Beginning new tablet copy session on tablet 2b5c193cc2e540dbbc926df1219ef72b from peer ed678a3f9e3d4e0ba5801f1663548796 at {username='slave'} at 127.0.0.1:56596: session id = ed678a3f9e3d4e0ba5801f1663548796-2b5c193cc2e540dbbc926df1219ef72b
I20260709 12:27:24.086598 22156 tablet_copy_source_session.cc:215] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:24.098162 25189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c193cc2e540dbbc926df1219ef72b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:24.138687 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:24.157934 25189 tablet_copy_client.cc:806] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:24.158586 25189 tablet_copy_client.cc:670] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:24.163424 25189 tablet_copy_client.cc:538] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:24.207549 25189 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap starting.
W20260709 12:27:24.220332 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:24.308400 25189 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:24.323202 25189 tablet_bootstrap.cc:492] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: Bootstrap complete.
I20260709 12:27:24.323956 25189 ts_tablet_manager.cc:1403] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: Time spent bootstrapping tablet: real 0.136s	user 0.031s	sys 0.000s
I20260709 12:27:24.328862 25189 raft_consensus.cc:359] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:24.329770 25189 raft_consensus.cc:740] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: ed678a3f9e3d4e0ba5801f1663548796, State: Initialized, Role: LEARNER
I20260709 12:27:24.330451 25189 consensus_queue.cc:260] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: NON_VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: true } }
I20260709 12:27:24.349892 25189 ts_tablet_manager.cc:1434] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
W20260709 12:27:24.367946 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:24.407608 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:24.413735 22156 tablet_copy_service.cc:342] P 85f0d4cf04de40aa9e25849fb2380466: Request end of tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2b5c193cc2e540dbbc926df1219ef72b received from {username='slave'} at 127.0.0.1:56596
I20260709 12:27:24.414201 22156 tablet_copy_service.cc:434] P 85f0d4cf04de40aa9e25849fb2380466: ending tablet copy session ed678a3f9e3d4e0ba5801f1663548796-2b5c193cc2e540dbbc926df1219ef72b on tablet 2b5c193cc2e540dbbc926df1219ef72b with peer ed678a3f9e3d4e0ba5801f1663548796
I20260709 12:27:24.588725 22737 raft_consensus.cc:1217] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
W20260709 12:27:24.632074 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:24.632153 24957 raft_consensus.cc:1064] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
W20260709 12:27:24.644536 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 185346us
I20260709 12:27:24.642207 24957 consensus_queue.cc:237] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:24.686475 22737 raft_consensus.cc:1217] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
W20260709 12:27:24.721144 22111 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 81302.1us
W20260709 12:27:24.725939 22185 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:24.769909 22211 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:27:24.784554 22185 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:24.824704 22185 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:25.080420 21953 catalog_manager.cc:4755] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bf83ee90e33b4083aebda67b32ca1149: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:25.142264 22111 consensus_peers.cc:597] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:25.165920 25207 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:27:25.508884 22167 debug-util.cc:398] Leaking SignalData structure 0x7b08000b89a0 after lost signal to thread 20876
W20260709 12:27:25.510455 22167 debug-util.cc:398] Leaking SignalData structure 0x7b0800110fc0 after lost signal to thread 22002
W20260709 12:27:25.512075 22167 debug-util.cc:398] Leaking SignalData structure 0x7b0800111a20 after lost signal to thread 22170
W20260709 12:27:25.513671 22167 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2640 after lost signal to thread 22244
W20260709 12:27:25.515079 22167 debug-util.cc:398] Leaking SignalData structure 0x7b08002641c0 after lost signal to thread 22761
I20260709 12:27:25.539219 25208 raft_consensus.cc:493] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ed678a3f9e3d4e0ba5801f1663548796)
I20260709 12:27:25.539896 25208 raft_consensus.cc:515] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:25.544111 22111 consensus_peers.cc:597] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.542742 25208 leader_election.cc:290] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:25.549114 22111 leader_election.cc:336] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:25.551064 22111 consensus_peers.cc:597] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:25.561690 22702 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111) [suppressed 417 similar messages]
I20260709 12:27:25.589350 22216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:25.612975 22111 leader_election.cc:304] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 85f0d4cf04de40aa9e25849fb2380466; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:25.620715 25199 raft_consensus.cc:2749] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:25.627302 22111 consensus_peers.cc:597] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:25.651222 25211 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:25.668258 25211 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:25.670595 25211 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:25.680600 22111 consensus_peers.cc:597] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:25.714262 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 56401us
I20260709 12:27:25.722046 22733 raft_consensus.cc:1275] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:25.723920 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d935d1f5ca454cf6b73d0e33d7a7f51a" candidate_uuid: "85f0d4cf04de40aa9e25849fb2380466" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
W20260709 12:27:25.728298 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 70394.3us
I20260709 12:27:25.750672 22141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d7a413cca41acba7ba36bb13ce654" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "85f0d4cf04de40aa9e25849fb2380466" is_pre_election: true
W20260709 12:27:25.757355 22111 consensus_peers.cc:597] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:25.766307 22111 consensus_peers.cc:597] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:25.769986 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:25.777441 22185 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:25.777973 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:25.778654 22185 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:25.779213 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:25.780400 25059 consensus_queue.cc:1048] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:25.780102 22185 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:25.782737 25214 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:25.790491 25217 raft_consensus.cc:1064] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
I20260709 12:27:25.793062 25217 consensus_queue.cc:237] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:25.795411 22185 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:25.799335 22111 consensus_peers.cc:597] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:25.800922 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:25.801323 25059 raft_consensus.cc:1064] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: attempting to promote NON_VOTER ed678a3f9e3d4e0ba5801f1663548796 to VOTER
W20260709 12:27:25.801944 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:25.803987 25059 consensus_queue.cc:237] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:25.818286 22143 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:25.818818 22732 raft_consensus.cc:1275] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 LEARNER]: Refusing update from remote peer be238c1de63840f9bb041e2f9ba58d2b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:25.820684 25214 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:25.823309 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:25.823810 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:25.831670 25214 consensus_queue.cc:1048] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:25.849743 25208 raft_consensus.cc:2955] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.855192 22737 raft_consensus.cc:2955] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.859369 22214 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:27:25.860339 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.863286 24957 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:25.866439 22731 raft_consensus.cc:1275] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEARNER]: Refusing update from remote peer 85f0d4cf04de40aa9e25849fb2380466: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:25.869395 25217 raft_consensus.cc:2955] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.882763 25199 consensus_queue.cc:1048] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:25.890812 22111 consensus_peers.cc:597] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.895859 22732 raft_consensus.cc:2955] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.896888 21967 catalog_manager.cc:5697] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 reported cstate change: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.923352 22143 raft_consensus.cc:2955] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.948315 22214 raft_consensus.cc:2955] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.969709 22211 raft_consensus.cc:2955] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.944785 25059 raft_consensus.cc:2955] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
I20260709 12:27:25.985760 21963 catalog_manager.cc:5697] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b reported cstate change: config changed from index 7 to 8, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "be238c1de63840f9bb041e2f9ba58d2b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.009440 22185 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:26.034376 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:26.050683 22111 consensus_peers.cc:597] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:26.064695 22737 raft_consensus.cc:2955] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } } }
W20260709 12:27:26.073395 21998 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9c00 after lost signal to thread 20876
W20260709 12:27:26.074489 21998 debug-util.cc:398] Leaking SignalData structure 0x7b08003373e0 after lost signal to thread 22002
W20260709 12:27:26.075745 21998 debug-util.cc:398] Leaking SignalData structure 0x7b0800041640 after lost signal to thread 22170
W20260709 12:27:26.076807 21998 debug-util.cc:398] Leaking SignalData structure 0x7b0800077280 after lost signal to thread 22244
W20260709 12:27:26.079883 21998 debug-util.cc:398] Leaking SignalData structure 0x7b080026e500 after lost signal to thread 22761
W20260709 12:27:26.073457 22111 consensus_peers.cc:597] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.126381 21967 catalog_manager.cc:5697] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 reported cstate change: config changed from index 5 to 6, ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "85f0d4cf04de40aa9e25849fb2380466" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.132838 22185 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.155787 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
W20260709 12:27:26.169096 22111 consensus_peers.cc:597] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:26.189381 22185 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:26.231499 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:26.335183 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:26.483594 22185 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:26.576720 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:26.599332 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:26.665834 22185 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:26.688237 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
W20260709 12:27:26.708596 22184 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.709300 22184 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.714711 22701 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.717279 22701 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.718688 22701 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.749526 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:39245, user_credentials={real_user=slave}} blocked reactor thread for 57454.4us
W20260709 12:27:26.765954 22184 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.779672 22184 consensus_peers.cc:597] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.791111 22701 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.792502 22701 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.793093 22701 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.797137 22184 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.799144 22184 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.805284 22701 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.813325 22701 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.820696 22111 consensus_peers.cc:597] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:26.830026 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:26.866336 22701 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.875522 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:26.899956 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:26.915243 22701 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.932708 22701 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.933763 22184 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.932770 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:26.942368 22701 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.945598 22184 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.947880 20873 tablet_replica.cc:333] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:26.948884 20873 raft_consensus.cc:2243] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.949590 20873 raft_consensus.cc:2272] T 93141c9281524e9aaffe4907f7e32041 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.952438 20873 tablet_replica.cc:333] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
W20260709 12:27:26.953227 22184 consensus_peers.cc:597] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.953316 20873 raft_consensus.cc:2243] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.954130 20873 raft_consensus.cc:2272] T 522ffe0721f94fd69f4df0687f606515 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.956668 20873 tablet_replica.cc:333] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:26.957531 20873 raft_consensus.cc:2243] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:26.958750 20873 raft_consensus.cc:2272] T 7a5597e9e8004903a03d0ac57b864069 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.971438 20873 tablet_replica.cc:333] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:26.972385 20873 raft_consensus.cc:2243] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.973060 20873 raft_consensus.cc:2272] T b4ed5fd823f34d34b4fd87d49e53edb0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.976205 20873 tablet_replica.cc:333] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:26.977078 20873 raft_consensus.cc:2243] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:26.982080 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:26.982805 20873 raft_consensus.cc:2272] T e5f28925d2fc4ec39e677a2be96ca259 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.988103 20873 tablet_replica.cc:333] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
W20260709 12:27:26.988173 22701 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.989530 22701 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.993391 22184 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.989041 20873 raft_consensus.cc:2243] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:26.998364 20873 raft_consensus.cc:2272] T 0f24f68619f14d9e9de4306dd59b5709 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.001228 20873 tablet_replica.cc:333] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.002130 20873 raft_consensus.cc:2243] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.002815 20873 raft_consensus.cc:2272] T bf83ee90e33b4083aebda67b32ca1149 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.010792 22184 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.013654 20873 tablet_replica.cc:333] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.015269 20873 raft_consensus.cc:2243] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:27.015669 22701 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.015974 20873 raft_consensus.cc:2272] T 34d1a2cd4888492fad01161b84e51d77 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.019589 20873 tablet_replica.cc:333] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.020452 20873 raft_consensus.cc:2243] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.023864 20873 raft_consensus.cc:2272] T 66ecbcd398b0449b86b36309434ca3d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.031219 20873 tablet_replica.cc:333] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.032069 20873 raft_consensus.cc:2243] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.033280 20873 raft_consensus.cc:2272] T 5e3e126e4f1f4d82991ffddf4599b103 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.036018 20873 tablet_replica.cc:333] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.036847 20873 raft_consensus.cc:2243] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.038419 20873 raft_consensus.cc:2272] T f84b376f41e049819a74ea69b90cd298 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.053282 20873 tablet_replica.cc:333] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.054215 20873 raft_consensus.cc:2243] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.055418 20873 raft_consensus.cc:2272] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.059337 20873 tablet_replica.cc:333] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.060299 20873 raft_consensus.cc:2243] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.060987 20873 raft_consensus.cc:2272] T f2b9f971fd394d129cd62de001799b21 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.063874 20873 tablet_replica.cc:333] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.064637 20873 raft_consensus.cc:2243] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.065245 20873 raft_consensus.cc:2272] T 8d4304a0cf75473e8fd1d5791213f0a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.068091 20873 tablet_replica.cc:333] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.068893 20873 raft_consensus.cc:2243] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.090402 20873 raft_consensus.cc:2272] T 31f3273ca74242e9b116e3e87078ccef P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.093093 20873 tablet_replica.cc:333] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.093905 20873 raft_consensus.cc:2243] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:27.101676 22184 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.105521 20873 raft_consensus.cc:2272] T c66fbf1879e84a19b490058938a4bc34 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.108364 20873 tablet_replica.cc:333] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.109233 20873 raft_consensus.cc:2243] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:27.109457 22184 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.109829 20873 raft_consensus.cc:2272] T ec2973e4920541d9ba2cb2c911dbab09 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.112494 20873 tablet_replica.cc:333] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.113341 20873 raft_consensus.cc:2243] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.114254 20873 raft_consensus.cc:2272] T 2610abde2b26405b8b88ae11fb975d64 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.118140 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:27.125422 22701 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.130823 20873 tablet_replica.cc:333] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
W20260709 12:27:27.136974 22184 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.138707 20873 raft_consensus.cc:2243] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.139991 20873 raft_consensus.cc:2272] T 62526c368b43448e83c05dfd4e5aeaf3 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.142729 20873 tablet_replica.cc:333] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.143579 20873 raft_consensus.cc:2243] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:27.144074 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:27.144232 20873 raft_consensus.cc:2272] T a8619cc30f64448bb01e0e927ff038d1 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.145807 22184 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.155315 22185 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:27.175349 22701 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.187620 22184 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.188320 20873 tablet_replica.cc:333] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.189411 20873 raft_consensus.cc:2243] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.190021 20873 raft_consensus.cc:2272] T 40fdb108e6f14522a9ef82da47fc0b74 P 85f0d4cf04de40aa9e25849fb2380466 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.192636 20873 tablet_replica.cc:333] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.193373 20873 raft_consensus.cc:2243] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.194257 20873 raft_consensus.cc:2272] T f7b7dc5b82134cd492412751a2d63d9f P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.196830 20873 tablet_replica.cc:333] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.208635 20873 raft_consensus.cc:2243] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.209270 20873 raft_consensus.cc:2272] T 6a3d458721d04ad184247f1a1926d3fa P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.214032 22701 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.228099 20873 tablet_replica.cc:333] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.231241 20873 raft_consensus.cc:2243] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.231841 20873 raft_consensus.cc:2272] T 42a9ba8203ae4024af5885277061c1a3 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.242619 20873 tablet_replica.cc:333] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.243474 20873 raft_consensus.cc:2243] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.245009 20873 raft_consensus.cc:2272] T 2b5c193cc2e540dbbc926df1219ef72b P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.247627 20873 tablet_replica.cc:333] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.248413 20873 raft_consensus.cc:2243] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:27:27.251396 22184 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.257566 20873 raft_consensus.cc:2272] T 28acb7e5630c4b1da2fa7d2abca24a62 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.267086 20873 tablet_replica.cc:333] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.267933 20873 raft_consensus.cc:2243] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.268498 20873 raft_consensus.cc:2272] T 821557b36d67456997b35682a066dbc9 P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.271130 20873 tablet_replica.cc:333] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.293584 20873 raft_consensus.cc:2243] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.294308 20873 raft_consensus.cc:2272] T b43429b68f624c25ae86dad7e60ceb15 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.309281 20873 tablet_replica.cc:333] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.310128 20873 raft_consensus.cc:2243] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.311249 20873 raft_consensus.cc:2272] T a81d7a413cca41acba7ba36bb13ce654 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.317687 20873 tablet_replica.cc:333] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.318454 20873 raft_consensus.cc:2243] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.319175 20873 raft_consensus.cc:2272] T 99368f219dd84b6994a569b62a8579d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.321686 20873 tablet_replica.cc:333] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.322413 20873 raft_consensus.cc:2243] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.322960 20873 raft_consensus.cc:2272] T d935d1f5ca454cf6b73d0e33d7a7f51a P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.326126 20873 tablet_replica.cc:333] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.326844 20873 raft_consensus.cc:2243] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.327427 20873 raft_consensus.cc:2272] T 45d56621ac1d470dac3f492c5c1b5256 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.328457 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:27.330053 20873 tablet_replica.cc:333] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.330857 20873 raft_consensus.cc:2243] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.331473 20873 raft_consensus.cc:2272] T d57c1d6eaa044fe58248b797147f51d0 P 85f0d4cf04de40aa9e25849fb2380466 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.333864 20873 tablet_replica.cc:333] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.334579 20873 raft_consensus.cc:2243] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.335162 20873 raft_consensus.cc:2272] T cb9f575e2f52433abc7aeff041ddb880 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.337662 20873 tablet_replica.cc:333] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.338361 20873 raft_consensus.cc:2243] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.338925 20873 raft_consensus.cc:2272] T e3caebc0658346798308160a170ffc71 P 85f0d4cf04de40aa9e25849fb2380466 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.341145 20873 tablet_replica.cc:333] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.341840 20873 raft_consensus.cc:2243] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.342476 20873 raft_consensus.cc:2272] T 5e89ee7eb571454eb9956953ae2c7c5d P 85f0d4cf04de40aa9e25849fb2380466 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.344805 20873 tablet_replica.cc:333] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.345530 20873 raft_consensus.cc:2243] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.346330 20873 raft_consensus.cc:2272] T 03a703fed624441fb4eb00f38f0ff80d P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.348805 20873 tablet_replica.cc:333] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
W20260709 12:27:27.349233 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:27.349582 20873 raft_consensus.cc:2243] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.351728 20873 raft_consensus.cc:2272] T cd094bd2058d4b6d9810ece12a93d849 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.371451 20873 tablet_replica.cc:333] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.372241 20873 raft_consensus.cc:2243] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.373333 20873 raft_consensus.cc:2272] T 8a5dc4546d94416ab0e98aa60a0074b9 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.375839 20873 tablet_replica.cc:333] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.376551 20873 raft_consensus.cc:2243] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.377081 20873 raft_consensus.cc:2272] T a029fe9d29df4ca38adc92d96e055bbd P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.388110 20873 tablet_replica.cc:333] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.389567 20873 raft_consensus.cc:2243] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.390233 20873 raft_consensus.cc:2272] T 68525dff5d9a48b9906b79db6bffb969 P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.393698 20873 tablet_replica.cc:333] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.398599 20873 raft_consensus.cc:2243] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.399329 20873 raft_consensus.cc:2272] T 3b958cd7e995415696872e37e9c3062b P 85f0d4cf04de40aa9e25849fb2380466 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.401909 20873 tablet_replica.cc:333] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.402566 20873 raft_consensus.cc:2243] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.403129 20873 raft_consensus.cc:2272] T 8800ea1c1a5648149433c4b68674d692 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.405514 20873 tablet_replica.cc:333] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.406344 20873 raft_consensus.cc:2243] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.407096 20873 raft_consensus.cc:2272] T bbe117f2cdc04fab8acb64e91252db18 P 85f0d4cf04de40aa9e25849fb2380466 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.409701 20873 tablet_replica.cc:333] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.410460 20873 raft_consensus.cc:2243] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.411269 20873 raft_consensus.cc:2272] T 2012f4a3900141a5b86022143147dd81 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.413622 20873 tablet_replica.cc:333] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.414266 20873 raft_consensus.cc:2243] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.414836 20873 raft_consensus.cc:2272] T f77cd08fd9014998aebc07bff003d1a8 P 85f0d4cf04de40aa9e25849fb2380466 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.417769 20873 tablet_replica.cc:333] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.418358 20873 raft_consensus.cc:2243] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.418901 20873 raft_consensus.cc:2272] T 285ef7a597884d3a8a0ad5e993a8eb93 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.422706 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:27.426714 20873 tablet_replica.cc:333] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466: stopping tablet replica
I20260709 12:27:27.427544 20873 raft_consensus.cc:2243] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.428557 20873 raft_consensus.cc:2272] T f8bfdf52fab442f6ab7ed33f99c33cf5 P 85f0d4cf04de40aa9e25849fb2380466 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.583241 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:27.644483 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:27.658389 22185 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:27.794924 22185 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:27.831506 22185 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:27.993134 22185 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:28.097875 25201 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.098505 25201 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:28.100744 25201 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.108547 22701 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.112542 25242 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.113098 25242 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:28.115628 25242 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.127782 22702 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.129839 22702 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.131141 25242 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:28.129302 22701 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.150935 25142 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.151540 25142 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:28.151997 22702 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.154703 25212 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.155679 25212 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:28.157943 25212 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:28.158588 22702 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:28.159427 22184 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.160012 25243 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:28.160815 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:28.167469 25142 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.168116 22184 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:28.174520 22185 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.174962 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.175693 25142 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:28.176658 22185 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.177058 22185 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.177737 25142 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:28.218349 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:28.226574 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:28.251746 22185 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:28.255844 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:28.258600 22185 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:28.328461 25142 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.328995 25142 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:28.335871 25142 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.344641 22184 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:28.346323 22185 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.346783 22185 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.348841 25212 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:28.356983 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:28.381855 25243 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.382591 25243 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:28.394541 25243 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:28.397742 22701 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:28.399322 22702 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.399765 22702 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.401762 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:28.404389 25242 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:28.411134 25142 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.411697 25142 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:28.414417 25142 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:28.418061 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:28.418740 22737 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
W20260709 12:27:28.429543 22184 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.433887 25212 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.434569 25212 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:28.431550 22185 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.437880 22185 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.441238 25212 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:28.442564 25212 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:28.455796 22184 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.472388 25243 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.473002 25243 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:28.491781 25201 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.492360 25201 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:28.498656 25201 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:28.504733 25243 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.536202 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 104711us
I20260709 12:27:28.542811 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:28.543465 22737 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
I20260709 12:27:28.552008 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:28.552659 22214 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 9.
W20260709 12:27:28.554661 22701 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:28.555207 22701 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:28.566435 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:28.567296 22702 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.567777 22702 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.568596 25201 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:28.569818 22702 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.570524 22702 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.571296 25201 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:28.572329 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:28.586372 22185 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.586959 22185 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.588436 25244 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:28.592159 22185 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:28.594950 25244 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.595443 25244 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:28.596944 20873 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22167)
I20260709 12:27:28.597615 25244 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.602813 22184 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.621919 25244 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.622493 25244 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:28.631348 22184 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.632148 25244 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.633519 22185 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.634073 22185 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.634873 25244 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:28.648317 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:28.659787 25244 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.660547 25244 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:28.667781 22184 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.668563 25244 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.691359 22185 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:28.694005 22185 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.695694 22185 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.698236 25245 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:28.710629 25244 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.711206 25244 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:28.718811 22184 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:28.722693 25244 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.724087 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.726624 22185 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.727406 25244 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:28.744318 25245 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:28.744886 25245 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:28.747187 25245 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:28.752745 22184 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:28.768790 22701 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:28.784791 22185 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.785411 22185 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.786216 25244 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:28.792285 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:28.794287 22185 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:28.795260 25244 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:28.875106 22185 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:28.921317 22185 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.078323 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:29.085482 22701 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.098507 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:29.154899 22701 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.155488 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:29.186273 22701 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.208720 22184 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.216408 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:29.229568 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:29.233093 22701 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.239276 22701 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.262777 22185 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.278790 22184 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.292361 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:29.299492 22184 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.304118 21953 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 85180.2us
W20260709 12:27:29.307722 21953 catalog_manager.cc:4755] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bf83ee90e33b4083aebda67b32ca1149: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:29.347385 22701 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.347414 22184 consensus_peers.cc:597] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.371483 22701 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.412658 22185 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.421461 22184 consensus_peers.cc:597] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.429047 22184 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.437882 22701 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.479194 22701 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.486930 22701 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.508036 22184 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.518877 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:29.521908 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:29.529739 22184 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.533900 22701 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.553362 22184 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.581707 22184 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.597821 20873 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22167)
W20260709 12:27:29.598887 22184 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.621227 22184 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.622689 22184 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.627489 22701 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.643736 22701 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.668850 22184 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.674248 22701 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.708151 22184 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.723480 22701 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.762645 22701 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.772732 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:29.792109 22184 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.830586 22184 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.847677 25252 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:29.850996 25252 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:29.859324 22701 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:29.861248 25252 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:29.880725 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:29.914382 25254 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:29.914947 25254 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:29.917137 25254 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:29.920058 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:29.947582 22702 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:29.969521 25248 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:29.982044 22702 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:29.982277 25248 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:29.992260 25246 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:29.997238 25248 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.002962 22185 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:30.006956 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:30.006625 22701 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:30.012573 22702 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.014640 22702 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.023200 25254 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:30.034287 22701 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:30.035219 22185 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:30.043812 22184 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:30.044363 22184 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.047974 25248 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.055958 25248 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.056730 25248 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:30.064703 22185 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.066741 25248 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:30.067324 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:30.067982 22737 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
W20260709 12:27:30.081529 22184 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:30.088071 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.090759 25248 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:30.108492 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:30.122467 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:30.132426 25248 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.133075 25248 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:30.135453 25248 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.141201 22184 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:30.144215 22185 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.144642 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.149995 25244 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:30.178298 25255 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.178906 25255 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:30.183482 25255 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.198637 22185 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:30.228382 22184 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:30.228963 22184 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.230125 25244 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.260382 25244 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.261118 25244 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:30.263664 25244 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.272090 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.304714 25244 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.305483 25244 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:30.309706 25244 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:30.304060 22184 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:30.311717 22184 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.337941 25248 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:30.341074 22737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:30.341825 22737 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
W20260709 12:27:30.372507 22185 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.380733 25244 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.381464 25244 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:30.383678 25244 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.389904 22184 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:30.394377 22184 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.398895 25244 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:30.402171 22185 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:30.422525 22185 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:30.428196 22184 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:30.431087 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:30.436968 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.439404 25244 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:30.452883 22185 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:30.491139 25244 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.491704 25244 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:30.498502 22184 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:30.496373 25244 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.507963 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:30.509567 25252 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.510182 25252 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:30.517367 25252 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.528275 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.528796 22185 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:30.531735 22701 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:30.534703 22702 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.535144 22702 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.536288 25252 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:30.537144 25244 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:30.562325 22702 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111) [suppressed 720 similar messages]
W20260709 12:27:30.587793 22185 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:30.588595 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:30.598352 20873 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 22167)
W20260709 12:27:30.784076 22185 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:30.822131 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:30.825338 25248 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.826468 25248 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:30.830612 25248 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.835228 22184 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:30.839023 22185 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:30.839558 22185 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.842140 25248 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:30.890249 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:30.899550 25248 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:30.900084 25248 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:30.902209 25248 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:30.913129 22185 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:30.916076 22184 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:30.916575 22184 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:30.917501 25248 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:31.015888 22185 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.016511 22185 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:31.044281 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:31.052927 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:31.172997 22701 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.315490 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:31.319026 22185 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.470947 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:31.563622 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:44299, user_credentials={real_user=slave}} blocked reactor thread for 51994.4us
W20260709 12:27:31.569480 22701 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.586741 22184 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.599030 20873 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 22167)
W20260709 12:27:31.691087 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:31.698103 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:31.696977 22185 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:31.695398 22701 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.724819 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:31.739830 22184 consensus_peers.cc:597] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.752085 22185 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.808403 22701 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.851495 22701 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.909950 22701 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.912379 22184 consensus_peers.cc:597] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.919519 22184 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.923561 22184 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.924209 22184 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:31.917752 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.915516 22185 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:31.938669 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:31.968487 22701 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.142910 22701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 174491us
W20260709 12:27:31.983371 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:32.003821 22184 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.158421 22702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 175087us
W20260709 12:27:32.158515 22184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:42771, user_credentials={real_user=slave}} blocked reactor thread for 154735us
W20260709 12:27:32.159088 22184 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.159544 22184 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:32.091387 25248 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.161993 25248 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:32.164621 25248 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:32.173767 22185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:40323, user_credentials={real_user=slave}} blocked reactor thread for 235123us
I20260709 12:27:32.190132 25264 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.191021 25264 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:32.193754 25264 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:32.195040 25264 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.195670 25264 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:32.198869 25264 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:32.200158 25265 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.214501 25265 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:32.220115 25265 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:32.298398 22701 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.299043 22701 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.299556 22701 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.300019 22701 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.315802 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:32.316593 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:32.332792 22701 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.333712 22701 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.333941 22185 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:32.341372 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:32.344748 22185 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:32.334254 22701 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.334838 22184 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:32.361670 22184 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.362215 22184 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:32.365604 22184 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:32.366074 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:32.366413 22701 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:32.367035 25260 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:32.370767 22184 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.371351 22184 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:32.372550 22184 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:32.367054 22701 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:32.376874 25266 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:32.381206 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:32.391358 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:32.394870 22701 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.404547 22184 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.405303 22184 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.417223 22184 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.403057 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:32.421322 22185 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:32.422195 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:32.422725 22184 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.425484 22184 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:32.426294 25258 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:32.432471 22701 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:32.428297 22185 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:32.435719 22185 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:32.436661 25258 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:32.448490 22184 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:32.496498 25258 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.497285 25258 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:32.513993 22184 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:32.515026 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:32.515839 25258 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:32.515587 22185 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:32.518937 25258 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:32.562248 22185 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:32.599587 20873 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 22167)
I20260709 12:27:32.624140 25260 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.625032 25260 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:32.631834 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:32.632890 22732 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 5.
I20260709 12:27:32.633347 25260 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:32.641702 22185 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:32.642522 22184 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:32.642987 22184 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:32.645449 25260 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:32.684028 22185 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:32.706336 25260 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.707122 25260 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:32.716663 22185 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:32.719285 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:32.727901 22184 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:32.728892 22184 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:32.732066 25258 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:32.728413 25260 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:32.826098 22185 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:32.838359 25257 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
W20260709 12:27:32.839568 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:32.839234 25257 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:32.854419 22701 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:32.855474 22702 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:32.855917 22702 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:32.856886 25262 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:32.857673 25257 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
I20260709 12:27:32.868536 25258 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:32.872797 25258 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:32.881404 22732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:32.882202 22732 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
W20260709 12:27:32.882613 22184 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:32.883548 22185 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:32.884008 22185 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:32.879515 25258 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
I20260709 12:27:32.885088 25266 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:32.966372 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:32.999536 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:33.040279 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:33.090677 25262 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:33.091394 25262 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:33.093755 25262 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:33.102277 22702 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:33.119604 22701 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:33.121780 22701 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:33.123612 25262 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:33.167660 22241 debug-util.cc:398] Leaking SignalData structure 0x7b08000dcec0 after lost signal to thread 20876
W20260709 12:27:33.168918 22241 debug-util.cc:398] Leaking SignalData structure 0x7b080013c000 after lost signal to thread 22002
W20260709 12:27:33.170310 22241 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8140 after lost signal to thread 22244
W20260709 12:27:33.171635 22241 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0940 after lost signal to thread 22761
I20260709 12:27:33.189838 25262 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:33.190519 25262 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:33.192799 25262 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:33.197600 22702 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:33.211350 22701 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:33.211912 22701 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:33.213104 25262 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:33.287139 25258 raft_consensus.cc:493] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:33.287884 25258 raft_consensus.cc:515] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:33.290192 25258 leader_election.cc:290] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:33.300767 22184 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:33.301528 22185 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:33.311839 22185 leader_election.cc:336] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:33.313464 22185 leader_election.cc:304] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:33.314759 25258 raft_consensus.cc:2749] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:33.361394 25258 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:33.363813 25258 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:33.366369 25258 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:33.388533 22184 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:33.390676 22185 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:33.391255 22185 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:33.392023 25266 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:33.400044 22185 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:33.501844 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.528065 22185 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:33.535991 22701 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:33.600112 20873 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 22167)
W20260709 12:27:33.632313 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:33.682739 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:33.716571 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:33.732952 22185 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:33.839382 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:33.845741 22185 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:33.947252 22185 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:33.963055 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:33.966595 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:33.984927 22701 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.153273 22185 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.154914 22184 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.173606 22185 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.186594 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:34.199689 22184 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:34.259037 25258 raft_consensus.cc:493] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:34.259665 25258 raft_consensus.cc:515] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:34.262156 25258 leader_election.cc:290] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:34.270356 22185 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:34.272547 22184 leader_election.cc:336] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:34.272956 22184 leader_election.cc:304] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:34.273732 25258 raft_consensus.cc:2749] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:34.279856 22701 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.310015 22184 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.312510 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:34.319684 22185 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.324102 22184 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.325316 22184 consensus_peers.cc:597] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.356251 22701 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.360085 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:34.394479 22184 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.398837 22701 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.406478 22701 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.462688 22701 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.470328 22701 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.499131 22184 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.500319 22701 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.505247 22701 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.510428 22701 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.549270 22184 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.601064 20873 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 22167)
W20260709 12:27:34.608018 22184 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:34.609375 25258 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:34.609987 25258 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:34.612323 25258 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:34.615223 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:34.620253 22184 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:34.632426 22184 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.638278 22701 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.639760 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:34.640717 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:34.644186 22185 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:34.644974 25258 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:34.648010 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:34.648597 22184 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.660192 22184 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.663960 22701 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:34.689343 25258 raft_consensus.cc:493] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:34.689920 25258 raft_consensus.cc:515] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:34.691924 22701 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:34.692071 25258 leader_election.cc:290] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:34.697659 22701 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.699090 22184 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:34.699942 22185 leader_election.cc:336] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:34.700420 22185 leader_election.cc:304] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:34.701156 25258 raft_consensus.cc:2749] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:34.753274 22184 consensus_peers.cc:597] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.794221 22701 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.796325 22184 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.838348 22701 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.868925 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:34.878530 22184 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.879398 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:34.903497 22701 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:34.915851 22184 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:35.047617 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:35.069067 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:35.080399 22184 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:35.092160 22185 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.115649 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:35.143522 25266 raft_consensus.cc:493] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:35.144117 25266 raft_consensus.cc:515] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:35.146375 25266 leader_election.cc:290] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:35.155462 22184 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:35.156275 22185 leader_election.cc:336] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:35.156669 22185 leader_election.cc:304] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:35.157858 25266 raft_consensus.cc:2749] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:35.177013 22185 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:35.405306 25272 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:35.406035 25272 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:35.419973 22702 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:35.421150 25272 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:35.423313 22214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c193cc2e540dbbc926df1219ef72b" candidate_uuid: "ed678a3f9e3d4e0ba5801f1663548796" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be238c1de63840f9bb041e2f9ba58d2b" is_pre_election: true
I20260709 12:27:35.423985 22214 raft_consensus.cc:2468] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed678a3f9e3d4e0ba5801f1663548796 in term 5.
I20260709 12:27:35.424094 25266 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:35.424746 25266 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:35.429994 25266 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), ed678a3f9e3d4e0ba5801f1663548796 (127.20.98.68:44299)
W20260709 12:27:35.435041 22184 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:35.460680 22729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd094bd2058d4b6d9810ece12a93d849" candidate_uuid: "be238c1de63840f9bb041e2f9ba58d2b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ed678a3f9e3d4e0ba5801f1663548796" is_pre_election: true
I20260709 12:27:35.461400 22729 raft_consensus.cc:2468] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be238c1de63840f9bb041e2f9ba58d2b in term 9.
W20260709 12:27:35.471197 22185 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:35.471956 22185 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:35.486927 25271 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:35.491118 25271 raft_consensus.cc:493] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:35.491622 25271 raft_consensus.cc:515] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
I20260709 12:27:35.494163 25271 leader_election.cc:290] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:35.498668 22185 consensus_peers.cc:597] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:35.505016 22185 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:35.514456 22701 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:35.515048 22701 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b, ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:35.516330 25272 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:35.519743 22185 consensus_peers.cc:597] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:35.520469 22184 leader_election.cc:336] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:35.521411 22184 leader_election.cc:304] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:35.523885 25271 raft_consensus.cc:2749] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:35.538709 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:35.564365 22184 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111) [suppressed 725 similar messages]
I20260709 12:27:35.592962 25274 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:35.593575 25274 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:35.595899 25274 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:35.608142 22702 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:35.610438 22701 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:35.612879 22701 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:35.617337 25274 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:35.632546 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:35.637558 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:35.838155 25274 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:35.838743 25274 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:35.859921 25274 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:35.860764 22702 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:35.867862 22701 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:35.868331 22701 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:35.869065 25274 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:35.938784 22185 consensus_peers.cc:597] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:35.991418 22185 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.063978 22701 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.121227 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:36.130129 22185 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:36.194994 22185 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:36.215813 22185 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:36.216775 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:36.356726 25274 raft_consensus.cc:493] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:36.357348 25274 raft_consensus.cc:515] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:36.359930 25274 leader_election.cc:290] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:36.374760 22185 consensus_peers.cc:597] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.375914 22185 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.377106 22702 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:36.378487 22185 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:36.379666 22701 leader_election.cc:336] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:36.380136 22701 leader_election.cc:304] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:36.381546 25270 raft_consensus.cc:2749] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:36.403261 22185 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.426209 22185 consensus_peers.cc:597] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.452325 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:36.455600 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:36.499502 22184 consensus_peers.cc:597] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.550657 22184 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.579026 22701 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:36.592181 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
W20260709 12:27:36.626188 22184 consensus_peers.cc:597] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.649087 22185 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:36.683622 22185 consensus_peers.cc:597] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:36.717751 22185 consensus_peers.cc:597] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.750926 22184 consensus_peers.cc:597] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.752242 22185 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:36.757510 22184 consensus_peers.cc:597] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:36.785079 25276 raft_consensus.cc:493] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:36.785840 25276 raft_consensus.cc:515] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:36.810146 22184 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:36.814677 25276 leader_election.cc:290] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:36.816398 22185 leader_election.cc:336] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:36.816885 22701 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:36.817188 22185 leader_election.cc:304] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:36.818997 25276 raft_consensus.cc:2749] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:36.856246 22701 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.865463 22701 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.865794 22184 consensus_peers.cc:597] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.898388 22184 consensus_peers.cc:597] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.907051 22701 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:36.913674 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
W20260709 12:27:36.921375 22702 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:36.936832 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:36.948143 22184 consensus_peers.cc:597] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.950742 22701 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.951377 22701 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.969659 22701 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.985002 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:36.990845 25271 raft_consensus.cc:493] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
W20260709 12:27:36.992146 22701 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:36.994561 22185 consensus_peers.cc:597] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:36.996074 25271 raft_consensus.cc:515] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:37.000494 22702 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:37.001268 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:37.004325 22184 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:37.008703 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.006281 25271 leader_election.cc:290] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:37.035015 22185 leader_election.cc:336] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:37.035646 22185 leader_election.cc:304] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:37.036628 25271 raft_consensus.cc:2749] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:37.036726 22701 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:37.039215 25278 raft_consensus.cc:493] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:37.039795 25278 raft_consensus.cc:515] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } }
W20260709 12:27:37.044762 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:37.049037 22184 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:37.051302 25278 leader_election.cc:290] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:37.059737 22185 leader_election.cc:336] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:37.065416 22185 leader_election.cc:304] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be238c1de63840f9bb041e2f9ba58d2b; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:37.066234 25278 raft_consensus.cc:2749] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:37.061160 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:37.069960 20873 tablet_replica.cc:333] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.071097 20873 raft_consensus.cc:2243] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.072945 20873 raft_consensus.cc:2272] T 93141c9281524e9aaffe4907f7e32041 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.077184 20873 tablet_replica.cc:333] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.079645 20873 raft_consensus.cc:2243] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:27:37.080096 22702 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.081589 20873 raft_consensus.cc:2272] T 522ffe0721f94fd69f4df0687f606515 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.085112 20873 tablet_replica.cc:333] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.086156 20873 raft_consensus.cc:2243] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.086908 20873 raft_consensus.cc:2272] T 0f24f68619f14d9e9de4306dd59b5709 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.089995 20873 tablet_replica.cc:333] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.091120 20873 raft_consensus.cc:2243] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.091823 20873 raft_consensus.cc:2272] T 7a5597e9e8004903a03d0ac57b864069 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.094898 20873 tablet_replica.cc:333] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.095876 20873 raft_consensus.cc:2243] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.097117 20873 raft_consensus.cc:2272] T b4ed5fd823f34d34b4fd87d49e53edb0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.103055 20873 tablet_replica.cc:333] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.104092 20873 raft_consensus.cc:2243] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Raft consensus shutting down.
W20260709 12:27:37.104189 22702 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.105988 20873 raft_consensus.cc:2272] T e5f28925d2fc4ec39e677a2be96ca259 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.108794 22184 consensus_peers.cc:597] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:37.109090 20873 tablet_replica.cc:333] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.110442 20873 raft_consensus.cc:2243] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.111641 20873 raft_consensus.cc:2272] T 790bdc35efb4419cb67fd1a718e2b584 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.114598 20873 tablet_replica.cc:333] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.115561 20873 raft_consensus.cc:2243] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:37.116490 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.116658 20873 raft_consensus.cc:2272] T 66ecbcd398b0449b86b36309434ca3d1 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.117128 22184 consensus_peers.cc:597] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:37.119990 20873 tablet_replica.cc:333] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
W20260709 12:27:37.121861 22701 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.132186 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:37.140301 20873 raft_consensus.cc:2243] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.141134 20873 raft_consensus.cc:2272] T 5e3e126e4f1f4d82991ffddf4599b103 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.144414 20873 tablet_replica.cc:333] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.145393 20873 raft_consensus.cc:2243] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.146561 20873 raft_consensus.cc:2272] T c609d086e32e4033b7376f770a2790a6 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.149632 20873 tablet_replica.cc:333] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.150701 20873 raft_consensus.cc:2243] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.153636 20873 raft_consensus.cc:2272] T 33d4294bcbec49ad88c8ce7c879b596d P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.157737 20873 tablet_replica.cc:333] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
W20260709 12:27:37.158233 22184 consensus_peers.cc:597] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:37.159385 20873 raft_consensus.cc:2243] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:27:37.160189 22701 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:37.160760 20873 raft_consensus.cc:2272] T 1fec8474cec64acca2f6f9303db0b0af P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.162077 22184 consensus_peers.cc:597] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:37.164057 20873 tablet_replica.cc:333] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.164981 20873 raft_consensus.cc:2243] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:37.182145 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:37.258867 20873 raft_consensus.cc:2272] T bf83ee90e33b4083aebda67b32ca1149 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.261869 20873 tablet_replica.cc:333] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.262727 20873 raft_consensus.cc:2243] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.264430 20873 raft_consensus.cc:2272] T 34d1a2cd4888492fad01161b84e51d77 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.268170 20873 tablet_replica.cc:333] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.268863 20873 raft_consensus.cc:2243] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.270361 20873 raft_consensus.cc:2272] T c387a77990f741e2ae187b3f92c6d472 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.274780 20873 tablet_replica.cc:333] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.275585 20873 raft_consensus.cc:2243] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.276261 20873 raft_consensus.cc:2272] T a81d7a413cca41acba7ba36bb13ce654 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.279345 20873 tablet_replica.cc:333] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.280180 20873 raft_consensus.cc:2243] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.282253 20873 raft_consensus.cc:2272] T 99368f219dd84b6994a569b62a8579d0 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.291808 20873 tablet_replica.cc:333] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.292622 20873 raft_consensus.cc:2243] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.293875 20873 raft_consensus.cc:2272] T b43429b68f624c25ae86dad7e60ceb15 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.296638 20873 tablet_replica.cc:333] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.297444 20873 raft_consensus.cc:2243] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.298048 20873 raft_consensus.cc:2272] T ed9f4c2d15b547e18ff1bfcfd082ae32 P be238c1de63840f9bb041e2f9ba58d2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.300683 20873 tablet_replica.cc:333] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.302160 20873 raft_consensus.cc:2243] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.303117 20873 raft_consensus.cc:2272] T f2b9f971fd394d129cd62de001799b21 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.306109 20873 tablet_replica.cc:333] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.307375 20873 raft_consensus.cc:2243] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:37.307535 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:37.308266 20873 raft_consensus.cc:2272] T d935d1f5ca454cf6b73d0e33d7a7f51a P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.308379 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:27:37.311280 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.311265 20873 tablet_replica.cc:333] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.316028 20873 raft_consensus.cc:2243] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.317804 20873 raft_consensus.cc:2272] T 2610abde2b26405b8b88ae11fb975d64 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.320741 20873 tablet_replica.cc:333] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.321528 20873 raft_consensus.cc:2243] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.322115 20873 raft_consensus.cc:2272] T 62526c368b43448e83c05dfd4e5aeaf3 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.340647 20873 tablet_replica.cc:333] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.342337 20873 raft_consensus.cc:2243] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.343542 20873 raft_consensus.cc:2272] T a8619cc30f64448bb01e0e927ff038d1 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.344869 22184 consensus_peers.cc:597] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.346283 22702 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:37.347012 22702 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.347453 20873 tablet_replica.cc:333] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.348253 20873 raft_consensus.cc:2243] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.349118 20873 raft_consensus.cc:2272] T 299ade5c6c9e48928f5602c43824af92 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.350371 22701 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.350919 22701 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.351476 22702 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.351775 20873 tablet_replica.cc:333] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.353888 20873 raft_consensus.cc:2243] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.354525 20873 raft_consensus.cc:2272] T c66fbf1879e84a19b490058938a4bc34 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.357111 20873 tablet_replica.cc:333] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.357849 20873 raft_consensus.cc:2243] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:27:37.358963 22702 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.359149 20873 raft_consensus.cc:2272] T 68525dff5d9a48b9906b79db6bffb969 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.359647 22701 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.362624 22701 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:37.365249 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.377990 20873 tablet_replica.cc:333] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.378857 20873 raft_consensus.cc:2243] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.379958 20873 raft_consensus.cc:2272] T 3b958cd7e995415696872e37e9c3062b P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.382653 20873 tablet_replica.cc:333] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.383383 20873 raft_consensus.cc:2243] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.383968 20873 raft_consensus.cc:2272] T 2bed3f011bde43719e0a7ce10da0401a P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.386466 20873 tablet_replica.cc:333] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.387272 20873 raft_consensus.cc:2243] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.387835 20873 raft_consensus.cc:2272] T f77cd08fd9014998aebc07bff003d1a8 P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.389657 22702 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:37.408020 22702 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:37.410118 20873 tablet_replica.cc:333] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
W20260709 12:27:37.410656 22701 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:37.410988 20873 raft_consensus.cc:2243] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.411675 20873 raft_consensus.cc:2272] T 2012f4a3900141a5b86022143147dd81 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.414405 20873 tablet_replica.cc:333] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.415167 20873 raft_consensus.cc:2243] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.416435 20873 raft_consensus.cc:2272] T ec2973e4920541d9ba2cb2c911dbab09 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.419083 20873 tablet_replica.cc:333] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.419966 20873 raft_consensus.cc:2243] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.421198 20873 raft_consensus.cc:2272] T 821557b36d67456997b35682a066dbc9 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.424007 20873 tablet_replica.cc:333] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.424814 20873 raft_consensus.cc:2243] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:37.425472 22185 consensus_peers.cc:597] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:37.425455 20873 raft_consensus.cc:2272] T 45d56621ac1d470dac3f492c5c1b5256 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.429203 20873 tablet_replica.cc:333] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.429898 20873 raft_consensus.cc:2243] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.431157 20873 raft_consensus.cc:2272] T d57c1d6eaa044fe58248b797147f51d0 P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.435221 20873 tablet_replica.cc:333] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.440532 20873 raft_consensus.cc:2243] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.441682 20873 raft_consensus.cc:2272] T 42a9ba8203ae4024af5885277061c1a3 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.444437 20873 tablet_replica.cc:333] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.445221 20873 raft_consensus.cc:2243] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.446440 20873 raft_consensus.cc:2272] T 6a3d458721d04ad184247f1a1926d3fa P be238c1de63840f9bb041e2f9ba58d2b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.449131 20873 tablet_replica.cc:333] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.449839 20873 raft_consensus.cc:2243] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.450719 20873 raft_consensus.cc:2272] T 2b5c193cc2e540dbbc926df1219ef72b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.453395 20873 tablet_replica.cc:333] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.454074 20873 raft_consensus.cc:2243] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.454605 20873 raft_consensus.cc:2272] T 28acb7e5630c4b1da2fa7d2abca24a62 P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.457160 20873 tablet_replica.cc:333] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.458164 20873 raft_consensus.cc:2243] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.459774 20873 raft_consensus.cc:2272] T 2100de7ab7b84cf39a4370858e9b6927 P be238c1de63840f9bb041e2f9ba58d2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.463124 20873 tablet_replica.cc:333] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.464134 20873 raft_consensus.cc:2243] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.464871 20873 raft_consensus.cc:2272] T 5e89ee7eb571454eb9956953ae2c7c5d P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.468683 20873 tablet_replica.cc:333] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.469380 20873 raft_consensus.cc:2243] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.470024 20873 raft_consensus.cc:2272] T 03a703fed624441fb4eb00f38f0ff80d P be238c1de63840f9bb041e2f9ba58d2b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.472580 20873 tablet_replica.cc:333] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.473279 20873 raft_consensus.cc:2243] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.474334 20873 raft_consensus.cc:2272] T cd094bd2058d4b6d9810ece12a93d849 P be238c1de63840f9bb041e2f9ba58d2b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.476823 20873 tablet_replica.cc:333] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.477492 20873 raft_consensus.cc:2243] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.478080 20873 raft_consensus.cc:2272] T 97b8db04a690435f8c84aba1b0f5ec2b P be238c1de63840f9bb041e2f9ba58d2b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.480577 20873 tablet_replica.cc:333] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.481280 20873 raft_consensus.cc:2243] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.481904 20873 raft_consensus.cc:2272] T 8a5dc4546d94416ab0e98aa60a0074b9 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.484491 20873 tablet_replica.cc:333] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.485136 20873 raft_consensus.cc:2243] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.486369 20873 raft_consensus.cc:2272] T a029fe9d29df4ca38adc92d96e055bbd P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.488962 20873 tablet_replica.cc:333] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.489599 20873 raft_consensus.cc:2243] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.491243 20873 raft_consensus.cc:2272] T 51286e1e6cac4310b4960b85e10b91cd P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.493712 20873 tablet_replica.cc:333] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.494335 20873 raft_consensus.cc:2243] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:37.494906 20873 raft_consensus.cc:2272] T f8bfdf52fab442f6ab7ed33f99c33cf5 P be238c1de63840f9bb041e2f9ba58d2b [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:37.497505 20873 tablet_replica.cc:333] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b: stopping tablet replica
I20260709 12:27:37.498091 20873 raft_consensus.cc:2243] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:37.499212 20873 raft_consensus.cc:2272] T 8800ea1c1a5648149433c4b68674d692 P be238c1de63840f9bb041e2f9ba58d2b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:37.553439 21953 catalog_manager.cc:4755] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 66ecbcd398b0449b86b36309434ca3d1: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:37.574949 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:37.863359 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:37.899360 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:38.039840 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:38.053234 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:27:38.054096 25277 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:38.054718 25277 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.058638 25277 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.061983 22701 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:38.067560 22702 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:38.067999 22702 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.068693 25277 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:38.070564 22702 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.122412 25274 raft_consensus.cc:493] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:38.122961 25274 raft_consensus.cc:515] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.125204 25274 leader_election.cc:290] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:38.129851 22702 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:38.131651 22701 leader_election.cc:336] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:38.132094 22701 leader_election.cc:304] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.132820 25274 raft_consensus.cc:2749] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:38.182446 25274 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.183043 25274 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.185338 25274 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.190224 22702 leader_election.cc:336] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:38.191159 22702 leader_election.cc:336] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.191639 22702 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.192461 25277 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:38.271428 22758 debug-util.cc:398] Leaking SignalData structure 0x7b08002de3c0 after lost signal to thread 20876
W20260709 12:27:38.272505 22758 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1d60 after lost signal to thread 22002
W20260709 12:27:38.273090 22758 debug-util.cc:398] Leaking SignalData structure 0x7b0800263c20 after lost signal to thread 22244
W20260709 12:27:38.274266 22758 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9900 after lost signal to thread 22761
I20260709 12:27:38.320473 25274 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.321666 25274 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.324431 25274 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.330124 22701 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:38.333880 25274 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.334458 25274 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.336540 25274 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.343963 22702 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:38.344398 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.345186 25274 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:38.348371 22702 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
W20260709 12:27:38.350498 22702 leader_election.cc:336] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:38.354743 22702 leader_election.cc:336] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.355144 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.355795 25274 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:38.537060 25274 raft_consensus.cc:493] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.537708 25274 raft_consensus.cc:515] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:38.545030 22701 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:38.546352 25274 leader_election.cc:290] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.572257 22702 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:38.572916 22702 leader_election.cc:304] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.573886 25274 raft_consensus.cc:2749] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:38.574942 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:38.575886 22702 leader_election.cc:336] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.608572 25274 raft_consensus.cc:493] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:38.609637 25274 raft_consensus.cc:515] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.612286 25274 leader_election.cc:290] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771)
W20260709 12:27:38.618683 22701 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:38.624627 22702 leader_election.cc:336] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:38.625257 22702 leader_election.cc:304] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.626086 25274 raft_consensus.cc:2749] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:38.627911 25274 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.628482 25274 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:38.630523 20873 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 22241)
I20260709 12:27:38.631672 25274 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.639457 22701 leader_election.cc:336] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:38.643535 22701 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.657052 22702 leader_election.cc:336] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.657723 22702 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:38.658608 25274 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:38.715108 25274 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:38.715688 25274 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.727720 25274 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.738893 22701 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:38.759917 22702 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.760514 22702 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:38.761597 25274 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:38.762647 22702 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:38.763624 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:38.772938 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:38.797287 25274 raft_consensus.cc:493] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.797835 25274 raft_consensus.cc:515] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.800021 25274 leader_election.cc:290] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.810118 22702 leader_election.cc:336] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:38.811002 22702 leader_election.cc:336] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.811513 22702 leader_election.cc:304] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.812398 25274 raft_consensus.cc:2749] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:38.857468 25277 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.858160 25277 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.857059 25274 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.860579 25277 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:38.861609 25274 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.866086 25274 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.885452 22701 leader_election.cc:336] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:38.902428 22701 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:38.919919 22702 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:38.928402 25283 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:38.929160 25283 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:38.931617 25283 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:38.927840 22702 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.934062 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
W20260709 12:27:38.935214 22702 leader_election.cc:336] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.938077 22702 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:38.935745 25283 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:38.939260 25274 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:38.972431 22702 leader_election.cc:336] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:38.973503 22702 leader_election.cc:336] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:38.974035 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:38.974913 25283 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:39.052783 22702 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:39.131472 22701 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.286783 22701 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.329644 22701 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.420471 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.420878 22702 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.428823 22701 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.445528 22701 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.456123 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.464265 22702 consensus_peers.cc:597] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.471457 22701 consensus_peers.cc:597] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.476356 22701 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.480270 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:39.481617 22701 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.526499 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.534492 22702 consensus_peers.cc:597] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:39.537842 22701 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.553401 22702 consensus_peers.cc:597] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.562819 22702 consensus_peers.cc:597] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.566013 22702 consensus_peers.cc:597] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.574424 22702 consensus_peers.cc:597] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.574817 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.631071 20873 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 22241)
W20260709 12:27:39.658862 22702 consensus_peers.cc:597] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:39.675103 22702 consensus_peers.cc:597] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.677251 22702 consensus_peers.cc:597] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.680789 22701 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.689198 22701 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.715581 22702 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.742903 22701 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.764801 22702 consensus_peers.cc:597] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:27:39.851089 22701 consensus_peers.cc:597] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.852209 22702 consensus_peers.cc:597] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.895741 22701 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.920384 22701 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:39.951128 22702 consensus_peers.cc:597] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.960677 22702 consensus_peers.cc:597] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.044886 22702 consensus_peers.cc:597] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:27:40.053409 25285 raft_consensus.cc:493] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:40.054059 25285 raft_consensus.cc:515] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.056578 25285 leader_election.cc:290] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:40.063189 22702 consensus_peers.cc:597] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:27:40.063905 22702 leader_election.cc:336] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:40.064620 22702 leader_election.cc:336] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:40.065027 22702 leader_election.cc:304] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:40.065809 25285 raft_consensus.cc:2749] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:40.086302 25285 raft_consensus.cc:493] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:40.086977 25285 raft_consensus.cc:515] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.090042 25285 leader_election.cc:290] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:40.094728 22701 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:40.098022 22702 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:40.098491 22702 leader_election.cc:304] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:40.099296 25285 raft_consensus.cc:2749] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:40.099416 22702 leader_election.cc:336] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
W20260709 12:27:40.245497 22702 consensus_peers.cc:597] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 -> Peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Couldn't send request to peer be238c1de63840f9bb041e2f9ba58d2b. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.250306 22701 consensus_peers.cc:597] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Couldn't send request to peer 85f0d4cf04de40aa9e25849fb2380466. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:40.274426 25285 raft_consensus.cc:493] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:40.275118 25285 raft_consensus.cc:515] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.277199 25285 leader_election.cc:290] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:40.283321 22702 leader_election.cc:336] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
W20260709 12:27:40.284001 22702 leader_election.cc:336] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:40.284420 22702 leader_election.cc:304] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:40.285163 25285 raft_consensus.cc:2749] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:40.294221 22702 consensus_peers.cc:597] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:40.352470 22702 consensus_peers.cc:597] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:27:40.402796 25285 raft_consensus.cc:493] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:40.403368 25285 raft_consensus.cc:515] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } attrs { replace: true } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.406116 25285 leader_election.cc:290] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:40.411545 22701 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:40.413359 22702 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:40.413900 22702 leader_election.cc:304] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:40.414778 25285 raft_consensus.cc:2749] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:40.414836 22702 leader_election.cc:336] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:40.445468 25286 raft_consensus.cc:493] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 85f0d4cf04de40aa9e25849fb2380466)
I20260709 12:27:40.446022 25286 raft_consensus.cc:515] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } attrs { replace: true } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.448679 25286 leader_election.cc:290] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:40.455653 22701 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
W20260709 12:27:40.460760 22702 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:40.461272 22702 leader_election.cc:304] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:40.461999 25286 raft_consensus.cc:2749] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:40.464424 22702 leader_election.cc:336] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
W20260709 12:27:40.470996 22702 consensus_peers.cc:597] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:40.510877 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
W20260709 12:27:40.525072 22702 consensus_peers.cc:597] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:27:40.572118 22702 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111) [suppressed 631 similar messages]
I20260709 12:27:40.656818 20873 tablet_server.cc:179] TabletServer@127.20.98.68:0 shutting down...
I20260709 12:27:40.693254 25285 raft_consensus.cc:493] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:40.693768 25285 raft_consensus.cc:515] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.695634 25285 leader_election.cc:290] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:40.700716 22701 leader_election.cc:336] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:40.699487 25286 raft_consensus.cc:493] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:40.701685 25286 raft_consensus.cc:515] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "85f0d4cf04de40aa9e25849fb2380466" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 42771 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.704007 25286 leader_election.cc:290] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:40.704460 25286 raft_consensus.cc:493] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
W20260709 12:27:40.705331 22702 leader_election.cc:336] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:40.705863 22702 leader_election.cc:304] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:40.708003 25285 raft_consensus.cc:2749] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:40.704898 25286 raft_consensus.cc:515] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
W20260709 12:27:40.710175 22701 leader_election.cc:336] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 85f0d4cf04de40aa9e25849fb2380466 (127.20.98.66:42771): Network error: Client connection negotiation failed: client connection to 127.20.98.66:42771: connect: Connection refused (error 111)
I20260709 12:27:40.710227 25286 leader_election.cc:290] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
W20260709 12:27:40.717712 22702 leader_election.cc:336] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:40.718468 22702 leader_election.cc:304] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: 85f0d4cf04de40aa9e25849fb2380466, be238c1de63840f9bb041e2f9ba58d2b
I20260709 12:27:40.719375 25286 raft_consensus.cc:2749] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:40.723663 22702 leader_election.cc:336] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
W20260709 12:27:40.724843 22702 leader_election.cc:336] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:40.725378 22702 leader_election.cc:304] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:40.726861 25286 raft_consensus.cc:2749] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:40.731880 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:40.732788 20873 tablet_replica.cc:333] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.733867 20873 raft_consensus.cc:2243] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.734813 20873 raft_consensus.cc:2272] T 2610abde2b26405b8b88ae11fb975d64 P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.735185 25288 raft_consensus.cc:493] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be238c1de63840f9bb041e2f9ba58d2b)
I20260709 12:27:40.735841 25288 raft_consensus.cc:515] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c9a50b2f586448c49281a6618c40a1f7" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40323 } } peers { permanent_uuid: "be238c1de63840f9bb041e2f9ba58d2b" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 39245 } } peers { permanent_uuid: "ed678a3f9e3d4e0ba5801f1663548796" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 44299 } attrs { promote: false } }
I20260709 12:27:40.738049 20873 tablet_replica.cc:333] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.739216 20873 raft_consensus.cc:2243] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.739353 25288 leader_election.cc:290] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323), be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245)
I20260709 12:27:40.740475 20873 raft_consensus.cc:2272] T 66ecbcd398b0449b86b36309434ca3d1 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.743479 20873 tablet_replica.cc:333] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.744459 20873 raft_consensus.cc:2243] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.745339 20873 raft_consensus.cc:2272] T 99368f219dd84b6994a569b62a8579d0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:40.747184 22702 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:40.748416 20873 tablet_replica.cc:333] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
W20260709 12:27:40.748689 22702 leader_election.cc:336] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer be238c1de63840f9bb041e2f9ba58d2b (127.20.98.67:39245): Network error: Client connection negotiation failed: client connection to 127.20.98.67:39245: connect: Connection refused (error 111)
I20260709 12:27:40.749203 22702 leader_election.cc:304] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed678a3f9e3d4e0ba5801f1663548796; no voters: be238c1de63840f9bb041e2f9ba58d2b, c9a50b2f586448c49281a6618c40a1f7
I20260709 12:27:40.749609 20873 raft_consensus.cc:2243] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.749927 25288 raft_consensus.cc:2749] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:40.751127 20873 raft_consensus.cc:2272] T d935d1f5ca454cf6b73d0e33d7a7f51a P ed678a3f9e3d4e0ba5801f1663548796 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.753472 20873 tablet_replica.cc:333] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.754112 20873 raft_consensus.cc:2243] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.755193 20873 raft_consensus.cc:2272] T bf83ee90e33b4083aebda67b32ca1149 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.758076 20873 tablet_replica.cc:333] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.758975 20873 raft_consensus.cc:2243] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.759661 20873 raft_consensus.cc:2272] T 3b958cd7e995415696872e37e9c3062b P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.762598 20873 tablet_replica.cc:333] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.763242 20873 raft_consensus.cc:2243] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.764163 20873 raft_consensus.cc:2272] T 2bed3f011bde43719e0a7ce10da0401a P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.766469 20873 tablet_replica.cc:333] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.767174 20873 raft_consensus.cc:2243] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.768186 20873 raft_consensus.cc:2272] T cb9f575e2f52433abc7aeff041ddb880 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.770292 20873 tablet_replica.cc:333] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.770864 20873 raft_consensus.cc:2243] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.771786 20873 raft_consensus.cc:2272] T e3caebc0658346798308160a170ffc71 P ed678a3f9e3d4e0ba5801f1663548796 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.773902 20873 tablet_replica.cc:333] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.774487 20873 raft_consensus.cc:2243] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.775271 20873 raft_consensus.cc:2272] T ed9f4c2d15b547e18ff1bfcfd082ae32 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.777585 20873 tablet_replica.cc:333] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.778415 20873 raft_consensus.cc:2243] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.779376 20873 raft_consensus.cc:2272] T b4ed5fd823f34d34b4fd87d49e53edb0 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.782136 20873 tablet_replica.cc:333] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.783015 20873 raft_consensus.cc:2243] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.784271 20873 raft_consensus.cc:2272] T bbe117f2cdc04fab8acb64e91252db18 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.787384 20873 tablet_replica.cc:333] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.788072 20873 raft_consensus.cc:2243] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.788776 20873 raft_consensus.cc:2272] T 299ade5c6c9e48928f5602c43824af92 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.791003 20873 tablet_replica.cc:333] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.791605 20873 raft_consensus.cc:2243] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.792116 20873 raft_consensus.cc:2272] T f84b376f41e049819a74ea69b90cd298 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.794229 20873 tablet_replica.cc:333] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.794776 20873 raft_consensus.cc:2243] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.795248 20873 raft_consensus.cc:2272] T c387a77990f741e2ae187b3f92c6d472 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.797447 20873 tablet_replica.cc:333] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.798300 20873 raft_consensus.cc:2243] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.799437 20873 raft_consensus.cc:2272] T f7b7dc5b82134cd492412751a2d63d9f P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.802529 20873 tablet_replica.cc:333] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.803323 20873 raft_consensus.cc:2243] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.804239 20873 raft_consensus.cc:2272] T 2b5c193cc2e540dbbc926df1219ef72b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.806480 20873 tablet_replica.cc:333] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.807111 20873 raft_consensus.cc:2243] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.807967 20873 raft_consensus.cc:2272] T 42a9ba8203ae4024af5885277061c1a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.810287 20873 tablet_replica.cc:333] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.811022 20873 raft_consensus.cc:2243] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.811980 20873 raft_consensus.cc:2272] T 2012f4a3900141a5b86022143147dd81 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.814345 20873 tablet_replica.cc:333] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.815055 20873 raft_consensus.cc:2243] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Raft consensus shutting down.
W20260709 12:27:40.815598 22702 consensus_peers.cc:597] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 -> Peer c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): Couldn't send request to peer c9a50b2f586448c49281a6618c40a1f7. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:27:40.816045 20873 raft_consensus.cc:2272] T f77cd08fd9014998aebc07bff003d1a8 P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.818161 20873 tablet_replica.cc:333] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.818744 20873 raft_consensus.cc:2243] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.819553 20873 raft_consensus.cc:2272] T 790bdc35efb4419cb67fd1a718e2b584 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.821628 20873 tablet_replica.cc:333] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.822185 20873 raft_consensus.cc:2243] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.822944 20873 raft_consensus.cc:2272] T 40fdb108e6f14522a9ef82da47fc0b74 P ed678a3f9e3d4e0ba5801f1663548796 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.824999 20873 tablet_replica.cc:333] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.825593 20873 raft_consensus.cc:2243] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.826402 20873 raft_consensus.cc:2272] T c66fbf1879e84a19b490058938a4bc34 P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.828369 20873 tablet_replica.cc:333] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.828915 20873 raft_consensus.cc:2243] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.829723 20873 raft_consensus.cc:2272] T 03a703fed624441fb4eb00f38f0ff80d P ed678a3f9e3d4e0ba5801f1663548796 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.831792 20873 tablet_replica.cc:333] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.832332 20873 raft_consensus.cc:2243] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.833146 20873 raft_consensus.cc:2272] T 33d4294bcbec49ad88c8ce7c879b596d P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.835098 20873 tablet_replica.cc:333] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.835639 20873 raft_consensus.cc:2243] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.836081 20873 raft_consensus.cc:2272] T b8e08d44df7b4ab4a3721b9aeb2aaa24 P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.838037 20873 tablet_replica.cc:333] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.838553 20873 raft_consensus.cc:2243] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.839051 20873 raft_consensus.cc:2272] T 1fec8474cec64acca2f6f9303db0b0af P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.841037 20873 tablet_replica.cc:333] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.841620 20873 raft_consensus.cc:2243] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.842054 20873 raft_consensus.cc:2272] T 31f3273ca74242e9b116e3e87078ccef P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.844136 20873 tablet_replica.cc:333] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.844834 20873 raft_consensus.cc:2243] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.845435 20873 raft_consensus.cc:2272] T 2100de7ab7b84cf39a4370858e9b6927 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.847815 20873 tablet_replica.cc:333] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.848488 20873 raft_consensus.cc:2243] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.849340 20873 raft_consensus.cc:2272] T c609d086e32e4033b7376f770a2790a6 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.851245 20873 tablet_replica.cc:333] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.851745 20873 raft_consensus.cc:2243] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.852510 20873 raft_consensus.cc:2272] T 97b8db04a690435f8c84aba1b0f5ec2b P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.854444 20873 tablet_replica.cc:333] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.854930 20873 raft_consensus.cc:2243] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.855682 20873 raft_consensus.cc:2272] T 5e89ee7eb571454eb9956953ae2c7c5d P ed678a3f9e3d4e0ba5801f1663548796 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.857548 20873 tablet_replica.cc:333] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.858040 20873 raft_consensus.cc:2243] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.858554 20873 raft_consensus.cc:2272] T cd094bd2058d4b6d9810ece12a93d849 P ed678a3f9e3d4e0ba5801f1663548796 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.860399 20873 tablet_replica.cc:333] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.860908 20873 raft_consensus.cc:2243] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.861742 20873 raft_consensus.cc:2272] T 285ef7a597884d3a8a0ad5e993a8eb93 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.863355 20873 tablet_replica.cc:333] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.863822 20873 raft_consensus.cc:2243] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.864566 20873 raft_consensus.cc:2272] T 45d56621ac1d470dac3f492c5c1b5256 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.866458 20873 tablet_replica.cc:333] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.866969 20873 raft_consensus.cc:2243] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.867724 20873 raft_consensus.cc:2272] T f2b9f971fd394d129cd62de001799b21 P ed678a3f9e3d4e0ba5801f1663548796 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.869668 20873 tablet_replica.cc:333] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.870121 20873 raft_consensus.cc:2243] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:40.870898 20873 raft_consensus.cc:2272] T 8d4304a0cf75473e8fd1d5791213f0a3 P ed678a3f9e3d4e0ba5801f1663548796 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:40.872808 20873 tablet_replica.cc:333] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796: stopping tablet replica
I20260709 12:27:40.873282 20873 raft_consensus.cc:2243] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:40.873891 20873 raft_consensus.cc:2272] T 51286e1e6cac4310b4960b85e10b91cd P ed678a3f9e3d4e0ba5801f1663548796 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:41.148514 20873 tablet_server.cc:196] TabletServer@127.20.98.68:0 shutdown complete.
I20260709 12:27:41.216150 20873 master.cc:562] Master@127.20.98.126:34211 shutting down...
W20260709 12:27:41.255568 22017 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:27:41.255897 22017 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:41.256101 22017 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:53.972954 21953 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111) [suppressed 31 similar messages]
W20260709 12:27:53.976964 21953 catalog_manager.cc:4755] TS c9a50b2f586448c49281a6618c40a1f7 (127.20.98.65:40323): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bf83ee90e33b4083aebda67b32ca1149: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40323: connect: Connection refused (error 111)
I20260709 12:27:54.880892 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:54.881982 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:54.882344 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P 59c532bc70954b39ab679e8a70103dee: stopping tablet replica
I20260709 12:27:55.002466 20873 master.cc:584] Master@127.20.98.126:34211 shutdown complete.
I20260709 12:27:55.053433 20873 test_util.cc:182] -----------------------------------------------
I20260709 12:27:55.053666 20873 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599888412524-20873-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (124456 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:27:55.057044 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:39987
I20260709 12:27:55.058243 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:55.063668 25293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:55.063778 25294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:55.065411 25296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.066679 20873 server_base.cc:1061] running on GCE node
I20260709 12:27:55.068847 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:55.069058 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:55.069249 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600075069228 us; error 0 us; skew 500 ppm
I20260709 12:27:55.069725 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:55.072006 20873 webserver.cc:533] Webserver started at http://127.20.98.126:37281/ using document root <none> and password file <none>
I20260709 12:27:55.072445 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:55.072603 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:55.072814 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:55.074082 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "1a88150b214a4290a4d5e533b9c0457e"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.078614 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:55.082033 25301 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.082823 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:55.083112 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "1a88150b214a4290a4d5e533b9c0457e"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.083411 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:55.108140 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:55.109484 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:55.149382 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:39987
I20260709 12:27:55.149570 25352 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:39987 every 8 connection(s)
I20260709 12:27:55.154013 25353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.166786 25353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e: Bootstrap starting.
I20260709 12:27:55.172669 25353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.177740 25353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e: No bootstrap required, opened a new log
I20260709 12:27:55.180377 25353 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a88150b214a4290a4d5e533b9c0457e" member_type: VOTER }
I20260709 12:27:55.180908 25353 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.181120 25353 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a88150b214a4290a4d5e533b9c0457e, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.181805 25353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a88150b214a4290a4d5e533b9c0457e" member_type: VOTER }
I20260709 12:27:55.182327 25353 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:55.182559 25353 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:55.182816 25353 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:55.188177 25353 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a88150b214a4290a4d5e533b9c0457e" member_type: VOTER }
I20260709 12:27:55.188747 25353 leader_election.cc:304] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a88150b214a4290a4d5e533b9c0457e; no voters: 
I20260709 12:27:55.190006 25353 leader_election.cc:290] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:55.190433 25356 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:55.191809 25356 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 1 LEADER]: Becoming Leader. State: Replica: 1a88150b214a4290a4d5e533b9c0457e, State: Running, Role: LEADER
I20260709 12:27:55.192523 25356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a88150b214a4290a4d5e533b9c0457e" member_type: VOTER }
I20260709 12:27:55.193547 25353 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:55.201490 25358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a88150b214a4290a4d5e533b9c0457e. Latest consensus state: current_term: 1 leader_uuid: "1a88150b214a4290a4d5e533b9c0457e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a88150b214a4290a4d5e533b9c0457e" member_type: VOTER } }
I20260709 12:27:55.201498 25357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a88150b214a4290a4d5e533b9c0457e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a88150b214a4290a4d5e533b9c0457e" member_type: VOTER } }
I20260709 12:27:55.202190 25358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:55.202476 25357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:55.204241 25366 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:55.209550 25366 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:55.211951 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:55.219194 25366 catalog_manager.cc:1383] Generated new cluster ID: c9cf8130ac8f41ef99c0fcdd0ef63952
I20260709 12:27:55.219447 25366 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:55.249033 25366 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:55.250532 25366 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:55.262468 25366 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e: Generated new TSK 0
I20260709 12:27:55.263123 25366 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:55.278751 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:55.286530 25374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:55.288128 25375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:55.290307 25377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.290809 20873 server_base.cc:1061] running on GCE node
I20260709 12:27:55.292711 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:55.292966 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:55.293218 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600075293166 us; error 0 us; skew 500 ppm
I20260709 12:27:55.293932 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:55.296746 20873 webserver.cc:533] Webserver started at http://127.20.98.65:39189/ using document root <none> and password file <none>
I20260709 12:27:55.297384 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:55.297621 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:55.297950 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:55.299417 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "3e2fd10beaf04318be94c0a3430cef3e"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.304833 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:27:55.308666 25382 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.309597 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:55.309984 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "3e2fd10beaf04318be94c0a3430cef3e"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.310263 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:55.356154 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:55.357566 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:55.359071 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:55.361536 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:55.361975 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.362274 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:55.362509 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.406870 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:34707
I20260709 12:27:55.406984 25444 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:34707 every 8 connection(s)
I20260709 12:27:55.412706 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:55.421739 25449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:55.422943 25450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.426139 20873 server_base.cc:1061] running on GCE node
W20260709 12:27:55.427491 25452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.429306 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:55.429593 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:55.429811 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600075429790 us; error 0 us; skew 500 ppm
I20260709 12:27:55.429896 25445 heartbeater.cc:344] Connected to a master server at 127.20.98.126:39987
I20260709 12:27:55.430373 25445 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:55.430649 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:55.431190 25445 heartbeater.cc:507] Master 127.20.98.126:39987 requested a full tablet report, sending...
I20260709 12:27:55.433696 25318 ts_manager.cc:194] Registered new tserver with Master: 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:55.433887 20873 webserver.cc:533] Webserver started at http://127.20.98.66:45359/ using document root <none> and password file <none>
I20260709 12:27:55.434595 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:55.434819 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:55.435130 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:55.435760 25318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57438
I20260709 12:27:55.436656 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "bf67e247c9e5443ea0099083f496b361"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.441812 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:27:55.446317 25457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.447155 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:27:55.447465 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "bf67e247c9e5443ea0099083f496b361"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.447779 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:55.477327 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:55.478708 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:55.480268 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:55.482787 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:55.483023 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.483265 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:55.483445 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.526904 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:43799
I20260709 12:27:55.527069 25519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:43799 every 8 connection(s)
I20260709 12:27:55.531931 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:55.540263 25523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.544189 20873 server_base.cc:1061] running on GCE node
W20260709 12:27:55.544446 25524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.545544 25520 heartbeater.cc:344] Connected to a master server at 127.20.98.126:39987
I20260709 12:27:55.545931 25520 heartbeater.cc:461] Registering TS with master...
W20260709 12:27:55.546236 25526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.546954 25520 heartbeater.cc:507] Master 127.20.98.126:39987 requested a full tablet report, sending...
I20260709 12:27:55.547353 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:55.547655 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:55.547868 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600075547851 us; error 0 us; skew 500 ppm
I20260709 12:27:55.548497 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:55.549474 25318 ts_manager.cc:194] Registered new tserver with Master: bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:55.551348 20873 webserver.cc:533] Webserver started at http://127.20.98.67:41079/ using document root <none> and password file <none>
I20260709 12:27:55.551401 25318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57448
I20260709 12:27:55.551990 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:55.552240 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:55.552613 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:55.554359 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "05cabf76554146489f61260dbdadf659"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.558936 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:55.562237 25531 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.563138 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:55.563393 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "05cabf76554146489f61260dbdadf659"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.563654 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:55.578845 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:55.580109 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:55.581784 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:55.583807 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:55.583993 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.584170 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:55.584295 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.627249 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:32857
I20260709 12:27:55.627419 25593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:32857 every 8 connection(s)
I20260709 12:27:55.632421 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:55.639892 25597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:55.642325 25598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:55.646224 25600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:55.646332 20873 server_base.cc:1061] running on GCE node
I20260709 12:27:55.647616 25594 heartbeater.cc:344] Connected to a master server at 127.20.98.126:39987
I20260709 12:27:55.647683 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:55.648154 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:55.648164 25594 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:55.648518 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600075648496 us; error 0 us; skew 500 ppm
I20260709 12:27:55.649258 25594 heartbeater.cc:507] Master 127.20.98.126:39987 requested a full tablet report, sending...
I20260709 12:27:55.649520 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:55.651643 25318 ts_manager.cc:194] Registered new tserver with Master: 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:55.652535 20873 webserver.cc:533] Webserver started at http://127.20.98.68:36145/ using document root <none> and password file <none>
I20260709 12:27:55.653141 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:55.653252 25318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57458
I20260709 12:27:55.653527 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:55.653970 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:55.655395 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-3-root/instance:
uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.661155 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:27:55.664976 25605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.665817 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:55.666159 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-3-root
uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:27:55.666458 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:55.689777 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:55.691069 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:55.692489 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:55.694821 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:55.695067 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.695379 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:55.695564 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:55.738153 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.68:42365
I20260709 12:27:55.738306 25667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.68:42365 every 8 connection(s)
I20260709 12:27:55.752354 25668 heartbeater.cc:344] Connected to a master server at 127.20.98.126:39987
I20260709 12:27:55.752776 25668 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:55.753618 25668 heartbeater.cc:507] Master 127.20.98.126:39987 requested a full tablet report, sending...
I20260709 12:27:55.755663 25318 ts_manager.cc:194] Registered new tserver with Master: 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:55.756513 20873 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015042939s
I20260709 12:27:55.757138 25318 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57464
I20260709 12:27:55.783943 25318 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57468:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:27:56.033299 25410 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d902711df4cea9b3d41edac3a3a48 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:56.033499 25485 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d902711df4cea9b3d41edac3a3a48 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:56.034950 25410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d902711df4cea9b3d41edac3a3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.036511 25484 tablet_service.cc:1511] Processing CreateTablet for tablet 60b6b992c02f4199bed5792eda84bf4d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:56.038435 25482 tablet_service.cc:1511] Processing CreateTablet for tablet 1fdf104c9b4e44bc81ed8ead9c9f0041 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:56.038873 25483 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd7967167e543ae8d82c4880099f27e (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:56.035004 25485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d902711df4cea9b3d41edac3a3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.044350 25483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd7967167e543ae8d82c4880099f27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.045365 25482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fdf104c9b4e44bc81ed8ead9c9f0041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.046063 25484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b6b992c02f4199bed5792eda84bf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.045773 25559 tablet_service.cc:1511] Processing CreateTablet for tablet 60b6b992c02f4199bed5792eda84bf4d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:56.047187 25559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b6b992c02f4199bed5792eda84bf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.047629 25409 tablet_service.cc:1511] Processing CreateTablet for tablet 60b6b992c02f4199bed5792eda84bf4d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:56.049033 25409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b6b992c02f4199bed5792eda84bf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.058874 25558 tablet_service.cc:1511] Processing CreateTablet for tablet 13eaa197620646c59092c991e745b86d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:56.060492 25408 tablet_service.cc:1511] Processing CreateTablet for tablet 13eaa197620646c59092c991e745b86d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:56.060568 25480 tablet_service.cc:1511] Processing CreateTablet for tablet 8e182cd9691849a9b13a7c77dde34629 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:56.062124 25408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eaa197620646c59092c991e745b86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.062196 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e182cd9691849a9b13a7c77dde34629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.062129 25481 tablet_service.cc:1511] Processing CreateTablet for tablet 7749b2664d48431c84785782eb9c6580 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:56.064806 25481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7749b2664d48431c84785782eb9c6580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.066680 25479 tablet_service.cc:1511] Processing CreateTablet for tablet 6d12b36c015f4c51b7d0ef14feabe0b9 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:56.068321 25479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d12b36c015f4c51b7d0ef14feabe0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.069967 25557 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd7967167e543ae8d82c4880099f27e (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:56.070816 25407 tablet_service.cc:1511] Processing CreateTablet for tablet 1fdf104c9b4e44bc81ed8ead9c9f0041 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:56.060618 25558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eaa197620646c59092c991e745b86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.072183 25407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fdf104c9b4e44bc81ed8ead9c9f0041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.075001 25478 tablet_service.cc:1511] Processing CreateTablet for tablet 66e0430567d64e6887cc879e2e9b3d61 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:56.076357 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e0430567d64e6887cc879e2e9b3d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.078851 25406 tablet_service.cc:1511] Processing CreateTablet for tablet 7749b2664d48431c84785782eb9c6580 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:56.080344 25406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7749b2664d48431c84785782eb9c6580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.082463 25405 tablet_service.cc:1511] Processing CreateTablet for tablet 919fd4e8dca6404ea25c7dcee45b6a97 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:56.083941 25405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919fd4e8dca6404ea25c7dcee45b6a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.086411 25404 tablet_service.cc:1511] Processing CreateTablet for tablet 6d12b36c015f4c51b7d0ef14feabe0b9 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:56.088709 25403 tablet_service.cc:1511] Processing CreateTablet for tablet 66e0430567d64e6887cc879e2e9b3d61 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:56.090996 25402 tablet_service.cc:1511] Processing CreateTablet for tablet c3271013e0434415b390de1bd1aab244 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:56.093219 25401 tablet_service.cc:1511] Processing CreateTablet for tablet f1b434fa71554dca9e4ef0b94f3967fb (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:56.077564 25557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd7967167e543ae8d82c4880099f27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.078851 25477 tablet_service.cc:1511] Processing CreateTablet for tablet 1704016a67e740008ce23d578992ecaa (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:56.102705 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1704016a67e740008ce23d578992ecaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.109102 25401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b434fa71554dca9e4ef0b94f3967fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.109947 25403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e0430567d64e6887cc879e2e9b3d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.112404 25404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d12b36c015f4c51b7d0ef14feabe0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.114528 25402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3271013e0434415b390de1bd1aab244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.121446 25476 tablet_service.cc:1511] Processing CreateTablet for tablet f1b434fa71554dca9e4ef0b94f3967fb (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:56.122972 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b434fa71554dca9e4ef0b94f3967fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.148471 25556 tablet_service.cc:1511] Processing CreateTablet for tablet 1fdf104c9b4e44bc81ed8ead9c9f0041 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:56.150110 25556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fdf104c9b4e44bc81ed8ead9c9f0041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.150660 25553 tablet_service.cc:1511] Processing CreateTablet for tablet 6d12b36c015f4c51b7d0ef14feabe0b9 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:56.152160 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d12b36c015f4c51b7d0ef14feabe0b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.154440 25552 tablet_service.cc:1511] Processing CreateTablet for tablet c3271013e0434415b390de1bd1aab244 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:56.155865 25552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3271013e0434415b390de1bd1aab244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.156899 25555 tablet_service.cc:1511] Processing CreateTablet for tablet 919fd4e8dca6404ea25c7dcee45b6a97 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:56.158398 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919fd4e8dca6404ea25c7dcee45b6a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.157967 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 1704016a67e740008ce23d578992ecaa (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:56.159425 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1704016a67e740008ce23d578992ecaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.160463 25554 tablet_service.cc:1511] Processing CreateTablet for tablet 8e182cd9691849a9b13a7c77dde34629 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:56.161990 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e182cd9691849a9b13a7c77dde34629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.161551 25550 tablet_service.cc:1511] Processing CreateTablet for tablet f1b434fa71554dca9e4ef0b94f3967fb (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:56.163029 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b434fa71554dca9e4ef0b94f3967fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.200242 25485 tablet_service.cc:1511] Processing CreateTablet for tablet 3c33d5ee86514aeda0b963d59db594a2 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:56.201683 25485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c33d5ee86514aeda0b963d59db594a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.203004 25478 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6db57a7db04a8a8d0736539285c239 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:56.205399 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6db57a7db04a8a8d0736539285c239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.206629 25476 tablet_service.cc:1511] Processing CreateTablet for tablet f88068fafe9c4345a4abefceb627e5c2 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 12:27:56.207131 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:56.208007 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f88068fafe9c4345a4abefceb627e5c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.210083 25688 tablet_bootstrap.cc:492] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:56.218499 25688 tablet_bootstrap.cc:654] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.216611 25483 tablet_service.cc:1511] Processing CreateTablet for tablet 18fe232132fe484c84a12165ab35ea2a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:56.237152 25484 tablet_service.cc:1511] Processing CreateTablet for tablet 743a94d34f3642f6b4bb966f8e08c795 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:56.260154 25410 tablet_service.cc:1511] Processing CreateTablet for tablet 91cdf689f66f41ffaf423525144f0f34 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:56.262487 25410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91cdf689f66f41ffaf423525144f0f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.260247 25559 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6db57a7db04a8a8d0736539285c239 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:56.262107 25558 tablet_service.cc:1511] Processing CreateTablet for tablet 91cdf689f66f41ffaf423525144f0f34 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:56.264134 25559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6db57a7db04a8a8d0736539285c239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.265573 25558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91cdf689f66f41ffaf423525144f0f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.265501 25404 tablet_service.cc:1511] Processing CreateTablet for tablet f88068fafe9c4345a4abefceb627e5c2 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:56.266921 25404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f88068fafe9c4345a4abefceb627e5c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.270138 25403 tablet_service.cc:1511] Processing CreateTablet for tablet 3c33d5ee86514aeda0b963d59db594a2 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:56.270264 25480 tablet_service.cc:1511] Processing CreateTablet for tablet ed5b1adb31b64ffdb249abd286df3062 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:56.271535 25403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c33d5ee86514aeda0b963d59db594a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.276880 25483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18fe232132fe484c84a12165ab35ea2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.282676 25689 tablet_bootstrap.cc:492] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:56.284300 25633 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d902711df4cea9b3d41edac3a3a48 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:56.285769 25633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d902711df4cea9b3d41edac3a3a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.287194 25482 tablet_service.cc:1511] Processing CreateTablet for tablet 340dfb91e8e44fdfaf0b420eefa9df9f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:56.284150 25407 tablet_service.cc:1511] Processing CreateTablet for tablet c468ba201aea46e79fb35a4ec3df27d9 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:56.277525 25481 tablet_service.cc:1511] Processing CreateTablet for tablet fbf093f8ce6c4c699a8c0589bc191c66 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:56.293529 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5b1adb31b64ffdb249abd286df3062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.295941 25557 tablet_service.cc:1511] Processing CreateTablet for tablet c468ba201aea46e79fb35a4ec3df27d9 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:56.297044 25482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340dfb91e8e44fdfaf0b420eefa9df9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.298064 25402 tablet_service.cc:1511] Processing CreateTablet for tablet fbf093f8ce6c4c699a8c0589bc191c66 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:56.299466 25402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf093f8ce6c4c699a8c0589bc191c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.300414 25689 tablet_bootstrap.cc:654] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.301590 25481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf093f8ce6c4c699a8c0589bc191c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.303642 25477 tablet_service.cc:1511] Processing CreateTablet for tablet ae8dca7915604597b895b2257bc049ce (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:56.303898 25555 tablet_service.cc:1511] Processing CreateTablet for tablet f88068fafe9c4345a4abefceb627e5c2 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:56.306839 25632 tablet_service.cc:1511] Processing CreateTablet for tablet 13eaa197620646c59092c991e745b86d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:56.308349 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eaa197620646c59092c991e745b86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.308125 25629 tablet_service.cc:1511] Processing CreateTablet for tablet 919fd4e8dca6404ea25c7dcee45b6a97 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:56.308529 25628 tablet_service.cc:1511] Processing CreateTablet for tablet 8e182cd9691849a9b13a7c77dde34629 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:56.309542 25629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919fd4e8dca6404ea25c7dcee45b6a97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.310467 25631 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd7967167e543ae8d82c4880099f27e (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:56.311349 25628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e182cd9691849a9b13a7c77dde34629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.312898 25630 tablet_service.cc:1511] Processing CreateTablet for tablet 7749b2664d48431c84785782eb9c6580 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:56.314376 25630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7749b2664d48431c84785782eb9c6580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.318212 25631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd7967167e543ae8d82c4880099f27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.318620 25485 tablet_service.cc:1511] Processing CreateTablet for tablet 8d58760f1c094ef78273fe3f2ce60924 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:56.320305 25485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d58760f1c094ef78273fe3f2ce60924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.321748 25484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743a94d34f3642f6b4bb966f8e08c795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.325843 25407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c468ba201aea46e79fb35a4ec3df27d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.334059 25690 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:56.335610 25688 tablet_bootstrap.cc:492] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:56.336158 25688 ts_tablet_manager.cc:1403] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.009s
I20260709 12:27:56.337911 25479 tablet_service.cc:1511] Processing CreateTablet for tablet 67c21509d83b4939a1a492dbd10b3acb (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:56.338440 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8dca7915604597b895b2257bc049ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.339366 25479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c21509d83b4939a1a492dbd10b3acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.339570 25688 raft_consensus.cc:359] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.340190 25557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c468ba201aea46e79fb35a4ec3df27d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.340376 25688 raft_consensus.cc:385] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.340801 25688 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.345543 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f88068fafe9c4345a4abefceb627e5c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.348513 25401 tablet_service.cc:1511] Processing CreateTablet for tablet 743a94d34f3642f6b4bb966f8e08c795 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:56.351027 25627 tablet_service.cc:1511] Processing CreateTablet for tablet 66e0430567d64e6887cc879e2e9b3d61 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:56.351430 25626 tablet_service.cc:1511] Processing CreateTablet for tablet c3271013e0434415b390de1bd1aab244 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:56.352512 25627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e0430567d64e6887cc879e2e9b3d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.353791 25625 tablet_service.cc:1511] Processing CreateTablet for tablet 1704016a67e740008ce23d578992ecaa (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:56.355280 25625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1704016a67e740008ce23d578992ecaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.358448 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 3c33d5ee86514aeda0b963d59db594a2 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:56.359915 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c33d5ee86514aeda0b963d59db594a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.365414 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3271013e0434415b390de1bd1aab244. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.392352 25690 tablet_bootstrap.cc:654] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.384630 25550 tablet_service.cc:1511] Processing CreateTablet for tablet 18fe232132fe484c84a12165ab35ea2a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:56.400463 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18fe232132fe484c84a12165ab35ea2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.402619 25556 tablet_service.cc:1511] Processing CreateTablet for tablet 21d58e43edb84946ae592af63b28862c (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:56.399017 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 743a94d34f3642f6b4bb966f8e08c795 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:56.403234 25688 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.404019 25556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d58e43edb84946ae592af63b28862c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.406417 25559 tablet_service.cc:1511] Processing CreateTablet for tablet 340dfb91e8e44fdfaf0b420eefa9df9f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:56.407718 25559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340dfb91e8e44fdfaf0b420eefa9df9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.411902 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743a94d34f3642f6b4bb966f8e08c795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.418121 25406 tablet_service.cc:1511] Processing CreateTablet for tablet ed5b1adb31b64ffdb249abd286df3062 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:56.419531 25406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5b1adb31b64ffdb249abd286df3062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.423327 25690 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:56.423404 25408 tablet_service.cc:1511] Processing CreateTablet for tablet 03a9d87c866a43c1aaad7aca6383189a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:56.424091 25690 ts_tablet_manager.cc:1403] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.090s	user 0.002s	sys 0.009s
I20260709 12:27:56.425060 25594 heartbeater.cc:499] Master 127.20.98.126:39987 was elected leader, sending a full tablet report...
I20260709 12:27:56.425662 25408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a9d87c866a43c1aaad7aca6383189a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.431512 25409 tablet_service.cc:1511] Processing CreateTablet for tablet 67c21509d83b4939a1a492dbd10b3acb (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:56.432888 25409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c21509d83b4939a1a492dbd10b3acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.434516 25688 ts_tablet_manager.cc:1434] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 12:27:56.435592 25688 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:56.438570 25445 heartbeater.cc:499] Master 127.20.98.126:39987 was elected leader, sending a full tablet report...
I20260709 12:27:56.441880 25480 tablet_service.cc:1511] Processing CreateTablet for tablet 5117c622cec24a8fb3f80b35f2d10db8 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:56.443428 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5117c622cec24a8fb3f80b35f2d10db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.448064 25690 raft_consensus.cc:359] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.448758 25554 tablet_service.cc:1511] Processing CreateTablet for tablet 8d58760f1c094ef78273fe3f2ce60924 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:56.456746 25633 tablet_service.cc:1511] Processing CreateTablet for tablet 91cdf689f66f41ffaf423525144f0f34 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:56.463629 25695 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:56.464181 25633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91cdf689f66f41ffaf423525144f0f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.467257 25689 tablet_bootstrap.cc:492] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:56.467852 25689 ts_tablet_manager.cc:1403] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.186s	user 0.012s	sys 0.000s
I20260709 12:27:56.472829 25555 tablet_service.cc:1511] Processing CreateTablet for tablet 62d6fff0aa59444fbdd7d28b71f0c28e (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:56.479051 25484 tablet_service.cc:1511] Processing CreateTablet for tablet 1212a262e8424670b13c83406b35dae8 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:56.480540 25484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1212a262e8424670b13c83406b35dae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.483188 25401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743a94d34f3642f6b4bb966f8e08c795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.457728 25690 raft_consensus.cc:385] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.493947 25403 tablet_service.cc:1511] Processing CreateTablet for tablet ae8dca7915604597b895b2257bc049ce (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:56.440809 25476 tablet_service.cc:1511] Processing CreateTablet for tablet d0af0dee12bd4a1c9b0b4cdca091a4ea (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:56.500041 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0af0dee12bd4a1c9b0b4cdca091a4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.501462 25478 tablet_service.cc:1511] Processing CreateTablet for tablet 62d6fff0aa59444fbdd7d28b71f0c28e (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:56.503008 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d6fff0aa59444fbdd7d28b71f0c28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.511581 25688 tablet_bootstrap.cc:654] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.501462 25552 tablet_service.cc:1511] Processing CreateTablet for tablet 03a9d87c866a43c1aaad7aca6383189a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:56.512486 25695 tablet_bootstrap.cc:654] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.514014 25552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a9d87c866a43c1aaad7aca6383189a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.515311 25553 tablet_service.cc:1511] Processing CreateTablet for tablet ae8dca7915604597b895b2257bc049ce (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:56.515327 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 9893e663e5c94468ac06743c6cbcec9d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:56.519208 25403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8dca7915604597b895b2257bc049ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.518164 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9893e663e5c94468ac06743c6cbcec9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.459812 25628 tablet_service.cc:1511] Processing CreateTablet for tablet 4c6db57a7db04a8a8d0736539285c239 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:56.526196 25628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c6db57a7db04a8a8d0736539285c239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.485917 25690 raft_consensus.cc:740] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.540863 25404 tablet_service.cc:1511] Processing CreateTablet for tablet d0af0dee12bd4a1c9b0b4cdca091a4ea (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:56.542292 25404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0af0dee12bd4a1c9b0b4cdca091a4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.544713 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8dca7915604597b895b2257bc049ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.558166 25624 tablet_service.cc:1511] Processing CreateTablet for tablet fbf093f8ce6c4c699a8c0589bc191c66 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:56.558846 25520 heartbeater.cc:499] Master 127.20.98.126:39987 was elected leader, sending a full tablet report...
I20260709 12:27:56.552809 25690 consensus_queue.cc:260] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.531037 25410 tablet_service.cc:1511] Processing CreateTablet for tablet 62d6fff0aa59444fbdd7d28b71f0c28e (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:56.570293 25410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d6fff0aa59444fbdd7d28b71f0c28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.573520 25405 tablet_service.cc:1511] Processing CreateTablet for tablet 21d58e43edb84946ae592af63b28862c (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:56.575021 25405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d58e43edb84946ae592af63b28862c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.582840 25625 tablet_service.cc:1511] Processing CreateTablet for tablet 18fe232132fe484c84a12165ab35ea2a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:56.538575 25477 tablet_service.cc:1511] Processing CreateTablet for tablet 01a03988797840b79a9c026cc8b293a7 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:56.585480 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a03988797840b79a9c026cc8b293a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.586511 25558 tablet_service.cc:1511] Processing CreateTablet for tablet 1212a262e8424670b13c83406b35dae8 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:56.590934 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d6fff0aa59444fbdd7d28b71f0c28e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:56.629267 25303 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 47415.5us
I20260709 12:27:56.629906 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf093f8ce6c4c699a8c0589bc191c66. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:56.632323 25595 tablet.cc:2406] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:56.634480 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d58760f1c094ef78273fe3f2ce60924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.638445 25625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18fe232132fe484c84a12165ab35ea2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.576669 25557 tablet_service.cc:1511] Processing CreateTablet for tablet 5117c622cec24a8fb3f80b35f2d10db8 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:56.655049 25407 tablet_service.cc:1511] Processing CreateTablet for tablet 9893e663e5c94468ac06743c6cbcec9d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:56.656545 25407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9893e663e5c94468ac06743c6cbcec9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.674050 25632 tablet_service.cc:1511] Processing CreateTablet for tablet c468ba201aea46e79fb35a4ec3df27d9 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:56.675447 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c468ba201aea46e79fb35a4ec3df27d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:56.619300 25304 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 43704.2us
I20260709 12:27:56.683719 25689 raft_consensus.cc:359] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.686555 25689 raft_consensus.cc:385] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.689329 25689 raft_consensus.cc:740] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.687465 25558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1212a262e8424670b13c83406b35dae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.687593 25626 tablet_service.cc:1511] Processing CreateTablet for tablet ed5b1adb31b64ffdb249abd286df3062 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:56.689208 25627 tablet_service.cc:1511] Processing CreateTablet for tablet 340dfb91e8e44fdfaf0b420eefa9df9f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:56.686316 25629 tablet_service.cc:1511] Processing CreateTablet for tablet 03a9d87c866a43c1aaad7aca6383189a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:56.685540 25404 tablet_service.cc:1511] Processing CreateTablet for tablet 1212a262e8424670b13c83406b35dae8 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
W20260709 12:27:56.700554 25305 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 109418us
I20260709 12:27:56.705495 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5b1adb31b64ffdb249abd286df3062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.690250 25550 tablet_service.cc:1511] Processing CreateTablet for tablet e612523c0021486da0ab8d3a964ad76c (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:56.709884 25630 tablet_service.cc:1511] Processing CreateTablet for tablet 67c21509d83b4939a1a492dbd10b3acb (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:56.719264 25557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5117c622cec24a8fb3f80b35f2d10db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.728416 25695 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:56.729511 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e612523c0021486da0ab8d3a964ad76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.736699 25631 tablet_service.cc:1511] Processing CreateTablet for tablet 21d58e43edb84946ae592af63b28862c (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:56.738492 25631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d58e43edb84946ae592af63b28862c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.729043 25695 ts_tablet_manager.cc:1403] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.266s	user 0.062s	sys 0.076s
I20260709 12:27:56.741806 25630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c21509d83b4939a1a492dbd10b3acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.759248 25629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a9d87c866a43c1aaad7aca6383189a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.758988 25403 tablet_service.cc:1511] Processing CreateTablet for tablet e612523c0021486da0ab8d3a964ad76c (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:56.759902 25668 heartbeater.cc:499] Master 127.20.98.126:39987 was elected leader, sending a full tablet report...
I20260709 12:27:56.761824 25690 ts_tablet_manager.cc:1434] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.337s	user 0.026s	sys 0.011s
I20260709 12:27:56.763021 25690 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:56.764883 25627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340dfb91e8e44fdfaf0b420eefa9df9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.759670 25402 tablet_service.cc:1511] Processing CreateTablet for tablet 01a03988797840b79a9c026cc8b293a7 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:56.766264 25402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a03988797840b79a9c026cc8b293a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.767009 25404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1212a262e8424670b13c83406b35dae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.751947 25689 consensus_queue.cc:260] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.772030 25688 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:56.772650 25688 ts_tablet_manager.cc:1403] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.337s	user 0.013s	sys 0.006s
I20260709 12:27:56.775974 25688 raft_consensus.cc:359] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:56.776719 25688 raft_consensus.cc:385] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.777024 25688 raft_consensus.cc:740] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.782107 25688 consensus_queue.cc:260] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:56.791191 25406 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd84795939b41f6989d135d7bf7bdd5 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:56.799371 25695 raft_consensus.cc:359] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.800189 25695 raft_consensus.cc:385] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.800508 25695 raft_consensus.cc:740] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.801579 25403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e612523c0021486da0ab8d3a964ad76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.803004 25688 ts_tablet_manager.cc:1434] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:27:56.803601 25406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd84795939b41f6989d135d7bf7bdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.805658 25695 consensus_queue.cc:260] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.815578 25480 tablet_service.cc:1511] Processing CreateTablet for tablet b412956a26e641d181700046c55c1456 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:56.817566 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b412956a26e641d181700046c55c1456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.831671 25481 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd84795939b41f6989d135d7bf7bdd5 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:56.834105 25554 tablet_service.cc:1511] Processing CreateTablet for tablet b412956a26e641d181700046c55c1456 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:56.835486 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b412956a26e641d181700046c55c1456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.838024 25632 tablet_service.cc:1511] Processing CreateTablet for tablet 8d58760f1c094ef78273fe3f2ce60924 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:56.838516 25689 ts_tablet_manager.cc:1434] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.370s	user 0.010s	sys 0.004s
I20260709 12:27:56.839419 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d58760f1c094ef78273fe3f2ce60924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.841369 25690 tablet_bootstrap.cc:654] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.843532 25405 tablet_service.cc:1511] Processing CreateTablet for tablet 43c409decd6b41e38642164bc29adcac (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:56.844691 25693 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.890472 25693 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.900816 25626 tablet_service.cc:1511] Processing CreateTablet for tablet 9893e663e5c94468ac06743c6cbcec9d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:56.902308 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9893e663e5c94468ac06743c6cbcec9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.902191 25401 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd86abda6394bcfa1249aef297ea152 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:56.905558 25628 tablet_service.cc:1511] Processing CreateTablet for tablet e612523c0021486da0ab8d3a964ad76c (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:56.893112 25693 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:56.916122 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd86abda6394bcfa1249aef297ea152 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:56.857722 25695 ts_tablet_manager.cc:1434] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.003s
I20260709 12:27:56.860533 25632 tablet_service.cc:1511] Processing CreateTablet for tablet d0af0dee12bd4a1c9b0b4cdca091a4ea (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:56.917649 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd86abda6394bcfa1249aef297ea152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.862347 25689 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:56.918992 25695 tablet_bootstrap.cc:492] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:56.920876 25477 tablet_service.cc:1511] Processing CreateTablet for tablet 56b2d6e550e94756880164ae94318541 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:56.869269 25688 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:56.871059 25553 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd84795939b41f6989d135d7bf7bdd5 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:56.923599 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd84795939b41f6989d135d7bf7bdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.881067 25625 tablet_service.cc:1511] Processing CreateTablet for tablet 01a03988797840b79a9c026cc8b293a7 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:56.890067 25405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c409decd6b41e38642164bc29adcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.906904 25628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e612523c0021486da0ab8d3a964ad76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.861891 25481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd84795939b41f6989d135d7bf7bdd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.867084 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 5117c622cec24a8fb3f80b35f2d10db8 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:56.853510 25699 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.925944 25476 tablet_service.cc:1511] Processing CreateTablet for tablet 43c409decd6b41e38642164bc29adcac (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:56.928181 25633 tablet_service.cc:1511] Processing CreateTablet for tablet b412956a26e641d181700046c55c1456 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:56.934971 25550 tablet_service.cc:1511] Processing CreateTablet for tablet 56b2d6e550e94756880164ae94318541 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:56.938269 25631 tablet_service.cc:1511] Processing CreateTablet for tablet 43c409decd6b41e38642164bc29adcac (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:56.939406 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b2d6e550e94756880164ae94318541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.943796 25625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a03988797840b79a9c026cc8b293a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.947239 25693 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.947779 25693 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:56.948714 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0af0dee12bd4a1c9b0b4cdca091a4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.942931 25699 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:56.949761 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c409decd6b41e38642164bc29adcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.951247 25693 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:56.954319 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b2d6e550e94756880164ae94318541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.965991 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5117c622cec24a8fb3f80b35f2d10db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.968142 25633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b412956a26e641d181700046c55c1456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.969960 25631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c409decd6b41e38642164bc29adcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.970366 25406 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd4b00fcdba43ccac1dc476ba3abbf5 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:56.979982 25401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd86abda6394bcfa1249aef297ea152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.013609 25690 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:57.014221 25690 ts_tablet_manager.cc:1403] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.251s	user 0.014s	sys 0.002s
I20260709 12:27:57.017693 25690 raft_consensus.cc:359] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.024428 25690 raft_consensus.cc:385] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.024824 25690 raft_consensus.cc:740] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.025699 25690 consensus_queue.cc:260] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.028280 25690 ts_tablet_manager.cc:1434] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:27:57.031852 25690 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:57.033546 25629 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd86abda6394bcfa1249aef297ea152 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:57.034952 25629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd86abda6394bcfa1249aef297ea152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.040846 25627 tablet_service.cc:1511] Processing CreateTablet for tablet 56b2d6e550e94756880164ae94318541 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:57.046687 25627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b2d6e550e94756880164ae94318541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.050017 25688 tablet_bootstrap.cc:700] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659: Time spent opening tablet: real 0.109s	user 0.002s	sys 0.000s
I20260709 12:27:57.047458 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:57.058224 25406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd4b00fcdba43ccac1dc476ba3abbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.054630 25699 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:57.048342 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:27:57.068691 25533 leader_election.cc:343] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.072046 25630 tablet_service.cc:1511] Processing CreateTablet for tablet 64358b60fab548429df4d7dc1d83a406 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:57.074710 25697 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.075251 25697 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.077082 25480 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd4b00fcdba43ccac1dc476ba3abbf5 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:57.078075 25697 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:57.078502 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd4b00fcdba43ccac1dc476ba3abbf5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:57.090770 25533 leader_election.cc:343] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.082370 25688 tablet_bootstrap.cc:654] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.105657 25558 tablet_service.cc:1511] Processing CreateTablet for tablet 6fd4b00fcdba43ccac1dc476ba3abbf5 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:57.107144 25558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fd4b00fcdba43ccac1dc476ba3abbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.098162 25630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64358b60fab548429df4d7dc1d83a406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.122215 25477 tablet_service.cc:1511] Processing CreateTablet for tablet 64358b60fab548429df4d7dc1d83a406 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:57.123602 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64358b60fab548429df4d7dc1d83a406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.126372 25690 tablet_bootstrap.cc:654] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.128046 25478 tablet_service.cc:1511] Processing CreateTablet for tablet fb4fcc72a03d416991a845dcfd4b9b5f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:57.129380 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4fcc72a03d416991a845dcfd4b9b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.141263 25689 tablet_bootstrap.cc:700] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361: Time spent opening tablet: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:27:57.170017 25697 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.169977 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:57.170802 25697 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:27:57.172012 25459 leader_election.cc:343] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.175232 25697 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:57.178916 25633 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3076f64046458ab4e3df3dfdd2a8c1 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:57.182251 25633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3076f64046458ab4e3df3dfdd2a8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.172665 25695 tablet_bootstrap.cc:654] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.203292 25689 tablet_bootstrap.cc:654] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.212582 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3076f64046458ab4e3df3dfdd2a8c1 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:57.213967 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3076f64046458ab4e3df3dfdd2a8c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:57.214385 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:57.214360 25481 tablet_service.cc:1511] Processing CreateTablet for tablet cbe7e65f43db4cfeb9a77fb1a77c5b86 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:57.219355 25481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe7e65f43db4cfeb9a77fb1a77c5b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.222667 25553 tablet_service.cc:1511] Processing CreateTablet for tablet fb4fcc72a03d416991a845dcfd4b9b5f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:57.224081 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4fcc72a03d416991a845dcfd4b9b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.231954 25626 tablet_service.cc:1511] Processing CreateTablet for tablet 4c373e378ec64a5aaac62d18c96517ce (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:57.233323 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c373e378ec64a5aaac62d18c96517ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.234690 25405 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3076f64046458ab4e3df3dfdd2a8c1 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:57.236069 25405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3076f64046458ab4e3df3dfdd2a8c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.236325 25401 tablet_service.cc:1511] Processing CreateTablet for tablet 64358b60fab548429df4d7dc1d83a406 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:57.237588 25401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64358b60fab548429df4d7dc1d83a406. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.244959 25403 tablet_service.cc:1511] Processing CreateTablet for tablet cbe7e65f43db4cfeb9a77fb1a77c5b86 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:57.246346 25403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe7e65f43db4cfeb9a77fb1a77c5b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.252192 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:27:57.253996 25460 leader_election.cc:343] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.254549 25460 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:27:57.255360 25699 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.259495 25700 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.259583 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:57.260116 25700 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.262112 25688 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
W20260709 12:27:57.262235 25535 leader_election.cc:343] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.262714 25688 ts_tablet_manager.cc:1403] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.459s	user 0.008s	sys 0.020s
I20260709 12:27:57.262784 25535 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:57.263212 25700 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:57.253808 25550 tablet_service.cc:1511] Processing CreateTablet for tablet cbe7e65f43db4cfeb9a77fb1a77c5b86 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:57.265151 25693 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.229161 25632 tablet_service.cc:1511] Processing CreateTablet for tablet fb4fcc72a03d416991a845dcfd4b9b5f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:57.275780 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4fcc72a03d416991a845dcfd4b9b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.275478 25688 raft_consensus.cc:359] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.275876 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe7e65f43db4cfeb9a77fb1a77c5b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.276291 25688 raft_consensus.cc:385] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.276674 25688 raft_consensus.cc:740] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.279716 25402 tablet_service.cc:1511] Processing CreateTablet for tablet 4c373e378ec64a5aaac62d18c96517ce (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:57.281113 25402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c373e378ec64a5aaac62d18c96517ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.311945 25554 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5d533e66e74b518a0074545fd8e96a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:57.313365 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5d533e66e74b518a0074545fd8e96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.314169 25630 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5d533e66e74b518a0074545fd8e96a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:57.318248 25630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5d533e66e74b518a0074545fd8e96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.317843 25557 tablet_service.cc:1511] Processing CreateTablet for tablet 80a46b4dd44940dc911e876c097f12fe (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:57.322890 25557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a46b4dd44940dc911e876c097f12fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.323092 25406 tablet_service.cc:1511] Processing CreateTablet for tablet 2a5d533e66e74b518a0074545fd8e96a (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:57.324393 25406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5d533e66e74b518a0074545fd8e96a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.319072 25476 tablet_service.cc:1511] Processing CreateTablet for tablet 80a46b4dd44940dc911e876c097f12fe (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:57.319097 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:57.325954 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a46b4dd44940dc911e876c097f12fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:57.326566 25532 leader_election.cc:343] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.327065 25532 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:57.328013 25693 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.333425 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:57.335590 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:57.338891 25477 tablet_service.cc:1511] Processing CreateTablet for tablet f2cd2d2b04c741948386a7e2706f99b7 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:57.310343 25478 tablet_service.cc:1511] Processing CreateTablet for tablet 4c373e378ec64a5aaac62d18c96517ce (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 12:27:57.348043 25386 leader_election.cc:343] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:57.351275 25386 leader_election.cc:343] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.354087 25555 tablet_service.cc:1511] Processing CreateTablet for tablet f2cd2d2b04c741948386a7e2706f99b7 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:57.355499 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2cd2d2b04c741948386a7e2706f99b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.355635 25689 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:57.356252 25689 ts_tablet_manager.cc:1403] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.494s	user 0.016s	sys 0.001s
I20260709 12:27:57.357676 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2cd2d2b04c741948386a7e2706f99b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.359859 25689 raft_consensus.cc:359] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.360666 25689 raft_consensus.cc:385] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.360982 25689 raft_consensus.cc:740] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.361807 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:57.362141 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:57.362535 25643 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:27:57.356240 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 80a46b4dd44940dc911e876c097f12fe (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:57.369139 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a46b4dd44940dc911e876c097f12fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.373656 25689 consensus_queue.cc:260] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.374148 25405 tablet_service.cc:1511] Processing CreateTablet for tablet f2cd2d2b04c741948386a7e2706f99b7 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:57.375592 25405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2cd2d2b04c741948386a7e2706f99b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.379233 25689 ts_tablet_manager.cc:1434] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.006s
W20260709 12:27:57.379066 25384 leader_election.cc:343] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.380373 25689 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:57.380293 25384 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:57.381297 25697 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.382797 25384 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:27:57.383672 25697 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.384057 25697 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.384392 25697 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.340799 25688 consensus_queue.cc:260] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.395731 25693 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.396252 25693 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.401113 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:57.402551 25693 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:27:57.403628 25535 leader_election.cc:343] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.405591 25688 ts_tablet_manager.cc:1434] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.142s	user 0.002s	sys 0.008s
I20260709 12:27:57.406807 25688 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:57.412258 25697 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.413416 25690 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:57.414034 25690 ts_tablet_manager.cc:1403] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.382s	user 0.022s	sys 0.022s
I20260709 12:27:57.433359 25626 tablet_service.cc:1511] Processing CreateTablet for tablet f2b0ab9ea8a441e5af5bf911f5c0a649 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:57.434820 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b0ab9ea8a441e5af5bf911f5c0a649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.434970 25697 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:57.445034 25695 tablet_bootstrap.cc:492] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:57.444936 25689 tablet_bootstrap.cc:654] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.446391 25695 ts_tablet_manager.cc:1403] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.528s	user 0.011s	sys 0.015s
I20260709 12:27:57.450381 25688 tablet_bootstrap.cc:654] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.466645 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:57.467486 25495 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:57.465493 25695 raft_consensus.cc:359] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.469952 25609 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:57.473502 25695 raft_consensus.cc:385] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.473927 25695 raft_consensus.cc:740] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.473978 25700 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.474579 25700 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.475082 25700 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.476043 25690 raft_consensus.cc:359] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:57.476972 25690 raft_consensus.cc:385] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.477368 25690 raft_consensus.cc:740] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.478293 25690 consensus_queue.cc:260] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:57.481055 25690 ts_tablet_manager.cc:1434] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.000s
I20260709 12:27:57.489097 25695 consensus_queue.cc:260] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.490790 25626 tablet_service.cc:1511] Processing CreateTablet for tablet d3837703213a42109c702302ad5f6c0d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:57.492197 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3837703213a42109c702302ad5f6c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.492224 25700 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.496057 25630 tablet_service.cc:1511] Processing CreateTablet for tablet e04d956db2a3482f97d01e0e1e82ebdd (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:57.497470 25630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04d956db2a3482f97d01e0e1e82ebdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.500828 25632 tablet_service.cc:1511] Processing CreateTablet for tablet 224263ffd6b64b1c8cba6c27db4d5c4f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:57.502295 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224263ffd6b64b1c8cba6c27db4d5c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.503691 25695 ts_tablet_manager.cc:1434] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.002s
I20260709 12:27:57.504762 25700 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:57.507537 25689 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:57.508160 25689 ts_tablet_manager.cc:1403] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.001s
I20260709 12:27:57.511662 25689 raft_consensus.cc:359] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.512475 25689 raft_consensus.cc:385] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.512812 25689 raft_consensus.cc:740] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.514194 25695 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:57.518365 25689 consensus_queue.cc:260] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.520498 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 19b643e26e28481e80dd52e2609d357d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:57.521944 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b643e26e28481e80dd52e2609d357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.524399 25695 tablet_bootstrap.cc:654] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.527155 25689 ts_tablet_manager.cc:1434] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 12:27:57.528381 25689 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:57.539065 25689 tablet_bootstrap.cc:654] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.568925 25632 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc486747ff742b4a5b17a179125bbfd (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:57.576370 25624 tablet_service.cc:1511] Processing CreateTablet for tablet cb631167f2654873a2976c1c5e2617de (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:57.576994 25632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc486747ff742b4a5b17a179125bbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.570196 25626 tablet_service.cc:1511] Processing CreateTablet for tablet 7c836d04de714eb8bdc97e6f4246f014 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:57.578693 25695 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:57.578819 25626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c836d04de714eb8bdc97e6f4246f014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.579284 25695 ts_tablet_manager.cc:1403] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 12:27:57.583855 25695 raft_consensus.cc:359] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.584614 25695 raft_consensus.cc:385] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.585440 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb631167f2654873a2976c1c5e2617de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.588152 25689 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:57.588716 25689 ts_tablet_manager.cc:1403] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 12:27:57.591984 25689 raft_consensus.cc:359] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:57.592748 25689 raft_consensus.cc:385] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.593089 25689 raft_consensus.cc:740] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.593899 25689 consensus_queue.cc:260] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:57.584972 25695 raft_consensus.cc:740] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.595911 25695 consensus_queue.cc:260] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.598539 25695 ts_tablet_manager.cc:1434] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 12:27:57.599364 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:27:57.599687 25695 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:57.600021 25495 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.606693 25695 tablet_bootstrap.cc:654] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.607884 25481 tablet_service.cc:1511] Processing CreateTablet for tablet e04d956db2a3482f97d01e0e1e82ebdd (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:57.610848 25689 ts_tablet_manager.cc:1434] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 12:27:57.618039 25689 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:57.624151 25477 tablet_service.cc:1511] Processing CreateTablet for tablet 7d18d987a38d42a0bfa897026a77afc3 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:57.627954 25695 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:57.612061 25479 tablet_service.cc:1511] Processing CreateTablet for tablet 6e4aceeecf604044aba90b5fbaa08a0f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:57.614539 25481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04d956db2a3482f97d01e0e1e82ebdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.631178 25695 ts_tablet_manager.cc:1403] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.011s
I20260709 12:27:57.631350 25476 tablet_service.cc:1511] Processing CreateTablet for tablet f2b0ab9ea8a441e5af5bf911f5c0a649 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:57.634128 25476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b0ab9ea8a441e5af5bf911f5c0a649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.636125 25479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e4aceeecf604044aba90b5fbaa08a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.638603 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:57.639086 25477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d18d987a38d42a0bfa897026a77afc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.639699 25418 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 1: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:27:57.638888 25689 tablet_bootstrap.cc:654] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.641556 25480 tablet_service.cc:1511] Processing CreateTablet for tablet 224263ffd6b64b1c8cba6c27db4d5c4f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:57.643486 25480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224263ffd6b64b1c8cba6c27db4d5c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.647614 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:57.648617 25419 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 1: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:27:57.648147 25695 raft_consensus.cc:359] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:57.611821 25484 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc486747ff742b4a5b17a179125bbfd (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:57.653247 25695 raft_consensus.cc:385] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.653434 25484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc486747ff742b4a5b17a179125bbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.653852 25695 raft_consensus.cc:740] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.655027 25695 consensus_queue.cc:260] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:57.659583 25695 ts_tablet_manager.cc:1434] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.007s
I20260709 12:27:57.660925 25695 tablet_bootstrap.cc:492] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:57.662858 25483 tablet_service.cc:1511] Processing CreateTablet for tablet cb631167f2654873a2976c1c5e2617de (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:57.664208 25483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb631167f2654873a2976c1c5e2617de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.664834 25690 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:57.667953 25699 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.668516 25699 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.669795 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:57.616720 25495 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:27:57.675626 25386 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:57.677665 25697 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.677016 25699 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:57.698686 25478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c373e378ec64a5aaac62d18c96517ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.671218 25695 tablet_bootstrap.cc:654] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.710923 25690 tablet_bootstrap.cc:654] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:57.718183 25384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 335441us
W20260709 12:27:57.719316 25532 leader_election.cc:343] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.719975 25532 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:57.720430 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:57.720990 25693 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.721544 25643 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 1: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:27:57.723984 25697 raft_consensus.cc:697] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:27:57.725148 25697 consensus_queue.cc:237] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.736207 25406 tablet_service.cc:1511] Processing CreateTablet for tablet 7d18d987a38d42a0bfa897026a77afc3 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:57.736717 25403 tablet_service.cc:1511] Processing CreateTablet for tablet 224263ffd6b64b1c8cba6c27db4d5c4f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:57.737838 25406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d18d987a38d42a0bfa897026a77afc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.738521 25403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224263ffd6b64b1c8cba6c27db4d5c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.739287 25700 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.739817 25700 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:57.736092 25402 tablet_service.cc:1511] Processing CreateTablet for tablet d3837703213a42109c702302ad5f6c0d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:57.744812 25700 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:57.746035 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:57.746827 25404 tablet_service.cc:1511] Processing CreateTablet for tablet 19b643e26e28481e80dd52e2609d357d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:57.749081 25407 tablet_service.cc:1511] Processing CreateTablet for tablet 6e4aceeecf604044aba90b5fbaa08a0f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:57.749694 25410 tablet_service.cc:1511] Processing CreateTablet for tablet cb631167f2654873a2976c1c5e2617de (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:57.750221 25401 tablet_service.cc:1511] Processing CreateTablet for tablet f2b0ab9ea8a441e5af5bf911f5c0a649 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:57.751801 25409 tablet_service.cc:1511] Processing CreateTablet for tablet 7c836d04de714eb8bdc97e6f4246f014 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:57.768190 25722 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:57.772568 25606 leader_election.cc:343] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.776556 25722 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.779549 25722 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:57.781652 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:57.782311 25495 raft_consensus.cc:2468] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:57.783645 25609 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:57.784536 25722 raft_consensus.cc:2804] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.784933 25722 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.785317 25722 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.812249 25700 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.820581 25688 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:57.827914 25695 tablet_bootstrap.cc:492] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:57.829792 25695 ts_tablet_manager.cc:1403] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.039s
I20260709 12:27:57.817390 25700 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.833868 25688 ts_tablet_manager.cc:1403] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.427s	user 0.009s	sys 0.024s
I20260709 12:27:57.841113 25689 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:57.841720 25689 ts_tablet_manager.cc:1403] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.224s	user 0.022s	sys 0.017s
I20260709 12:27:57.843202 25700 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:57.846196 25689 raft_consensus.cc:359] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.847119 25689 raft_consensus.cc:385] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.847515 25689 raft_consensus.cc:740] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.847615 25688 raft_consensus.cc:359] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:57.848591 25688 raft_consensus.cc:385] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.848435 25689 consensus_queue.cc:260] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:57.870177 25554 tablet_service.cc:1511] Processing CreateTablet for tablet d3837703213a42109c702302ad5f6c0d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:57.871917 25554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3837703213a42109c702302ad5f6c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.871963 25550 tablet_service.cc:1511] Processing CreateTablet for tablet 7d18d987a38d42a0bfa897026a77afc3 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:57.872303 25557 tablet_service.cc:1511] Processing CreateTablet for tablet e04d956db2a3482f97d01e0e1e82ebdd (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:57.873957 25555 tablet_service.cc:1511] Processing CreateTablet for tablet 19b643e26e28481e80dd52e2609d357d (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:57.874524 25550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d18d987a38d42a0bfa897026a77afc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.875765 25553 tablet_service.cc:1511] Processing CreateTablet for tablet 8cc486747ff742b4a5b17a179125bbfd (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:57.877355 25555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b643e26e28481e80dd52e2609d357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.879001 25553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc486747ff742b4a5b17a179125bbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.880331 25558 tablet_service.cc:1511] Processing CreateTablet for tablet 7c836d04de714eb8bdc97e6f4246f014 (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:57.881539 25558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c836d04de714eb8bdc97e6f4246f014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.883893 25557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04d956db2a3482f97d01e0e1e82ebdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.891126 25402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3837703213a42109c702302ad5f6c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.901408 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:57.902912 25722 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:27:57.904078 25606 leader_election.cc:343] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.904079 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:57.905844 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:27:57.906134 25609 leader_election.cc:343] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.906416 25495 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.906611 25609 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:57.909780 25404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19b643e26e28481e80dd52e2609d357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.912317 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:57.913897 25410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb631167f2654873a2976c1c5e2617de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:57.918745 25459 leader_election.cc:343] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.921854 25401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b0ab9ea8a441e5af5bf911f5c0a649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.926292 25409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c836d04de714eb8bdc97e6f4246f014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.932619 25407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e4aceeecf604044aba90b5fbaa08a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:57.938100 25495 raft_consensus.cc:2468] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:27:57.946022 25722 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:57.950390 25722 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.950528 25609 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:57.951534 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:27:57.952536 25494 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 1: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:27:57.954442 25609 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:57.956461 25695 raft_consensus.cc:359] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.959100 25695 raft_consensus.cc:385] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.959491 25695 raft_consensus.cc:740] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.960518 25689 ts_tablet_manager.cc:1434] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.118s	user 0.008s	sys 0.001s
I20260709 12:27:57.960455 25695 consensus_queue.cc:260] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.970535 25690 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:57.971127 25690 ts_tablet_manager.cc:1403] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.307s	user 0.027s	sys 0.013s
I20260709 12:27:57.974499 25689 tablet_bootstrap.cc:492] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:57.951538 25722 raft_consensus.cc:2804] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.980589 25700 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.983814 25689 tablet_bootstrap.cc:654] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.986631 25722 raft_consensus.cc:697] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:27:57.988960 25722 consensus_queue.cc:237] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:57.990007 25690 raft_consensus.cc:359] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:57.990823 25690 raft_consensus.cc:385] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.991144 25690 raft_consensus.cc:740] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.991951 25690 consensus_queue.cc:260] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:57.849104 25688 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.999022 25688 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.000283 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.001456 25420 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:58.002835 25551 tablet_service.cc:1511] Processing CreateTablet for tablet 6e4aceeecf604044aba90b5fbaa08a0f (DEFAULT_TABLE table=test-workload [id=84921c2dd11841d7a494c5b9f36b5898]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:58.004436 25551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e4aceeecf604044aba90b5fbaa08a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:58.008502 25690 ts_tablet_manager.cc:1434] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.005s
I20260709 12:27:58.009666 25688 ts_tablet_manager.cc:1434] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.173s	user 0.011s	sys 0.000s
I20260709 12:27:58.010957 25688 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:58.020015 25458 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:27:58.021375 25699 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.021780 25699 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.009666 25690 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:58.022171 25699 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.034585 25693 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.035162 25693 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.038298 25693 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.038727 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:58.039040 25690 tablet_bootstrap.cc:654] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.039911 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:27:58.041499 25532 leader_election.cc:343] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:58.042364 25533 leader_election.cc:343] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.042403 25695 ts_tablet_manager.cc:1434] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.211s	user 0.031s	sys 0.035s
I20260709 12:27:58.042878 25533 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.043542 25693 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.043715 25695 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.040735 25315 catalog_manager.cc:5697] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.046645 25697 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.047118 25697 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.049571 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.050293 25569 raft_consensus.cc:2468] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:58.051632 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.053107 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:58.053053 25695 tablet_bootstrap.cc:654] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.054950 25699 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.057492 25608 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:27:58.059350 25608 leader_election.cc:343] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:58.060586 25608 leader_election.cc:343] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.062891 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:58.063007 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.064162 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:58.064754 25420 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.065186 25697 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:27:58.066161 25459 leader_election.cc:343] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:58.069257 25386 leader_election.cc:343] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.086898 25689 tablet_bootstrap.cc:492] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:58.087759 25689 ts_tablet_manager.cc:1403] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.012s
I20260709 12:27:58.089946 25740 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.090559 25740 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.091660 25689 raft_consensus.cc:359] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.092514 25689 raft_consensus.cc:385] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.092868 25689 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.094202 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.075801 25699 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.098909 25740 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:58.094095 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.106372 25733 raft_consensus.cc:2804] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.106865 25733 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.107195 25733 raft_consensus.cc:3060] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:58.108840 25458 leader_election.cc:343] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.110495 25688 tablet_bootstrap.cc:654] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.094070 25689 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.115101 25689 ts_tablet_manager.cc:1434] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.004s
W20260709 12:27:58.120540 25460 leader_election.cc:343] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.121105 25460 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.122417 25740 raft_consensus.cc:2749] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.154102 25420 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:58.156121 25458 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:27:58.157868 25740 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.158521 25740 raft_consensus.cc:697] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:27:58.159668 25740 consensus_queue.cc:237] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.162021 25695 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.162814 25695 ts_tablet_manager.cc:1403] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.012s
I20260709 12:27:58.167326 25699 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.168025 25699 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.171005 25699 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.173382 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:27:58.175140 25459 leader_election.cc:343] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.117252 25689 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:58.180388 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:27:58.182149 25458 leader_election.cc:343] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.182629 25458 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.183918 25699 raft_consensus.cc:2749] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.184597 25734 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.185304 25734 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.187449 25689 tablet_bootstrap.cc:654] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.188964 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.192152 25690 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:58.192749 25690 ts_tablet_manager.cc:1403] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.183s	user 0.045s	sys 0.071s
I20260709 12:27:58.194885 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.148907 25733 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.197860 25688 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:58.198625 25688 ts_tablet_manager.cc:1403] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.188s	user 0.020s	sys 0.019s
W20260709 12:27:58.201304 25609 leader_election.cc:343] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.192721 25734 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:27:58.206784 25608 leader_election.cc:343] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.207026 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:58.207417 25608 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:58.208019 25567 raft_consensus.cc:3060] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.200747 25695 raft_consensus.cc:359] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.200872 25690 raft_consensus.cc:359] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.210417 25733 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.210510 25690 raft_consensus.cc:385] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.212839 25690 raft_consensus.cc:740] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.213629 25734 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.213941 25690 consensus_queue.cc:260] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.215758 25688 raft_consensus.cc:359] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.216634 25688 raft_consensus.cc:385] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.217046 25688 raft_consensus.cc:740] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
W20260709 12:27:58.217128 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:58.217525 25697 consensus_queue.cc:1048] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.218014 25688 consensus_queue.cc:260] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.220867 25688 ts_tablet_manager.cc:1434] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:27:58.217119 25695 raft_consensus.cc:385] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.229200 25695 raft_consensus.cc:740] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.230616 25695 consensus_queue.cc:260] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.234361 25688 tablet_bootstrap.cc:492] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:58.241465 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:58.241663 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.216637 25690 ts_tablet_manager.cc:1434] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
W20260709 12:27:58.247221 25385 leader_election.cc:343] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.247807 25385 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:27:58.242846 25606 leader_election.cc:343] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.250542 25316 catalog_manager.cc:5697] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.249131 25697 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.255606 25567 raft_consensus.cc:2468] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:27:58.256891 25690 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:58.258338 25608 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.258780 25695 ts_tablet_manager.cc:1434] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.001s
I20260709 12:27:58.259384 25734 raft_consensus.cc:2804] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.259972 25734 raft_consensus.cc:697] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:27:58.260303 25697 consensus_queue.cc:1048] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.260982 25734 consensus_queue.cc:237] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.262042 25689 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:58.262676 25689 ts_tablet_manager.cc:1403] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.146s	user 0.026s	sys 0.010s
I20260709 12:27:58.264766 25690 tablet_bootstrap.cc:654] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.268574 25689 raft_consensus.cc:359] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.269621 25689 raft_consensus.cc:385] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.270140 25689 raft_consensus.cc:740] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.271219 25689 consensus_queue.cc:260] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.277451 25693 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.278265 25693 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.282454 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.283203 25420 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:58.284516 25688 tablet_bootstrap.cc:654] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.285272 25695 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.286369 25532 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.286703 25689 ts_tablet_manager.cc:1434] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:27:58.291574 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.291826 25689 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
W20260709 12:27:58.301455 25535 leader_election.cc:343] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.299974 25693 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:58.305984 25693 raft_consensus.cc:2804] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.310153 25693 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.311878 25693 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.337739 25695 tablet_bootstrap.cc:654] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.354678 25689 tablet_bootstrap.cc:654] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:58.348026 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 61766.3us
W20260709 12:27:58.358898 25384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 53061.5us
I20260709 12:27:58.367148 25314 catalog_manager.cc:5697] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.389853 25695 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.390501 25695 ts_tablet_manager.cc:1403] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.011s
I20260709 12:27:58.385517 25740 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.392364 25740 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.396209 25740 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.396595 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.396361 25695 raft_consensus.cc:359] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.397112 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.397372 25567 raft_consensus.cc:2468] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:58.397470 25695 raft_consensus.cc:385] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.398030 25695 raft_consensus.cc:740] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
W20260709 12:27:58.398579 25458 leader_election.cc:343] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.392764 25690 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:58.399062 25695 consensus_queue.cc:260] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.402294 25690 ts_tablet_manager.cc:1403] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.146s	user 0.042s	sys 0.024s
I20260709 12:27:58.403901 25460 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.404472 25695 ts_tablet_manager.cc:1434] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 12:27:58.405894 25690 raft_consensus.cc:359] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.406661 25690 raft_consensus.cc:385] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.406980 25690 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.407811 25690 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.410317 25695 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.411737 25740 raft_consensus.cc:2804] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.412153 25740 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.412485 25740 raft_consensus.cc:3060] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.414047 25693 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.415112 25734 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.415620 25734 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.416949 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:58.417609 25420 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.417773 25688 tablet_bootstrap.cc:492] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:58.418401 25688 ts_tablet_manager.cc:1403] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.184s	user 0.019s	sys 0.013s
I20260709 12:27:58.419878 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.420549 25419 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:58.421859 25606 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.421761 25688 raft_consensus.cc:359] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.422662 25688 raft_consensus.cc:385] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.422912 25733 raft_consensus.cc:2804] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.423554 25733 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.423928 25693 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:58.424664 25740 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.425383 25690 ts_tablet_manager.cc:1434] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:27:58.426097 25420 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:27:58.426954 25740 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.423960 25733 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.435461 25532 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.436473 25693 raft_consensus.cc:2804] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.436808 25695 tablet_bootstrap.cc:654] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.436996 25693 raft_consensus.cc:697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:27:58.437950 25693 consensus_queue.cc:237] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.427749 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.422971 25688 raft_consensus.cc:740] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.429666 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:58.441877 25568 raft_consensus.cc:3060] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.429033 25315 catalog_manager.cc:5697] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.417721 25734 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.430370 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:58.435501 25690 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:27:58.446894 25458 leader_election.cc:343] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:58.447029 25608 leader_election.cc:343] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.428465 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:27:58.449081 25535 leader_election.cc:343] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.452529 25690 tablet_bootstrap.cc:654] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.452819 25733 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.456276 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:27:58.457873 25608 leader_election.cc:343] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.460988 25688 consensus_queue.cc:260] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.462393 25734 consensus_queue.cc:1048] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.463004 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:58.463634 25420 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.464203 25568 raft_consensus.cc:2468] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:58.468626 25733 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.466012 25688 ts_tablet_manager.cc:1434] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.047s	user 0.001s	sys 0.008s
I20260709 12:27:58.435644 25689 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:58.470330 25460 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.470878 25688 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:58.470533 25689 ts_tablet_manager.cc:1403] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.180s	user 0.019s	sys 0.008s
I20260709 12:27:58.474072 25689 raft_consensus.cc:359] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.474750 25689 raft_consensus.cc:385] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.474948 25420 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:27:58.475481 25740 raft_consensus.cc:2804] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.476061 25740 raft_consensus.cc:697] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:27:58.476176 25606 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:27:58.477036 25740 consensus_queue.cc:237] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.477478 25733 raft_consensus.cc:2804] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.478299 25733 raft_consensus.cc:697] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:27:58.478804 25689 raft_consensus.cc:740] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.479372 25733 consensus_queue.cc:237] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.479633 25689 consensus_queue.cc:260] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.480415 25688 tablet_bootstrap.cc:654] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.489022 25689 ts_tablet_manager.cc:1434] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:27:58.491686 25689 tablet_bootstrap.cc:492] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:58.492551 25690 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:58.493080 25690 ts_tablet_manager.cc:1403] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.006s
W20260709 12:27:58.494302 25608 consensus_peers.cc:597] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:58.503387 25695 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.504101 25695 ts_tablet_manager.cc:1403] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.002s
I20260709 12:27:58.504802 25689 tablet_bootstrap.cc:654] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.504532 25314 catalog_manager.cc:5697] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.507154 25695 raft_consensus.cc:359] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.511004 25695 raft_consensus.cc:385] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.511355 25695 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.512279 25695 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.496261 25690 raft_consensus.cc:359] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.513851 25690 raft_consensus.cc:385] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.514156 25690 raft_consensus.cc:740] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.514997 25690 consensus_queue.cc:260] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.517416 25690 ts_tablet_manager.cc:1434] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:27:58.517499 25315 catalog_manager.cc:5697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.519712 25695 ts_tablet_manager.cc:1434] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:27:58.520735 25695 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.524847 25690 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:58.531881 25690 tablet_bootstrap.cc:654] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.539872 25695 tablet_bootstrap.cc:654] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.548220 25316 catalog_manager.cc:5697] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.550544 25690 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:58.551087 25690 ts_tablet_manager.cc:1403] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 12:27:58.556690 25695 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.557291 25695 ts_tablet_manager.cc:1403] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 12:27:58.560436 25690 raft_consensus.cc:359] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.561216 25690 raft_consensus.cc:385] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.561497 25690 raft_consensus.cc:740] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.563319 25740 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.563397 25695 raft_consensus.cc:359] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.563918 25740 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.564756 25690 consensus_queue.cc:260] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.566196 25740 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.564280 25695 raft_consensus.cc:385] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.566936 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.567276 25695 raft_consensus.cc:740] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.567658 25568 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:58.567744 25690 ts_tablet_manager.cc:1434] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:27:58.568010 25695 consensus_queue.cc:260] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.568720 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:58.569906 25460 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:58.570273 25695 ts_tablet_manager.cc:1434] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:27:58.570771 25740 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:58.570887 25459 leader_election.cc:343] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.571225 25740 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.571506 25695 tablet_bootstrap.cc:492] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.571596 25740 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.569401 25690 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:58.583438 25740 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.578274 25695 tablet_bootstrap.cc:654] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.586542 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:58.587185 25568 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.595799 25568 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:58.597105 25460 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:58.598104 25699 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.601323 25769 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.602090 25769 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.605665 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.605901 25769 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:58.606345 25420 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:58.608239 25606 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.609658 25769 raft_consensus.cc:2804] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.609835 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.610065 25769 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.610415 25769 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.610522 25494 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:58.625694 25688 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:58.626343 25688 ts_tablet_manager.cc:1403] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.009s
I20260709 12:27:58.627084 25690 tablet_bootstrap.cc:654] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.632640 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:58.634102 25769 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:27:58.639353 25459 leader_election.cc:343] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.635231 25699 raft_consensus.cc:697] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:27:58.640530 25695 tablet_bootstrap.cc:492] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.641033 25695 ts_tablet_manager.cc:1403] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.008s
I20260709 12:27:58.629908 25688 raft_consensus.cc:359] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.642066 25688 raft_consensus.cc:385] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.642359 25688 raft_consensus.cc:740] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.642477 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:58.635329 25740 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.643100 25420 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.643177 25688 consensus_queue.cc:260] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.643106 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:27:58.644531 25494 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.646143 25688 ts_tablet_manager.cc:1434] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:27:58.647239 25688 tablet_bootstrap.cc:492] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:58.647739 25695 raft_consensus.cc:359] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.648479 25695 raft_consensus.cc:385] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.648756 25695 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.640964 25769 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:58.649621 25695 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.651763 25695 ts_tablet_manager.cc:1434] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:27:58.651973 25420 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:27:58.652803 25695 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.653395 25606 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.654392 25769 raft_consensus.cc:2804] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.655097 25769 raft_consensus.cc:697] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:27:58.656102 25769 consensus_queue.cc:237] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.640882 25699 consensus_queue.cc:237] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.659399 25643 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.659561 25695 tablet_bootstrap.cc:654] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.663935 25688 tablet_bootstrap.cc:654] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.671306 25690 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:58.674698 25689 tablet_bootstrap.cc:492] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:58.671895 25690 ts_tablet_manager.cc:1403] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.000s
I20260709 12:27:58.671911 25693 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.690480 25689 ts_tablet_manager.cc:1403] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.199s	user 0.050s	sys 0.043s
I20260709 12:27:58.685288 25722 consensus_queue.cc:1048] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:27:58.677304 25758 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.693284 25758 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.694670 25688 tablet_bootstrap.cc:492] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:58.695180 25688 ts_tablet_manager.cc:1403] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.005s
I20260709 12:27:58.690522 25693 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.696669 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.697444 25567 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:27:58.676367 25775 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:27:58.699606 25758 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.700050 25695 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.700549 25695 ts_tablet_manager.cc:1403] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.017s
I20260709 12:27:58.700435 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:58.701161 25643 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:27:58.702344 25384 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.703233 25758 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.703617 25758 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.703965 25758 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.706110 25690 raft_consensus.cc:359] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.706389 25689 raft_consensus.cc:359] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.706871 25690 raft_consensus.cc:385] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.707175 25689 raft_consensus.cc:385] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.707266 25690 raft_consensus.cc:740] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.707618 25689 raft_consensus.cc:740] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.708202 25690 consensus_queue.cc:260] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.708523 25689 consensus_queue.cc:260] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.710440 25688 raft_consensus.cc:359] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.711241 25688 raft_consensus.cc:385] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.711582 25688 raft_consensus.cc:740] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.712464 25688 consensus_queue.cc:260] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.713034 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.714979 25689 ts_tablet_manager.cc:1434] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:27:58.715806 25420 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:58.717520 25695 raft_consensus.cc:359] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.718283 25695 raft_consensus.cc:385] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.718114 25532 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.718565 25695 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.718693 25740 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.719537 25695 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.720489 25751 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.721603 25751 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.721997 25751 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.723312 25695 ts_tablet_manager.cc:1434] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:27:58.716109 25689 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:58.729187 25419 raft_consensus.cc:3060] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.734208 25695 tablet_bootstrap.cc:492] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.681816 25494 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:27:58.729832 25722 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.740135 25722 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.743608 25722 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:58.746287 25695 tablet_bootstrap.cc:654] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.746124 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.746974 25693 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:58.748274 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.744973 25758 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:27:58.751811 25608 leader_election.cc:343] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.752955 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:58.753585 25643 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:58.754737 25606 leader_election.cc:343] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.755470 25606 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.756951 25734 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.757272 25758 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.757817 25734 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.758786 25315 catalog_manager.cc:5697] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.750592 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.750638 25693 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.768427 25494 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:58.769964 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.762601 25722 raft_consensus.cc:2749] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.773731 25688 ts_tablet_manager.cc:1434] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.011s
I20260709 12:27:58.775182 25688 tablet_bootstrap.cc:492] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:58.776171 25733 consensus_queue.cc:1048] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.767817 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:58.778352 25567 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.781498 25734 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:58.783165 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.784322 25569 raft_consensus.cc:2393] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 1: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:27:58.786238 25608 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:58.787972 25734 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.792500 25643 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:27:58.801688 25690 ts_tablet_manager.cc:1434] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.111s	user 0.010s	sys 0.000s
I20260709 12:27:58.802752 25690 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:58.805615 25693 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.809262 25783 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.810120 25734 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.813026 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.809845 25783 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.813820 25495 raft_consensus.cc:2468] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:58.816849 25740 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.817598 25740 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.822168 25689 tablet_bootstrap.cc:654] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.824899 25384 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.825893 25758 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.826390 25758 raft_consensus.cc:697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:27:58.826455 25535 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:58.827358 25758 consensus_queue.cc:237] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:58.830626 25740 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:58.831751 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:58.833580 25418 raft_consensus.cc:2393] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:27:58.837767 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:58.839735 25783 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.840456 25783 raft_consensus.cc:2804] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.840804 25783 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.819479 25751 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.842094 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:58.843775 25533 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:58.837816 25693 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.841202 25783 raft_consensus.cc:3060] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.850047 25693 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.852428 25695 tablet_bootstrap.cc:492] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.853021 25695 ts_tablet_manager.cc:1403] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.125s	user 0.029s	sys 0.025s
I20260709 12:27:58.853658 25688 tablet_bootstrap.cc:654] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.856144 25695 raft_consensus.cc:359] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:27:58.857393 25590 debug-util.cc:398] Leaking SignalData structure 0x7b08001b58a0 after lost signal to thread 20876
I20260709 12:27:58.856956 25695 raft_consensus.cc:385] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.848850 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.857993 25695 raft_consensus.cc:740] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.850438 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:58.861577 25695 consensus_queue.cc:260] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:27:58.859994 25590 debug-util.cc:398] Leaking SignalData structure 0x7b08001074e0 after lost signal to thread 25352
I20260709 12:27:58.858520 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:58.863786 25420 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:58.865700 25590 debug-util.cc:398] Leaking SignalData structure 0x7b0800106d40 after lost signal to thread 25519
W20260709 12:27:58.867928 25590 debug-util.cc:398] Leaking SignalData structure 0x7b080019dda0 after lost signal to thread 25667
I20260709 12:27:58.857860 25751 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:58.875013 25460 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:58.877115 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:27:58.877431 25695 ts_tablet_manager.cc:1434] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:27:58.858719 25314 catalog_manager.cc:5697] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.877758 25699 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.877862 25495 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.878505 25695 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:58.877627 25420 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:27:58.873413 25643 raft_consensus.cc:2468] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:58.888052 25690 tablet_bootstrap.cc:654] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.890784 25532 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:58.891768 25751 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.892519 25751 raft_consensus.cc:697] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:27:58.894023 25689 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:58.894381 25751 consensus_queue.cc:237] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.894587 25689 ts_tablet_manager.cc:1403] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.179s	user 0.013s	sys 0.003s
I20260709 12:27:58.900054 25495 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:27:58.900260 25688 tablet_bootstrap.cc:492] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:58.902854 25688 ts_tablet_manager.cc:1403] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.003s
I20260709 12:27:58.887177 25567 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:27:58.903869 25689 raft_consensus.cc:359] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.905934 25689 raft_consensus.cc:385] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.906251 25689 raft_consensus.cc:740] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.907150 25689 consensus_queue.cc:260] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:58.915575 25734 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.916095 25734 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.918428 25695 tablet_bootstrap.cc:654] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.919734 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:58.920614 25689 ts_tablet_manager.cc:1434] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
W20260709 12:27:58.921284 25608 leader_election.cc:343] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.921658 25689 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:58.921881 25734 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:58.922916 25734 consensus_queue.cc:1048] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.923910 25783 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.926307 25775 consensus_queue.cc:1048] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.929972 25688 raft_consensus.cc:359] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.940614 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:58.940793 25688 raft_consensus.cc:385] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.941355 25643 raft_consensus.cc:3060] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.937718 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:27:58.939769 25458 consensus_peers.cc:597] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:58.941490 25688 raft_consensus.cc:740] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
W20260709 12:27:58.947991 25609 leader_election.cc:343] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.950533 25609 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:58.949506 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:27:58.951460 25494 raft_consensus.cc:3060] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.955113 25643 raft_consensus.cc:2468] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:27:58.958473 25722 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:58.959507 25608 consensus_peers.cc:597] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:58.960724 25533 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:27:58.946246 25699 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.961804 25783 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.962025 25787 raft_consensus.cc:2804] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.965216 25787 raft_consensus.cc:697] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:27:58.966214 25787 consensus_queue.cc:237] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.961828 25494 raft_consensus.cc:2468] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:27:58.963302 25688 consensus_queue.cc:260] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.970974 25690 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:58.971560 25690 ts_tablet_manager.cc:1403] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.169s	user 0.016s	sys 0.000s
I20260709 12:27:58.972502 25693 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.973263 25693 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:58.975318 25690 raft_consensus.cc:359] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.976248 25690 raft_consensus.cc:385] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.969233 25689 tablet_bootstrap.cc:654] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.977670 25690 raft_consensus.cc:740] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.978822 25693 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:58.964242 25695 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:58.963382 25316 catalog_manager.cc:5697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.981559 25695 ts_tablet_manager.cc:1403] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.006s
I20260709 12:27:58.982646 25688 ts_tablet_manager.cc:1434] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.002s
I20260709 12:27:58.984637 25688 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:58.984234 25690 consensus_queue.cc:260] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:58.985745 25693 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.988868 25568 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.983562 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:27:58.992827 25535 leader_election.cc:343] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.996476 25688 tablet_bootstrap.cc:654] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.004442 25690 ts_tablet_manager.cc:1434] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.002s
I20260709 12:27:59.000849 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.005443 25690 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:59.015098 25315 catalog_manager.cc:5697] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:59.021965 25533 leader_election.cc:343] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.022519 25533 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:59.023777 25693 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.030334 25695 raft_consensus.cc:359] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.031172 25695 raft_consensus.cc:385] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.031656 25695 raft_consensus.cc:740] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.032577 25695 consensus_queue.cc:260] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.036140 25695 ts_tablet_manager.cc:1434] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:27:59.039244 25695 tablet_bootstrap.cc:492] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.053608 25695 tablet_bootstrap.cc:654] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.061959 25689 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.062553 25689 ts_tablet_manager.cc:1403] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.005s
I20260709 12:27:59.065639 25689 raft_consensus.cc:359] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.066418 25689 raft_consensus.cc:385] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.066776 25689 raft_consensus.cc:740] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.067567 25689 consensus_queue.cc:260] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.068562 25693 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.072144 25689 ts_tablet_manager.cc:1434] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:59.075659 25734 consensus_queue.cc:1048] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.082283 25315 catalog_manager.cc:5697] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.088320 25689 tablet_bootstrap.cc:492] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:59.090687 25690 tablet_bootstrap.cc:654] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.091647 25688 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:59.092175 25688 ts_tablet_manager.cc:1403] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.012s
I20260709 12:27:59.093665 25699 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.102421 25688 raft_consensus.cc:359] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.103328 25688 raft_consensus.cc:385] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.103644 25688 raft_consensus.cc:740] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.105712 25689 tablet_bootstrap.cc:654] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.109752 25695 tablet_bootstrap.cc:492] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:59.114634 25695 ts_tablet_manager.cc:1403] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.006s
I20260709 12:27:59.127851 25689 tablet_bootstrap.cc:492] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.130168 25689 ts_tablet_manager.cc:1403] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.004s
I20260709 12:27:59.133651 25689 raft_consensus.cc:359] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.118448 25695 raft_consensus.cc:359] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.137960 25695 raft_consensus.cc:385] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.138306 25695 raft_consensus.cc:740] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.139571 25695 consensus_queue.cc:260] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.142036 25695 ts_tablet_manager.cc:1434] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260709 12:27:59.143049 25695 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.143405 25689 raft_consensus.cc:385] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.145373 25689 raft_consensus.cc:740] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.146179 25689 consensus_queue.cc:260] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.144589 25688 consensus_queue.cc:260] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.159400 25688 ts_tablet_manager.cc:1434] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:27:59.160881 25688 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:59.165377 25690 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:59.165938 25690 ts_tablet_manager.cc:1403] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.161s	user 0.039s	sys 0.031s
I20260709 12:27:59.169099 25769 consensus_queue.cc:1048] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.180961 25690 raft_consensus.cc:359] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.177000 25689 ts_tablet_manager.cc:1434] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:27:59.182967 25690 raft_consensus.cc:385] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.183348 25690 raft_consensus.cc:740] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.184211 25689 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:59.184109 25690 consensus_queue.cc:260] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.187856 25699 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.196544 25695 tablet_bootstrap.cc:654] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.198714 25688 tablet_bootstrap.cc:654] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.201254 25689 tablet_bootstrap.cc:654] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.202085 25690 ts_tablet_manager.cc:1434] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:27:59.203111 25758 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.203598 25758 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.205776 25758 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:59.206589 25690 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:59.206854 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.207588 25643 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:27:59.209863 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:59.210137 25384 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:59.210536 25495 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:27:59.211320 25722 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.211817 25722 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.214217 25722 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:59.217103 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.216346 25758 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.217836 25569 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:59.218909 25758 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.219388 25758 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.219869 25608 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:27:59.220161 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:59.220860 25495 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:27:59.221225 25769 raft_consensus.cc:2804] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.221621 25769 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.221951 25769 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.226684 25690 tablet_bootstrap.cc:654] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.230696 25695 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:59.231160 25695 ts_tablet_manager.cc:1403] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.001s
I20260709 12:27:59.233980 25695 raft_consensus.cc:359] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.234673 25695 raft_consensus.cc:385] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.234936 25695 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.235787 25688 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:59.235579 25695 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.236405 25688 ts_tablet_manager.cc:1403] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.009s
I20260709 12:27:59.239266 25690 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:59.239630 25689 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.239213 25688 raft_consensus.cc:359] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.239817 25690 ts_tablet_manager.cc:1403] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.003s
I20260709 12:27:59.240054 25688 raft_consensus.cc:385] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.240160 25689 ts_tablet_manager.cc:1403] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.056s	user 0.006s	sys 0.005s
I20260709 12:27:59.240636 25688 raft_consensus.cc:740] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.241557 25688 consensus_queue.cc:260] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.242655 25690 raft_consensus.cc:359] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.243062 25689 raft_consensus.cc:359] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.243484 25690 raft_consensus.cc:385] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.243736 25689 raft_consensus.cc:385] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.243832 25690 raft_consensus.cc:740] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.244117 25689 raft_consensus.cc:740] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.244642 25690 consensus_queue.cc:260] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.244992 25689 consensus_queue.cc:260] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.246671 25787 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.247233 25689 ts_tablet_manager.cc:1434] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:59.247159 25787 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.248207 25695 ts_tablet_manager.cc:1434] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:27:59.248363 25688 ts_tablet_manager.cc:1434] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:27:59.249423 25688 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:59.250205 25689 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:59.250413 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.251511 25787 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:59.253145 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.249444 25695 tablet_bootstrap.cc:492] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.263084 25740 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.263674 25740 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.264209 25690 ts_tablet_manager.cc:1434] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:27:59.265630 25690 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:59.265836 25740 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:59.270304 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.271013 25568 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:59.263091 25532 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:59.272058 25690 tablet_bootstrap.cc:654] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.274626 25787 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:59.274703 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:59.274089 25460 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:59.274483 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.277618 25418 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:59.277806 25688 tablet_bootstrap.cc:654] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.278513 25740 raft_consensus.cc:2804] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.278914 25740 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.276495 25769 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.279300 25740 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.282691 25689 tablet_bootstrap.cc:654] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.283015 25695 tablet_bootstrap.cc:654] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.288985 25758 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.291385 25758 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:59.293334 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:27:59.293468 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:59.293895 25495 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.294350 25643 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.298604 25769 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:59.300472 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:59.301158 25568 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.302188 25495 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:27:59.308086 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:27:59.311043 25494 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.311142 25775 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.311661 25775 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.313333 25688 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:59.313879 25775 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:59.314116 25688 ts_tablet_manager.cc:1403] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.008s
I20260709 12:27:59.315641 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.316354 25642 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:59.318202 25459 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:59.319085 25386 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:59.318382 25568 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:27:59.320300 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.321357 25758 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.321931 25758 raft_consensus.cc:697] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:27:59.322053 25608 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:27:59.323238 25458 leader_election.cc:343] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.322947 25758 consensus_queue.cc:237] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.323465 25688 raft_consensus.cc:359] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.324177 25688 raft_consensus.cc:385] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.324461 25688 raft_consensus.cc:740] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.322122 25494 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:27:59.325109 25688 consensus_queue.cc:260] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.322968 25769 raft_consensus.cc:2804] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.327314 25769 raft_consensus.cc:697] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:27:59.328027 25688 ts_tablet_manager.cc:1434] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:27:59.328248 25769 consensus_queue.cc:237] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.329789 25690 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:59.330194 25688 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:59.330335 25690 ts_tablet_manager.cc:1403] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.006s
I20260709 12:27:59.329227 25775 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.333735 25775 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.334169 25775 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.337572 25688 tablet_bootstrap.cc:654] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.333758 25690 raft_consensus.cc:359] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.338632 25690 raft_consensus.cc:385] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.338855 25690 raft_consensus.cc:740] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.340636 25690 consensus_queue.cc:260] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.342494 25787 consensus_queue.cc:1048] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.343206 25690 ts_tablet_manager.cc:1434] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:27:59.344412 25690 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:59.349903 25787 consensus_queue.cc:1048] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.350175 25643 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:27:59.350502 25690 tablet_bootstrap.cc:654] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.362251 25740 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.369781 25689 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.370285 25689 ts_tablet_manager.cc:1403] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.120s	user 0.004s	sys 0.013s
I20260709 12:27:59.372501 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:59.374109 25787 consensus_queue.cc:1048] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.374320 25418 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.387578 25695 tablet_bootstrap.cc:492] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:59.388852 25695 ts_tablet_manager.cc:1403] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.008s
I20260709 12:27:59.391767 25695 raft_consensus.cc:359] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.392437 25695 raft_consensus.cc:385] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.392728 25695 raft_consensus.cc:740] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.393489 25695 consensus_queue.cc:260] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.395820 25695 ts_tablet_manager.cc:1434] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:59.396860 25695 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.399755 25317 catalog_manager.cc:5697] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.403265 25695 tablet_bootstrap.cc:654] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.402649 25775 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.406945 25689 raft_consensus.cc:359] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.409282 25689 raft_consensus.cc:385] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.409667 25689 raft_consensus.cc:740] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.412019 25689 consensus_queue.cc:260] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.416744 25689 ts_tablet_manager.cc:1434] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.003s
I20260709 12:27:59.410718 25740 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:59.423576 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:59.424281 25568 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.424592 25697 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.425539 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:59.426147 25643 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.428082 25418 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:59.429262 25458 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:59.430358 25688 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:59.430825 25688 ts_tablet_manager.cc:1403] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.002s
I20260709 12:27:59.446264 25690 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:59.446842 25690 ts_tablet_manager.cc:1403] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.040s
I20260709 12:27:59.446748 25569 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.447362 25643 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:59.448272 25775 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:59.434096 25740 raft_consensus.cc:2804] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.448475 25568 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:59.449009 25459 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:59.450896 25699 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.451593 25699 raft_consensus.cc:697] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:27:59.453974 25697 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.454559 25697 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.464972 25693 consensus_queue.cc:1048] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.452728 25699 consensus_queue.cc:237] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.469575 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:59.462952 25688 raft_consensus.cc:359] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.456681 25697 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:59.471959 25688 raft_consensus.cc:385] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.472482 25689 tablet_bootstrap.cc:492] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:59.474656 25688 raft_consensus.cc:740] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.478425 25697 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.478933 25697 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.482215 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:59.482865 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:27:59.484465 25385 leader_election.cc:343] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:59.484506 25458 leader_election.cc:343] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.469128 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.481629 25688 consensus_queue.cc:260] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.493014 25688 ts_tablet_manager.cc:1434] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.003s
I20260709 12:27:59.493364 25689 tablet_bootstrap.cc:654] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.490090 25740 raft_consensus.cc:697] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:27:59.496539 25690 raft_consensus.cc:359] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.497128 25690 raft_consensus.cc:385] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.497439 25690 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.497512 25688 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:59.498185 25690 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.503296 25385 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:59.508626 25831 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.509588 25690 ts_tablet_manager.cc:1434] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.062s	user 0.014s	sys 0.000s
I20260709 12:27:59.510494 25690 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:59.511293 25316 catalog_manager.cc:5697] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.516871 25418 raft_consensus.cc:3060] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.521147 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:27:59.522678 25384 leader_election.cc:343] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.523154 25384 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:27:59.507335 25697 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:59.519066 25758 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:27:59.531453 25697 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.544456 25740 consensus_queue.cc:237] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.551890 25689 tablet_bootstrap.cc:492] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.552506 25689 ts_tablet_manager.cc:1403] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.011s
I20260709 12:27:59.555337 25689 raft_consensus.cc:359] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.556054 25689 raft_consensus.cc:385] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.556345 25689 raft_consensus.cc:740] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.557215 25689 consensus_queue.cc:260] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.559700 25690 tablet_bootstrap.cc:654] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.556056 25688 tablet_bootstrap.cc:654] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.560916 25689 ts_tablet_manager.cc:1434] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:27:59.562430 25689 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:59.569941 25695 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:59.570447 25695 ts_tablet_manager.cc:1403] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.026s
I20260709 12:27:59.582715 25695 raft_consensus.cc:359] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.583694 25695 raft_consensus.cc:385] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.584061 25695 raft_consensus.cc:740] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.591292 25695 consensus_queue.cc:260] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.593639 25695 ts_tablet_manager.cc:1434] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:27:59.594990 25695 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.605074 25689 tablet_bootstrap.cc:654] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.605566 25722 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.606129 25722 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.608381 25722 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:27:59.614830 25758 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.615394 25758 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.616235 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:59.617303 25699 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.617818 25699 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:27:59.618322 25609 leader_election.cc:343] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.620224 25699 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:59.620589 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.621591 25419 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:59.622474 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.622802 25458 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:59.623113 25567 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:27:59.624322 25758 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:59.624636 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.626175 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.626804 25642 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:27:59.616432 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.627455 25699 raft_consensus.cc:2804] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.627897 25699 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.627996 25384 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:59.628290 25699 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:59.628558 25606 leader_election.cc:343] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:59.628683 25385 leader_election.cc:343] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.629035 25606 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:59.629282 25831 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.629698 25831 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.630141 25831 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.630198 25733 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.639086 25699 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.645644 25690 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:59.646155 25690 ts_tablet_manager.cc:1403] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.003s
I20260709 12:27:59.650825 25699 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:59.651065 25315 catalog_manager.cc:5697] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.652828 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:59.652761 25690 raft_consensus.cc:359] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.653556 25569 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.655920 25688 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:59.656426 25688 ts_tablet_manager.cc:1403] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.014s
I20260709 12:27:59.657740 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:59.658330 25420 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.659324 25688 raft_consensus.cc:359] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.659998 25688 raft_consensus.cc:385] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.660256 25688 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.661393 25688 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.653601 25690 raft_consensus.cc:385] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.664072 25688 ts_tablet_manager.cc:1434] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:27:59.664237 25690 raft_consensus.cc:740] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.665673 25690 consensus_queue.cc:260] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.674178 25318 catalog_manager.cc:5697] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.683002 25695 tablet_bootstrap.cc:654] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.689385 25420 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:59.691181 25689 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.691725 25689 ts_tablet_manager.cc:1403] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.002s
I20260709 12:27:59.693960 25688 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:59.694591 25689 raft_consensus.cc:359] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.695305 25689 raft_consensus.cc:385] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.694999 25831 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.695619 25689 raft_consensus.cc:740] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.696344 25689 consensus_queue.cc:260] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.698129 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:27:59.698832 25567 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.701903 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:59.702529 25643 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.702613 25689 ts_tablet_manager.cc:1434] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:27:59.704183 25688 tablet_bootstrap.cc:654] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.704005 25758 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.704696 25758 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.705314 25831 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:59.709025 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:59.709895 25695 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
W20260709 12:27:59.710683 25386 leader_election.cc:343] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.712155 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.713302 25758 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:27:59.714327 25384 leader_election.cc:343] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.715495 25384 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:59.716724 25567 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:27:59.717206 25758 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.710683 25695 ts_tablet_manager.cc:1403] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.003s
I20260709 12:27:59.720155 25643 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:27:59.721597 25384 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:59.718421 25690 ts_tablet_manager.cc:1434] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:27:59.722501 25758 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.723145 25690 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:59.723541 25758 raft_consensus.cc:697] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:27:59.724891 25758 consensus_queue.cc:237] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.726619 25569 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:27:59.727870 25460 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:27:59.704800 25689 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:59.734823 25699 raft_consensus.cc:2804] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.728190 25695 raft_consensus.cc:359] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.735405 25699 raft_consensus.cc:697] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:27:59.737536 25699 consensus_queue.cc:237] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.738390 25769 consensus_queue.cc:1048] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.740895 25689 tablet_bootstrap.cc:654] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.742733 25695 raft_consensus.cc:385] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.748975 25695 raft_consensus.cc:740] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.754976 25315 catalog_manager.cc:5697] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.756392 25722 consensus_queue.cc:1048] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.757365 25695 consensus_queue.cc:260] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.760365 25695 ts_tablet_manager.cc:1434] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:27:59.764192 25695 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.769646 25689 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.770239 25689 ts_tablet_manager.cc:1403] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.008s
I20260709 12:27:59.773355 25689 raft_consensus.cc:359] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.774055 25689 raft_consensus.cc:385] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.774345 25689 raft_consensus.cc:740] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.775920 25690 tablet_bootstrap.cc:654] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.775576 25689 consensus_queue.cc:260] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:27:59.776067 25688 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:59.776763 25688 ts_tablet_manager.cc:1403] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.020s
I20260709 12:27:59.778837 25689 ts_tablet_manager.cc:1434] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:59.780115 25689 tablet_bootstrap.cc:492] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:27:59.782581 25695 tablet_bootstrap.cc:654] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.779824 25688 raft_consensus.cc:359] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.785426 25688 raft_consensus.cc:385] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.785781 25688 raft_consensus.cc:740] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.786593 25688 consensus_queue.cc:260] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.788754 25688 ts_tablet_manager.cc:1434] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:27:59.789594 25690 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:27:59.789883 25688 tablet_bootstrap.cc:492] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:27:59.790081 25690 ts_tablet_manager.cc:1403] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 12:27:59.796001 25689 tablet_bootstrap.cc:654] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.805212 25690 raft_consensus.cc:359] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.806095 25690 raft_consensus.cc:385] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.806437 25690 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.809628 25689 tablet_bootstrap.cc:492] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.810150 25689 ts_tablet_manager.cc:1403] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 12:27:59.809804 25690 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:27:59.813285 25688 tablet_bootstrap.cc:654] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.813432 25693 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.813508 25740 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.814389 25693 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.814435 25740 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.813112 25689 raft_consensus.cc:359] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.818337 25693 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:59.818583 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.818517 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.819387 25420 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:59.816879 25689 raft_consensus.cc:385] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.820043 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:27:59.821362 25689 raft_consensus.cc:740] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.820138 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.825079 25642 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:59.825024 25689 consensus_queue.cc:260] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.823298 25318 catalog_manager.cc:5697] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.817071 25740 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:59.826419 25533 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:27:59.828836 25693 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.831609 25693 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.831971 25693 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.834842 25689 ts_tablet_manager.cc:1434] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:27:59.835822 25689 tablet_bootstrap.cc:492] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
W20260709 12:27:59.825256 25459 leader_election.cc:343] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:59.837956 25460 leader_election.cc:343] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.838537 25460 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:27:59.843636 25693 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.844740 25689 tablet_bootstrap.cc:654] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.844867 25740 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.845808 25693 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:59.847714 25695 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:59.847548 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:27:59.848169 25418 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.849445 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:27:59.850206 25642 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.856408 25418 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:27:59.848186 25695 ts_tablet_manager.cc:1403] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.016s
I20260709 12:27:59.857364 25758 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.858175 25532 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:27:59.859026 25783 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.859501 25783 raft_consensus.cc:697] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:27:59.860050 25695 raft_consensus.cc:359] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.860757 25695 raft_consensus.cc:385] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.861042 25695 raft_consensus.cc:740] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.860344 25783 consensus_queue.cc:237] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.861755 25695 consensus_queue.cc:260] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.864845 25695 ts_tablet_manager.cc:1434] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:59.865619 25722 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.866258 25722 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.868001 25695 tablet_bootstrap.cc:492] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.868957 25690 ts_tablet_manager.cc:1434] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 12:27:59.874317 25690 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:27:59.876967 25733 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.877475 25733 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:27:59.879520 25733 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:59.883586 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.884099 25695 tablet_bootstrap.cc:654] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.884333 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.885089 25722 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:27:59.886063 25769 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.886634 25769 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:27:59.887331 25606 leader_election.cc:343] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.890882 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.891474 25828 consensus_queue.cc:1048] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.893924 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.894454 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:27:59.893929 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:27:59.908739 25608 leader_election.cc:343] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.909303 25608 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:27:59.901364 25609 leader_election.cc:343] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:59.912315 25606 leader_election.cc:343] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.912745 25733 raft_consensus.cc:2749] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.900254 25769 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:27:59.927273 25787 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.928054 25787 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:27:59.915243 25608 leader_election.cc:343] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.937285 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:27:59.941407 25495 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:27:59.942608 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:27:59.934118 25787 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:27:59.949695 25532 leader_election.cc:343] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.951011 25608 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:27:59.954231 25758 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.955415 25695 tablet_bootstrap.cc:492] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:27:59.958273 25689 tablet_bootstrap.cc:492] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:27:59.964603 25722 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.966115 25695 ts_tablet_manager.cc:1403] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.098s	user 0.017s	sys 0.027s
I20260709 12:27:59.966588 25689 ts_tablet_manager.cc:1403] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.131s	user 0.021s	sys 0.014s
W20260709 12:27:59.965312 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 54824.8us
I20260709 12:27:59.962707 25828 consensus_queue.cc:1048] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:27:59.969753 25535 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:59.970158 25688 tablet_bootstrap.cc:492] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:27:59.970759 25688 ts_tablet_manager.cc:1403] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.027s
I20260709 12:27:59.971043 25787 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.971453 25787 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.977088 25787 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.977347 25688 raft_consensus.cc:359] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.978255 25688 raft_consensus.cc:385] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:59.978894 25608 leader_election.cc:343] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.979055 25688 raft_consensus.cc:740] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.979498 25608 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:27:59.980353 25722 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.980047 25688 consensus_queue.cc:260] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.982928 25688 ts_tablet_manager.cc:1434] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:59.980330 25695 raft_consensus.cc:359] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.984664 25695 raft_consensus.cc:385] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.984964 25695 raft_consensus.cc:740] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.985749 25695 consensus_queue.cc:260] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:27:59.989398 25695 ts_tablet_manager.cc:1434] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:27:59.989673 25690 tablet_bootstrap.cc:654] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:59.989537 25458 consensus_peers.cc:597] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:59.990614 25695 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:27:59.991848 25642 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:27:59.995632 25688 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:00.013321 25688 tablet_bootstrap.cc:654] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.018177 25783 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.024060 25783 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.027148 25783 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:27:59.977010 25317 catalog_manager.cc:5697] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.028499 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.032657 25641 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:00.033865 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.036125 25828 consensus_queue.cc:1048] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.037115 25533 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:00.042080 25693 raft_consensus.cc:2804] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.042527 25693 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.042863 25693 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:00.044341 25535 leader_election.cc:343] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.069835 25689 raft_consensus.cc:359] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.070770 25689 raft_consensus.cc:385] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.071059 25689 raft_consensus.cc:740] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.071714 25695 tablet_bootstrap.cc:654] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.074597 25689 consensus_queue.cc:260] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.078883 25722 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.079500 25722 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.080431 25689 ts_tablet_manager.cc:1434] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.003s
I20260709 12:28:00.086642 25689 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:00.114291 25699 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.120595 25689 tablet_bootstrap.cc:654] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.102747 25787 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.116976 25699 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.139890 25688 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:00.140455 25688 ts_tablet_manager.cc:1403] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.017s
I20260709 12:28:00.143193 25688 raft_consensus.cc:359] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.143821 25688 raft_consensus.cc:385] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.144081 25688 raft_consensus.cc:740] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.145076 25859 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.145676 25859 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.148054 25859 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:00.149241 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.149984 25494 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:28:00.150084 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:00.151350 25460 leader_election.cc:343] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.152262 25609 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:00.153277 25769 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.153685 25769 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.154026 25769 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.155460 25690 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:00.155957 25690 ts_tablet_manager.cc:1403] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.282s	user 0.031s	sys 0.006s
I20260709 12:28:00.157333 25758 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.158005 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:00.157861 25758 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.159446 25699 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:00.133363 25722 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:00.160049 25758 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:00.160430 25608 leader_election.cc:343] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.161437 25787 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:00.127998 25693 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.162103 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:00.163331 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:00.164523 25532 leader_election.cc:343] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.165788 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.166570 25643 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:00.169978 25690 raft_consensus.cc:359] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.170692 25690 raft_consensus.cc:385] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.170986 25690 raft_consensus.cc:740] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.171806 25690 consensus_queue.cc:260] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.173481 25384 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:00.174351 25758 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.174925 25758 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.175359 25758 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.175908 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:00.177870 25460 leader_election.cc:343] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.180625 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:00.181270 25458 leader_election.cc:343] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.181793 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.182185 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:00.181299 25494 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.182776 25495 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.187098 25758 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.189718 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.190393 25643 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:00.190447 25758 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:00.191680 25459 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:00.192889 25828 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.193302 25828 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.193655 25828 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.181809 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:00.197690 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:00.198083 25860 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.198352 25643 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.199146 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:00.199414 25386 leader_election.cc:343] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.205274 25688 consensus_queue.cc:260] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.208666 25693 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:00.211861 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:00.228895 25641 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.214375 25859 consensus_queue.cc:1048] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:00.223532 25828 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.174494 25690 ts_tablet_manager.cc:1434] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:28:00.232942 25690 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:00.238255 25688 ts_tablet_manager.cc:1434] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.098s	user 0.009s	sys 0.000s
I20260709 12:28:00.225579 25758 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:28:00.257280 25695 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:00.257951 25695 ts_tablet_manager.cc:1403] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.268s	user 0.035s	sys 0.040s
I20260709 12:28:00.258188 25688 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
W20260709 12:28:00.259752 25386 leader_election.cc:343] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.260111 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:00.260701 25689 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:00.261214 25689 ts_tablet_manager.cc:1403] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.180s	user 0.011s	sys 0.005s
W20260709 12:28:00.261868 25460 leader_election.cc:343] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.263978 25689 raft_consensus.cc:359] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.264680 25689 raft_consensus.cc:385] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.264940 25689 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.266891 25688 tablet_bootstrap.cc:654] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.266706 25689 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.268916 25689 ts_tablet_manager.cc:1434] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:00.281726 25695 raft_consensus.cc:359] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.282680 25695 raft_consensus.cc:385] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.282980 25695 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.283872 25695 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.291301 25689 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:00.292953 25695 ts_tablet_manager.cc:1434] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:28:00.295632 25751 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.306627 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:00.307415 25640 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.308208 25641 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:00.315904 25695 tablet_bootstrap.cc:492] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:00.318076 25533 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:00.318537 25495 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:00.303014 25769 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.323401 25751 raft_consensus.cc:2804] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.323917 25751 raft_consensus.cc:697] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:00.325155 25769 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:00.325381 25740 consensus_queue.cc:1048] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.324812 25751 consensus_queue.cc:237] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.326975 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:00.328450 25608 leader_election.cc:343] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:00.329077 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:00.332509 25494 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:00.303714 25828 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:00.334468 25535 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:00.335703 25787 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.336174 25787 raft_consensus.cc:697] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:00.337029 25787 consensus_queue.cc:237] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.337769 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:00.338379 25494 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.344189 25690 tablet_bootstrap.cc:654] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.344473 25695 tablet_bootstrap.cc:654] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.317219 25643 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:00.348490 25758 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.362510 25688 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:00.353294 25384 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:00.364523 25758 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.365006 25758 raft_consensus.cc:697] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:00.365809 25758 consensus_queue.cc:237] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.366263 25640 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:00.367590 25689 tablet_bootstrap.cc:654] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.368463 25459 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:00.369771 25828 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.370278 25828 raft_consensus.cc:697] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:00.363926 25688 ts_tablet_manager.cc:1403] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.003s
I20260709 12:28:00.371069 25828 consensus_queue.cc:237] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.380856 25831 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.394218 25688 raft_consensus.cc:359] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.395174 25831 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.403878 25831 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:00.407260 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.396757 25688 raft_consensus.cc:385] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.414553 25688 raft_consensus.cc:740] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.416493 25316 catalog_manager.cc:5697] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.422183 25316 catalog_manager.cc:5697] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.432341 25722 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.432956 25722 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.438050 25722 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:00.438946 25494 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:00.438083 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.441205 25609 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:00.442337 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.443970 25384 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:00.445396 25831 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.446273 25722 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.447108 25722 raft_consensus.cc:697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:00.447005 25783 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:00.449813 25609 leader_election.cc:343] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.455152 25688 consensus_queue.cc:260] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.469396 25688 ts_tablet_manager.cc:1434] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.003s
I20260709 12:28:00.469527 25695 tablet_bootstrap.cc:492] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:00.470078 25695 ts_tablet_manager.cc:1403] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.167s	user 0.018s	sys 0.007s
I20260709 12:28:00.470822 25688 tablet_bootstrap.cc:492] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:00.475750 25690 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:00.476308 25690 ts_tablet_manager.cc:1403] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.021s
I20260709 12:28:00.478434 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:00.480235 25318 catalog_manager.cc:5697] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:00.488794 25606 leader_election.cc:343] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.489354 25606 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:00.491662 25769 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:00.486683 25871 log.cc:927] Time spent T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:28:00.491663 25315 catalog_manager.cc:5697] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.495419 25690 raft_consensus.cc:359] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.497802 25690 raft_consensus.cc:385] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.498175 25690 raft_consensus.cc:740] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.498787 25693 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.499104 25690 consensus_queue.cc:260] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.483661 25722 consensus_queue.cc:237] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.500769 25689 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:00.499356 25693 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.501343 25689 ts_tablet_manager.cc:1403] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.211s	user 0.015s	sys 0.006s
I20260709 12:28:00.505668 25693 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:00.508353 25695 raft_consensus.cc:359] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.509158 25695 raft_consensus.cc:385] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.509505 25695 raft_consensus.cc:740] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.505546 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.514587 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:00.514461 25695 consensus_queue.cc:260] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.514827 25642 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:00.514814 25689 raft_consensus.cc:359] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.516820 25689 raft_consensus.cc:385] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.517107 25689 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.517405 25690 ts_tablet_manager.cc:1434] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:28:00.518529 25690 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:00.518821 25532 leader_election.cc:343] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.524812 25690 tablet_bootstrap.cc:654] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.535184 25533 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:00.536841 25787 raft_consensus.cc:2804] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.537374 25787 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.537834 25787 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.542541 25688 tablet_bootstrap.cc:654] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.546087 25689 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.552747 25689 ts_tablet_manager.cc:1434] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:28:00.553804 25689 tablet_bootstrap.cc:492] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:00.554571 25787 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.556689 25418 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.557624 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:00.558207 25695 ts_tablet_manager.cc:1434] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.001s
I20260709 12:28:00.558292 25640 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.559370 25695 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:00.567744 25640 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:00.568984 25787 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:00.578197 25533 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:00.579690 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:00.581692 25787 raft_consensus.cc:2804] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.582391 25787 raft_consensus.cc:697] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:00.583460 25787 consensus_queue.cc:237] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.587061 25689 tablet_bootstrap.cc:654] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:00.587769 25532 leader_election.cc:343] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.609015 25695 tablet_bootstrap.cc:654] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.611621 25690 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:00.612152 25690 ts_tablet_manager.cc:1403] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.017s
I20260709 12:28:00.613736 25688 tablet_bootstrap.cc:492] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:00.617601 25690 raft_consensus.cc:359] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.619938 25690 raft_consensus.cc:385] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.620342 25690 raft_consensus.cc:740] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.619400 25688 ts_tablet_manager.cc:1403] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.149s	user 0.019s	sys 0.012s
I20260709 12:28:00.621417 25690 consensus_queue.cc:260] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.623853 25688 raft_consensus.cc:359] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.624565 25688 raft_consensus.cc:385] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.624856 25688 raft_consensus.cc:740] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.625146 25315 catalog_manager.cc:5697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.626755 25688 consensus_queue.cc:260] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.629994 25688 ts_tablet_manager.cc:1434] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:28:00.631196 25688 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:00.633455 25316 catalog_manager.cc:5697] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.635680 25828 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.636232 25828 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.638398 25828 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:00.640175 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.641070 25640 raft_consensus.cc:2393] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 1: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:00.643570 25787 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.644131 25787 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.644881 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:00.647817 25458 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:00.649158 25828 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.656947 25695 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:00.649641 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:00.657485 25695 ts_tablet_manager.cc:1403] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.005s
I20260709 12:28:00.650559 25787 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:00.651085 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.658322 25640 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
W20260709 12:28:00.658402 25532 leader_election.cc:343] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.651794 25688 tablet_bootstrap.cc:654] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.659562 25533 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:00.660756 25787 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.661120 25787 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.661494 25787 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.666514 25688 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:00.667065 25688 ts_tablet_manager.cc:1403] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 12:28:00.670004 25688 raft_consensus.cc:359] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.670734 25688 raft_consensus.cc:385] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.671031 25688 raft_consensus.cc:740] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.671759 25688 consensus_queue.cc:260] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.673923 25787 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.674355 25688 ts_tablet_manager.cc:1434] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:28:00.675477 25688 tablet_bootstrap.cc:492] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:00.677872 25695 raft_consensus.cc:359] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.678529 25695 raft_consensus.cc:385] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.678803 25695 raft_consensus.cc:740] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.678896 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:00.679850 25640 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.680927 25787 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:00.681389 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:00.681716 25695 consensus_queue.cc:260] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:00.683539 25532 leader_election.cc:343] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.683984 25695 ts_tablet_manager.cc:1434] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:28:00.685242 25695 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:00.685384 25881 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.685887 25881 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.688143 25881 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:00.689813 25688 tablet_bootstrap.cc:654] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.690893 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:00.691571 25567 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:00.692911 25385 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:00.698289 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.698971 25494 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:00.699100 25688 tablet_bootstrap.cc:492] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:00.700935 25688 ts_tablet_manager.cc:1403] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.001s
I20260709 12:28:00.702689 25695 tablet_bootstrap.cc:654] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.703999 25688 raft_consensus.cc:359] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.704468 25881 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.704949 25881 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.705374 25881 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.704815 25688 raft_consensus.cc:385] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.709728 25688 raft_consensus.cc:740] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.711304 25688 consensus_queue.cc:260] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.717593 25688 ts_tablet_manager.cc:1434] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:28:00.718650 25688 tablet_bootstrap.cc:492] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:00.718972 25695 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:00.721621 25695 ts_tablet_manager.cc:1403] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.007s
I20260709 12:28:00.727798 25689 tablet_bootstrap.cc:492] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:00.724531 25695 raft_consensus.cc:359] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.727897 25688 tablet_bootstrap.cc:654] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.728204 25695 raft_consensus.cc:385] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.728345 25689 ts_tablet_manager.cc:1403] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.008s
I20260709 12:28:00.728531 25695 raft_consensus.cc:740] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.729295 25695 consensus_queue.cc:260] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.731299 25695 ts_tablet_manager.cc:1434] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:28:00.731089 25689 raft_consensus.cc:359] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.731776 25689 raft_consensus.cc:385] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.732046 25689 raft_consensus.cc:740] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.732390 25695 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:00.734072 25722 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.734549 25722 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.736624 25722 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:00.739466 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:00.740082 25695 tablet_bootstrap.cc:654] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:00.741248 25608 leader_election.cc:343] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.742266 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:00.744041 25609 leader_election.cc:343] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.744642 25609 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:00.747200 25722 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:00.747668 25532 consensus_peers.cc:597] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.751461 25787 consensus_queue.cc:1048] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:00.754289 25787 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.754909 25787 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.760871 25751 consensus_queue.cc:1048] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.761852 25787 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:00.763388 25688 tablet_bootstrap.cc:492] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:00.763933 25688 ts_tablet_manager.cc:1403] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.008s
I20260709 12:28:00.766321 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.767030 25688 raft_consensus.cc:359] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.767457 25643 raft_consensus.cc:2393] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 1: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:00.771061 25688 raft_consensus.cc:385] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.771418 25688 raft_consensus.cc:740] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.772423 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.773239 25688 consensus_queue.cc:260] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.775486 25535 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:00.779099 25787 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.732707 25689 consensus_queue.cc:260] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.787113 25722 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.787709 25722 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.793107 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:00.794307 25689 ts_tablet_manager.cc:1434] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:28:00.800390 25697 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.624353 25690 ts_tablet_manager.cc:1434] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:28:00.794625 25606 leader_election.cc:343] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.805784 25690 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:00.806883 25689 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:00.812441 25722 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:00.814807 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:00.816869 25609 leader_election.cc:343] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.820739 25640 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:00.799780 25828 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.831287 25758 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.833674 25787 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.835948 25881 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.852329 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:00.852985 25567 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.817420 25609 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:00.863687 25881 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:00.863945 25769 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:00.865123 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 48301.1us
I20260709 12:28:00.775528 25688 ts_tablet_manager.cc:1434] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:00.840839 25690 tablet_bootstrap.cc:654] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.865494 25689 tablet_bootstrap.cc:654] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.898128 25567 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:00.866590 25688 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:00.869361 25828 consensus_queue.cc:1048] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:28:00.876807 25533 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:00.888597 25697 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.916059 25697 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.917335 25787 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.917865 25787 raft_consensus.cc:697] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:00.918735 25864 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.918978 25787 consensus_queue.cc:237] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.919451 25864 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.902941 25695 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:00.903530 25722 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.922600 25722 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.923609 25697 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:00.925904 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:00.928786 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.929550 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:00.930456 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.931416 25643 raft_consensus.cc:2393] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:00.931537 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:00.932271 25418 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:28:00.934365 25385 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:00.935369 25697 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.870143 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:00.917801 25828 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.922168 25695 ts_tablet_manager.cc:1403] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.190s	user 0.024s	sys 0.057s
I20260709 12:28:00.924798 25722 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:00.910107 25689 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:00.938436 25689 ts_tablet_manager.cc:1403] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.002s
I20260709 12:28:00.938433 25494 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.938951 25740 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.939977 25740 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.935891 25606 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:00.942248 25740 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:00.942008 25828 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.942919 25769 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.943320 25769 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.943673 25769 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.944176 25493 raft_consensus.cc:2468] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:00.944583 25828 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:00.946015 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:00.947367 25695 raft_consensus.cc:359] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.947846 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.949112 25864 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:00.948829 25316 catalog_manager.cc:5697] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.948107 25695 raft_consensus.cc:385] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.950943 25695 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.951689 25695 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:00.953704 25494 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
W20260709 12:28:00.954038 25458 leader_election.cc:343] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.957893 25695 ts_tablet_manager.cc:1434] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:28:00.955658 25535 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:00.959023 25693 raft_consensus.cc:2804] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.959455 25693 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.959843 25693 raft_consensus.cc:3060] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.960112 25386 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:00.961062 25881 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.961566 25881 raft_consensus.cc:697] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:00.962407 25881 consensus_queue.cc:237] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.965974 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:00.966660 25643 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:00.968466 25693 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:00.956434 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:00.955024 25459 leader_election.cc:343] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.956377 25688 tablet_bootstrap.cc:654] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.975018 25722 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:00.977319 25769 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.986514 25695 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:00.978305 25690 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:00.974961 25697 raft_consensus.cc:2749] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.981731 25459 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:00.988338 25690 ts_tablet_manager.cc:1403] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.183s	user 0.012s	sys 0.000s
I20260709 12:28:00.989961 25569 raft_consensus.cc:2393] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:00.990442 25315 catalog_manager.cc:5697] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.991168 25769 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:00.992343 25690 raft_consensus.cc:359] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:00.992291 25460 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:00.994134 25740 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.994513 25740 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.994889 25740 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.995384 25689 raft_consensus.cc:359] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:00.996138 25689 raft_consensus.cc:385] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.993147 25690 raft_consensus.cc:385] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.994656 25864 consensus_queue.cc:1048] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.997848 25690 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.998646 25690 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.000988 25690 ts_tablet_manager.cc:1434] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:28:01.004649 25690 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:00.997632 25689 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.003665 25828 raft_consensus.cc:3060] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.018972 25693 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:01.020042 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:01.020138 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:01.020747 25609 leader_election.cc:343] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.020793 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:01.021934 25689 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.026861 25740 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.015628 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:01.029762 25418 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.036005 25695 tablet_bootstrap.cc:654] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.048071 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:01.067350 25689 ts_tablet_manager.cc:1434] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.007s
I20260709 12:28:01.068431 25689 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:01.072825 25690 tablet_bootstrap.cc:654] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:01.059779 25533 leader_election.cc:343] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.053745 25693 consensus_queue.cc:1048] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20260709 12:28:01.081666 25533 leader_election.cc:343] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:01.083371 25609 leader_election.cc:343] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.085562 25740 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.093416 25828 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.094676 25569 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.094283 25418 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:01.096140 25606 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:01.097451 25903 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:01.097930 25903 raft_consensus.cc:697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:01.098773 25903 consensus_queue.cc:237] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.117154 25907 consensus_queue.cc:1048] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:01.126096 25689 tablet_bootstrap.cc:654] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.127707 25688 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:01.128369 25688 ts_tablet_manager.cc:1403] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.262s	user 0.019s	sys 0.005s
I20260709 12:28:01.117071 25493 raft_consensus.cc:2468] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:01.129096 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:01.155385 25693 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.156018 25693 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:01.156339 25688 raft_consensus.cc:359] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.157049 25688 raft_consensus.cc:385] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.157359 25688 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.157824 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:01.158459 25418 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.159866 25688 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.160116 25643 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.171938 25751 consensus_queue.cc:1048] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:01.180910 25688 ts_tablet_manager.cc:1434] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:28:01.195395 25689 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:01.195945 25689 ts_tablet_manager.cc:1403] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.012s
I20260709 12:28:01.198173 25688 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:01.205677 25689 raft_consensus.cc:359] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.206462 25689 raft_consensus.cc:385] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.207046 25689 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.207769 25689 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.177611 25905 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:28:01.214188 25695 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:01.221529 25695 ts_tablet_manager.cc:1403] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.239s	user 0.018s	sys 0.020s
I20260709 12:28:01.224442 25695 raft_consensus.cc:359] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.225697 25751 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.226609 25695 raft_consensus.cc:385] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.226851 25751 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.227154 25695 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.227788 25535 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:01.228133 25695 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.229305 25751 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:01.230264 25751 raft_consensus.cc:2804] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:01.230688 25751 raft_consensus.cc:697] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:01.231106 25689 ts_tablet_manager.cc:1434] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:28:01.231477 25751 consensus_queue.cc:237] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:01.232079 25689 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:01.233016 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:01.242625 25695 ts_tablet_manager.cc:1434] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 12:28:01.243959 25695 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:01.233358 25643 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:01.241384 25905 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.250373 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:01.251003 25905 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.251405 25493 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:01.252907 25535 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:01.254263 25783 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:01.254654 25783 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:01.254952 25532 leader_election.cc:343] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.254992 25783 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.257010 25693 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:01.259332 25905 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.261269 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:01.261698 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:01.263185 25606 leader_election.cc:343] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.269325 25688 tablet_bootstrap.cc:654] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.269436 25317 catalog_manager.cc:5697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:01.264415 25783 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.276684 25418 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:01.297202 25458 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:01.298532 25907 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:01.299232 25907 raft_consensus.cc:697] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:01.299934 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:01.303227 25690 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:01.303966 25690 ts_tablet_manager.cc:1403] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.300s	user 0.055s	sys 0.026s
I20260709 12:28:01.292517 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:01.304920 25532 leader_election.cc:343] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.295722 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:01.315498 25695 tablet_bootstrap.cc:654] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.315630 25783 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:01.300438 25907 consensus_queue.cc:237] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.315526 25905 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:01.322880 25608 leader_election.cc:343] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.323414 25608 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:01.324749 25769 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.322686 25905 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.325975 25690 raft_consensus.cc:359] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.326736 25690 raft_consensus.cc:385] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.327018 25690 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.327814 25905 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.327692 25690 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.334280 25535 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:01.335130 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:01.335937 25494 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.337566 25693 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:01.329725 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:01.343832 25608 leader_election.cc:343] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.348471 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:01.356519 25606 leader_election.cc:343] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.357062 25606 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:01.358265 25494 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:01.360040 25905 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.361313 25535 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:01.363793 25695 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:01.363935 25751 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:01.364365 25695 ts_tablet_manager.cc:1403] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.012s
I20260709 12:28:01.365777 25689 tablet_bootstrap.cc:654] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.365157 25697 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:28:01.365114 25751 raft_consensus.cc:697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:01.370901 25317 catalog_manager.cc:5697] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:01.380321 25688 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:01.380846 25688 ts_tablet_manager.cc:1403] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.183s	user 0.013s	sys 0.013s
I20260709 12:28:01.384685 25688 raft_consensus.cc:359] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.385381 25688 raft_consensus.cc:385] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.385658 25690 ts_tablet_manager.cc:1434] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 12:28:01.385676 25688 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.386713 25690 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:01.387435 25688 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.387925 25751 consensus_queue.cc:237] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.393121 25688 ts_tablet_manager.cc:1434] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:28:01.394459 25688 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:01.396401 25695 raft_consensus.cc:359] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.397190 25695 raft_consensus.cc:385] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.397456 25695 raft_consensus.cc:740] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.398209 25695 consensus_queue.cc:260] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.403581 25697 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:01.404850 25690 tablet_bootstrap.cc:654] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.408350 25695 ts_tablet_manager.cc:1434] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.003s
I20260709 12:28:01.409461 25695 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:01.424747 25318 catalog_manager.cc:5697] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:01.434259 25689 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:01.434790 25689 ts_tablet_manager.cc:1403] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.203s	user 0.006s	sys 0.007s
I20260709 12:28:01.452464 25689 raft_consensus.cc:359] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.453022 25689 raft_consensus.cc:385] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.453276 25689 raft_consensus.cc:740] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.455670 25689 consensus_queue.cc:260] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.475757 25689 ts_tablet_manager.cc:1434] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.004s
I20260709 12:28:01.477792 25783 consensus_queue.cc:1048] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:01.479584 25695 tablet_bootstrap.cc:654] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.481506 25689 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:01.484335 25911 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:01.486397 25532 consensus_peers.cc:597] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:01.484890 25911 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:01.489630 25911 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:01.490228 25690 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:01.490720 25690 ts_tablet_manager.cc:1403] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.017s
I20260709 12:28:01.491377 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:01.492885 25458 leader_election.cc:343] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.496145 25688 tablet_bootstrap.cc:654] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.496596 25689 tablet_bootstrap.cc:654] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.496670 25905 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.497217 25903 consensus_queue.cc:1048] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:01.497279 25905 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.497741 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:01.499557 25905 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:01.500105 25831 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.500532 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:01.500584 25831 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:01.502756 25606 leader_election.cc:343] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.503153 25831 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:01.505841 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:01.506129 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:01.506966 25493 raft_consensus.cc:2393] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
W20260709 12:28:01.507261 25460 leader_election.cc:343] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.507651 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:01.507758 25460 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:01.509735 25385 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:01.510174 25740 raft_consensus.cc:2749] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.510941 25697 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:01.512431 25609 leader_election.cc:343] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.512915 25609 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:01.513912 25690 raft_consensus.cc:359] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.514693 25903 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.514874 25690 raft_consensus.cc:385] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.515355 25690 raft_consensus.cc:740] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.518961 25695 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:01.519690 25695 ts_tablet_manager.cc:1403] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.002s
I20260709 12:28:01.524286 25690 consensus_queue.cc:260] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:01.529393 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:01.532701 25697 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.533211 25690 ts_tablet_manager.cc:1434] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:28:01.533845 25318 catalog_manager.cc:5697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:01.543171 25690 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:01.535892 25695 raft_consensus.cc:359] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.545295 25695 raft_consensus.cc:385] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.545612 25695 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.546269 25689 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:01.546978 25689 ts_tablet_manager.cc:1403] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.005s
I20260709 12:28:01.550935 25689 raft_consensus.cc:359] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.551819 25689 raft_consensus.cc:385] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.552191 25689 raft_consensus.cc:740] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.546273 25695 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.555996 25695 ts_tablet_manager.cc:1434] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:28:01.556907 25695 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:01.559775 25690 tablet_bootstrap.cc:654] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.565033 25688 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:01.562553 25689 consensus_queue.cc:260] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.565593 25688 ts_tablet_manager.cc:1403] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.171s	user 0.038s	sys 0.022s
I20260709 12:28:01.568337 25688 raft_consensus.cc:359] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.568985 25688 raft_consensus.cc:385] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.569253 25688 raft_consensus.cc:740] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.570039 25688 consensus_queue.cc:260] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.572108 25688 ts_tablet_manager.cc:1434] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:01.572655 25695 tablet_bootstrap.cc:654] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.572989 25688 tablet_bootstrap.cc:492] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:01.575769 25689 ts_tablet_manager.cc:1434] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:28:01.580686 25688 tablet_bootstrap.cc:654] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.585425 25689 tablet_bootstrap.cc:492] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:01.585821 25493 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.589752 25751 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.590292 25751 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.593297 25787 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.593480 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:01.593778 25787 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.594200 25643 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:01.594466 25689 tablet_bootstrap.cc:654] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.595638 25533 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:01.595933 25787 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.596568 25787 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:01.598104 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:01.598160 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:01.599184 25751 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.596899 25787 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.600093 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:01.600395 25533 leader_election.cc:343] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.600488 25787 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:01.602562 25532 leader_election.cc:343] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.608135 25740 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.608688 25740 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.613287 25740 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.612792 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:01.614215 25643 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:01.615345 25459 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:01.616523 25740 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:01.616928 25740 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.617326 25740 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:01.616532 25532 leader_election.cc:343] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.618875 25532 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:01.621040 25693 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.625721 25688 tablet_bootstrap.cc:492] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:01.626194 25688 ts_tablet_manager.cc:1403] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.009s
I20260709 12:28:01.628836 25688 raft_consensus.cc:359] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:01.631569 25688 raft_consensus.cc:385] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.631947 25688 raft_consensus.cc:740] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.630543 25740 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:01.631062 25695 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:01.632781 25695 ts_tablet_manager.cc:1403] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.004s
I20260709 12:28:01.615345 25787 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.635524 25695 raft_consensus.cc:359] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.636197 25695 raft_consensus.cc:385] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.636245 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:01.636639 25418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:01.637053 25642 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:01.638206 25532 leader_election.cc:343] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.638067 25688 consensus_queue.cc:260] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:01.642186 25688 ts_tablet_manager.cc:1434] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:28:01.642491 25740 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.643652 25787 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.636565 25695 raft_consensus.cc:740] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.646979 25695 consensus_queue.cc:260] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.647933 25926 consensus_queue.cc:1048] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:01.652097 25642 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:01.653535 25533 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:01.654826 25751 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:01.655329 25751 raft_consensus.cc:697] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:01.656970 25688 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:01.658015 25751 consensus_queue.cc:237] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.662185 25690 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:01.662734 25690 ts_tablet_manager.cc:1403] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.003s
I20260709 12:28:01.665680 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:01.666337 25640 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.668346 25695 ts_tablet_manager.cc:1434] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:28:01.670749 25881 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.681679 25695 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:01.688198 25903 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.688887 25903 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:01.730533 25384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 202740us
I20260709 12:28:01.754369 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:01.751466 25690 raft_consensus.cc:359] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:01.756969 25608 leader_election.cc:343] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.672242 25881 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:01.757333 25533 consensus_peers.cc:597] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 -> Peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Couldn't send request to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:01.758356 25688 tablet_bootstrap.cc:654] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.759292 25690 raft_consensus.cc:385] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.761255 25690 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.761870 25689 tablet_bootstrap.cc:492] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:01.762360 25689 ts_tablet_manager.cc:1403] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.186s	user 0.036s	sys 0.048s
I20260709 12:28:01.768561 25689 raft_consensus.cc:359] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:01.769640 25689 raft_consensus.cc:385] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.769934 25689 raft_consensus.cc:740] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.770644 25689 consensus_queue.cc:260] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:01.772567 25689 ts_tablet_manager.cc:1434] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:28:01.773622 25689 tablet_bootstrap.cc:492] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:01.773749 25695 tablet_bootstrap.cc:654] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.775233 25881 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:01.773532 25690 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.778419 25690 ts_tablet_manager.cc:1434] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.115s	user 0.002s	sys 0.007s
I20260709 12:28:01.779444 25690 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:01.779738 25695 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:01.780212 25695 ts_tablet_manager.cc:1403] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.002s
I20260709 12:28:01.780582 25689 tablet_bootstrap.cc:654] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.773908 25903 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.826018 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:01.831372 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:01.833423 25693 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.832674 25695 raft_consensus.cc:359] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.833895 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:01.834332 25695 raft_consensus.cc:385] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.834750 25695 raft_consensus.cc:740] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.834602 25693 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:01.836176 25695 consensus_queue.cc:260] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:01.839777 25695 ts_tablet_manager.cc:1434] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.001s
W20260709 12:28:01.842674 25606 leader_election.cc:343] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.843675 25606 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:01.850685 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:01.851830 25643 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:01.853749 25722 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.856189 25533 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:01.859827 25787 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:01.860283 25787 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.860760 25787 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.873768 25907 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:01.866730 25693 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:01.849048 25751 consensus_queue.cc:1048] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
W20260709 12:28:01.889051 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 46791.8us
I20260709 12:28:01.918229 25769 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.919050 25769 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:01.927058 25384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 55666.7us
I20260709 12:28:01.930140 25316 catalog_manager.cc:5697] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:01.933719 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:01.975651 25769 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:01.978101 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:01.980863 25606 leader_election.cc:343] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.011607 25695 tablet_bootstrap.cc:492] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
W20260709 12:28:02.017346 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 173119us
W20260709 12:28:02.021879 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 146161us
I20260709 12:28:02.028295 25690 tablet_bootstrap.cc:654] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:02.039752 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 148416us
I20260709 12:28:02.042340 25697 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.046303 25926 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.043074 25697 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.048059 25926 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.051179 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.051234 25697 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:02.052250 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:02.053905 25643 raft_consensus.cc:2393] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:02.057250 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:02.058367 25787 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:02.059058 25606 leader_election.cc:343] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.059924 25926 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:02.064570 25688 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:02.065423 25688 ts_tablet_manager.cc:1403] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.409s	user 0.022s	sys 0.005s
I20260709 12:28:02.069612 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.071055 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.073994 25385 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
W20260709 12:28:02.074347 25458 leader_election.cc:343] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:02.075873 25458 leader_election.cc:343] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.075183 25640 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:02.077782 25688 raft_consensus.cc:359] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.078593 25688 raft_consensus.cc:385] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.078861 25688 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.075839 25697 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.079239 25459 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:02.079605 25688 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.081180 25951 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.081801 25951 raft_consensus.cc:697] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:02.083083 25951 consensus_queue.cc:237] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:02.086753 25609 leader_election.cc:343] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.087354 25609 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:02.087733 25948 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:02.079303 25695 tablet_bootstrap.cc:654] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.082446 25688 ts_tablet_manager.cc:1434] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:28:02.088148 25385 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:02.088589 25926 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.093621 25689 tablet_bootstrap.cc:492] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:02.094410 25689 ts_tablet_manager.cc:1403] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.321s	user 0.008s	sys 0.007s
I20260709 12:28:02.098104 25881 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.098737 25689 raft_consensus.cc:359] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.101152 25419 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.099619 25689 raft_consensus.cc:385] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.105095 25689 raft_consensus.cc:740] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.108070 25787 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:02.111093 25689 consensus_queue.cc:260] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.110302 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:02.112361 25643 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.120038 25881 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.122772 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.123677 25565 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:28:02.126868 25688 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:02.144819 25911 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.145498 25911 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.150852 25608 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:02.151410 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.152156 25491 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:02.154597 25690 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:02.157857 25643 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:02.159317 25769 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.162958 25769 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.163419 25769 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.168938 25689 ts_tablet_manager.cc:1434] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.074s	user 0.010s	sys 0.000s
I20260709 12:28:02.172996 25690 ts_tablet_manager.cc:1403] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.394s	user 0.010s	sys 0.005s
I20260709 12:28:02.174602 25533 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:02.175364 25689 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:02.181310 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.175557 25693 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:28:02.183862 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:02.184773 25640 raft_consensus.cc:2393] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:02.157757 25911 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:02.178166 25787 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.195621 25695 tablet_bootstrap.cc:492] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:02.196199 25695 ts_tablet_manager.cc:1403] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.355s	user 0.004s	sys 0.012s
I20260709 12:28:02.196812 25316 catalog_manager.cc:5697] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:02.199256 25787 raft_consensus.cc:697] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:02.204830 25787 consensus_queue.cc:237] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.209705 25689 tablet_bootstrap.cc:654] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.210729 25695 raft_consensus.cc:359] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.211489 25695 raft_consensus.cc:385] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.211764 25695 raft_consensus.cc:740] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.212472 25695 consensus_queue.cc:260] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.223480 25688 tablet_bootstrap.cc:654] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.231993 25690 raft_consensus.cc:359] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.232872 25690 raft_consensus.cc:385] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.239339 25693 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:02.233156 25690 raft_consensus.cc:740] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.248653 25690 consensus_queue.cc:260] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.250504 25690 ts_tablet_manager.cc:1434] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.077s	user 0.003s	sys 0.004s
I20260709 12:28:02.251780 25690 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:02.228935 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:02.254237 25494 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.255908 25460 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:02.266176 25693 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.285668 25693 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.288072 25693 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:02.289821 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:02.271365 25951 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.292619 25951 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.294927 25951 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:02.296388 25532 leader_election.cc:343] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.296765 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:02.298579 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:02.298662 25459 leader_election.cc:343] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:02.300334 25460 leader_election.cc:343] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.300853 25460 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:02.304607 25952 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.313427 25416 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.330610 25695 ts_tablet_manager.cc:1434] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.134s	user 0.005s	sys 0.001s
I20260709 12:28:02.331954 25695 tablet_bootstrap.cc:492] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:02.333292 25317 catalog_manager.cc:5697] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.345010 25949 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:02.346467 25769 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.350174 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:02.351794 25606 leader_election.cc:343] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.355695 25689 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:02.356252 25689 ts_tablet_manager.cc:1403] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.183s	user 0.057s	sys 0.051s
I20260709 12:28:02.358712 25951 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:02.359858 25689 raft_consensus.cc:359] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.360759 25689 raft_consensus.cc:385] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.361081 25689 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.362236 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:02.362183 25689 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.362986 25563 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.363876 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.364722 25689 ts_tablet_manager.cc:1434] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:02.364643 25490 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:02.370868 25689 tablet_bootstrap.cc:492] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:02.378219 25494 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:02.378831 25911 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.380936 25690 tablet_bootstrap.cc:654] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.386951 25689 tablet_bootstrap.cc:654] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.392993 25769 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:02.393699 25535 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:02.404807 25948 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.405475 25948 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.405906 25948 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.445336 25563 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:02.471362 25688 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:02.471973 25688 ts_tablet_manager.cc:1403] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.345s	user 0.023s	sys 0.054s
I20260709 12:28:02.481866 25608 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:02.483251 25769 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.483834 25769 raft_consensus.cc:697] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:02.484846 25769 consensus_queue.cc:237] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.486107 25689 tablet_bootstrap.cc:492] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:02.486779 25689 ts_tablet_manager.cc:1403] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.016s
I20260709 12:28:02.497565 25695 tablet_bootstrap.cc:654] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.501924 25688 raft_consensus.cc:359] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.504614 25688 raft_consensus.cc:385] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.504937 25688 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.506692 25948 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.518898 25690 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:02.519658 25690 ts_tablet_manager.cc:1403] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.268s	user 0.028s	sys 0.049s
I20260709 12:28:02.524573 25688 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.525841 25689 raft_consensus.cc:359] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.527014 25689 raft_consensus.cc:385] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:02.533751 25458 consensus_peers.cc:597] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.535323 25948 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:02.536754 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:02.537518 25494 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.540333 25690 raft_consensus.cc:359] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.541061 25690 raft_consensus.cc:385] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.541352 25690 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.542008 25690 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.543623 25690 ts_tablet_manager.cc:1434] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:28:02.529716 25695 tablet_bootstrap.cc:492] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:02.527438 25689 raft_consensus.cc:740] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.544903 25695 ts_tablet_manager.cc:1403] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.014s
I20260709 12:28:02.548956 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:02.554242 25416 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.555514 25494 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:02.557119 25535 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:02.559142 25787 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.559208 25689 consensus_queue.cc:260] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.559808 25787 raft_consensus.cc:697] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:02.561743 25688 ts_tablet_manager.cc:1434] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.003s
I20260709 12:28:02.560777 25787 consensus_queue.cc:237] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.562938 25688 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:02.560770 25689 ts_tablet_manager.cc:1434] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 12:28:02.575284 25689 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:02.575513 25416 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:02.569810 25316 catalog_manager.cc:5697] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.586978 25690 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:02.599617 25318 catalog_manager.cc:5697] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:02.610100 25688 tablet_bootstrap.cc:654] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.617087 25690 tablet_bootstrap.cc:654] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.621078 25695 raft_consensus.cc:359] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.631155 25695 raft_consensus.cc:385] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.631722 25695 raft_consensus.cc:740] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.635468 25695 consensus_queue.cc:260] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.643496 25740 consensus_queue.cc:1048] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:02.647660 25689 tablet_bootstrap.cc:654] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.654389 25689 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:02.654855 25689 ts_tablet_manager.cc:1403] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.001s
I20260709 12:28:02.656778 25688 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:02.657327 25688 ts_tablet_manager.cc:1403] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.003s
I20260709 12:28:02.659575 25695 ts_tablet_manager.cc:1434] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.000s
I20260709 12:28:02.674335 25695 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:02.662978 25689 raft_consensus.cc:359] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.664145 25769 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.660637 25688 raft_consensus.cc:359] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.675741 25688 raft_consensus.cc:385] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.675850 25689 raft_consensus.cc:385] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.676105 25688 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.676209 25689 raft_consensus.cc:740] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.676931 25688 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.676970 25689 consensus_queue.cc:260] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.679390 25688 ts_tablet_manager.cc:1434] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:28:02.679553 25689 ts_tablet_manager.cc:1434] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:28:02.680433 25688 tablet_bootstrap.cc:492] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:02.675771 25769 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.683055 25740 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.683601 25740 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.684151 25769 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:02.687659 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.690646 25740 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:02.672806 25690 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:02.693097 25690 ts_tablet_manager.cc:1403] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.003s
I20260709 12:28:02.694217 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:02.694422 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.695418 25562 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:02.695530 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.697283 25460 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:02.698149 25740 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:02.698344 25458 leader_election.cc:343] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.698606 25740 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.699182 25740 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.699647 25787 consensus_queue.cc:1048] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:02.701853 25608 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:02.703029 25769 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.712519 25695 tablet_bootstrap.cc:654] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.714112 25688 tablet_bootstrap.cc:654] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.695742 25689 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:02.712327 25690 raft_consensus.cc:359] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.727095 25690 raft_consensus.cc:385] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.727437 25690 raft_consensus.cc:740] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.726501 25722 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.728338 25722 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.730710 25722 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:02.733273 25787 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.733835 25787 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.734493 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.736042 25787 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:02.738336 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:02.738577 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:02.739398 25643 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
W20260709 12:28:02.739984 25532 leader_election.cc:343] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:02.736096 25608 leader_election.cc:343] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.740865 25533 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:02.742256 25690 consensus_queue.cc:260] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.745342 25948 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.745785 25948 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.746121 25948 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.747551 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.748169 25494 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:28:02.750185 25690 ts_tablet_manager.cc:1434] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:28:02.750066 25609 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:02.751189 25722 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.751559 25722 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.751893 25722 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.758684 25948 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.759562 25751 consensus_queue.cc:1048] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:02.761893 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:02.763479 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
W20260709 12:28:02.763806 25532 leader_election.cc:343] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.764106 25643 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.774133 25695 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:02.774643 25695 ts_tablet_manager.cc:1403] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.000s
I20260709 12:28:02.777705 25695 raft_consensus.cc:359] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.778422 25695 raft_consensus.cc:385] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.778745 25695 raft_consensus.cc:740] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.762527 25722 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.793823 25695 consensus_queue.cc:260] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.796496 25643 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:02.769858 25948 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:02.792266 25952 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.813354 25952 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.815657 25952 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:02.816780 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:02.817775 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:02.818192 25689 tablet_bootstrap.cc:654] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:02.818485 25459 leader_election.cc:343] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:02.819548 25460 leader_election.cc:343] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.819959 25460 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:02.821331 25952 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.829375 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:02.831557 25608 leader_election.cc:343] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:02.832485 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:02.834255 25695 ts_tablet_manager.cc:1434] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:28:02.834041 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:02.835196 25490 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.829685 25690 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:02.837028 25769 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.837598 25769 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.839901 25769 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:02.841141 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.841511 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:02.829458 25722 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:02.842617 25609 leader_election.cc:343] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:02.843101 25606 leader_election.cc:343] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.843544 25606 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:02.835548 25640 raft_consensus.cc:3060] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.849604 25533 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:02.846714 25722 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.851122 25695 tablet_bootstrap.cc:492] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:02.857291 25948 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.860982 25948 raft_consensus.cc:697] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:02.861863 25948 consensus_queue.cc:237] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:02.867764 25689 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:02.868363 25689 ts_tablet_manager.cc:1403] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.004s
I20260709 12:28:02.871222 25689 raft_consensus.cc:359] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.872193 25689 raft_consensus.cc:385] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.874934 25881 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.885531 25689 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.885584 25881 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.886492 25689 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:02.889357 25689 ts_tablet_manager.cc:1434] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:28:02.889662 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.890393 25689 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:02.891831 25881 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:02.875487 25740 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.892594 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:02.898870 25384 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:02.901211 25695 tablet_bootstrap.cc:654] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.901290 25976 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.906358 25690 tablet_bootstrap.cc:654] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.913434 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:02.914134 25562 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.915710 25690 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:02.916240 25690 ts_tablet_manager.cc:1403] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.001s
I20260709 12:28:02.918592 25688 tablet_bootstrap.cc:492] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:02.919149 25688 ts_tablet_manager.cc:1403] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.239s	user 0.019s	sys 0.024s
I20260709 12:28:02.922823 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:02.921710 25690 raft_consensus.cc:359] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.926980 25688 raft_consensus.cc:359] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.927585 25690 raft_consensus.cc:385] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.927649 25688 raft_consensus.cc:385] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.927938 25690 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.928711 25690 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.930078 25416 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.931151 25690 ts_tablet_manager.cc:1434] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:28:02.932253 25690 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:02.928015 25688 raft_consensus.cc:740] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.933907 25688 consensus_queue.cc:260] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.936901 25689 tablet_bootstrap.cc:654] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.938517 25690 tablet_bootstrap.cc:654] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.939158 25948 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.939729 25688 ts_tablet_manager.cc:1434] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:28:02.939690 25948 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.940865 25688 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:02.920871 25740 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:02.943686 25948 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:02.945293 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:02.951990 25562 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:02.952692 25643 raft_consensus.cc:2393] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 1: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:02.948868 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:02.953300 25460 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:02.954247 25952 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.955037 25533 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:02.956239 25948 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.956684 25952 raft_consensus.cc:697] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:02.884846 25490 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:02.947376 25416 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:02.960348 25609 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:02.960126 25952 consensus_queue.cc:237] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:02.961584 25769 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.962100 25769 raft_consensus.cc:697] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:02.962970 25769 consensus_queue.cc:237] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:02.977537 25316 catalog_manager.cc:5697] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.000588 25787 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:03.003953 25948 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:03.005326 25606 consensus_peers.cc:597] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:03.005813 25740 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.015357 25740 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.029799 25315 catalog_manager.cc:5697] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.031950 25688 tablet_bootstrap.cc:654] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.033834 25695 tablet_bootstrap.cc:492] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:03.034404 25695 ts_tablet_manager.cc:1403] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.184s	user 0.015s	sys 0.007s
I20260709 12:28:03.039598 25740 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:03.058650 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:03.064996 25460 leader_election.cc:343] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.064071 25695 raft_consensus.cc:359] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.069295 25695 raft_consensus.cc:385] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.069746 25695 raft_consensus.cc:740] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.084230 25690 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:03.085819 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:03.088052 25458 leader_election.cc:343] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.088522 25458 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:03.089629 25740 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.094266 25787 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:03.085008 25690 ts_tablet_manager.cc:1403] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.153s	user 0.030s	sys 0.023s
I20260709 12:28:03.099485 25690 raft_consensus.cc:359] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.100327 25690 raft_consensus.cc:385] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.100646 25690 raft_consensus.cc:740] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.111681 25926 consensus_queue.cc:1048] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:03.116916 25417 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:03.129341 25995 log.cc:927] Time spent T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:28:03.155083 25690 consensus_queue.cc:260] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.170650 25690 ts_tablet_manager.cc:1434] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 12:28:03.178884 25689 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:03.179459 25689 ts_tablet_manager.cc:1403] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.289s	user 0.041s	sys 0.062s
I20260709 12:28:03.182387 25689 raft_consensus.cc:359] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.183171 25689 raft_consensus.cc:385] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.183463 25689 raft_consensus.cc:740] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.184255 25689 consensus_queue.cc:260] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.186372 25689 ts_tablet_manager.cc:1434] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:28:03.187430 25689 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:03.193699 25695 consensus_queue.cc:260] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.196470 25695 ts_tablet_manager.cc:1434] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.162s	user 0.012s	sys 0.000s
I20260709 12:28:03.210889 25690 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:03.228672 25695 tablet_bootstrap.cc:492] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:03.234154 25690 tablet_bootstrap.cc:654] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.236452 25695 tablet_bootstrap.cc:654] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.238869 25688 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:03.239598 25688 ts_tablet_manager.cc:1403] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.299s	user 0.008s	sys 0.006s
I20260709 12:28:03.211570 25316 catalog_manager.cc:5697] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.255467 25689 tablet_bootstrap.cc:654] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.258234 25722 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.261690 25722 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.263998 25722 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:03.266893 25688 raft_consensus.cc:359] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.267913 25688 raft_consensus.cc:385] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.268222 25688 raft_consensus.cc:740] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.268797 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:03.269109 25688 consensus_queue.cc:260] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:03.270525 25609 leader_election.cc:343] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.301067 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:03.303457 25688 ts_tablet_manager.cc:1434] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.002s
W20260709 12:28:03.306905 25608 leader_election.cc:343] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.307498 25608 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:03.305048 25688 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:03.312925 26003 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.332435 25949 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:03.341290 25690 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:03.341632 25689 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:03.342063 25690 ts_tablet_manager.cc:1403] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.141s	user 0.040s	sys 0.035s
I20260709 12:28:03.342285 25740 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.342865 25740 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.344502 25688 tablet_bootstrap.cc:654] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.346514 25689 ts_tablet_manager.cc:1403] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.159s	user 0.021s	sys 0.017s
I20260709 12:28:03.346323 25690 raft_consensus.cc:359] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.347323 25690 raft_consensus.cc:385] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.347671 25690 raft_consensus.cc:740] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.348526 25690 consensus_queue.cc:260] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.352440 25690 ts_tablet_manager.cc:1434] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:28:03.353561 25690 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:03.353564 25695 tablet_bootstrap.cc:492] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:03.355819 25695 ts_tablet_manager.cc:1403] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.006s
I20260709 12:28:03.346065 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:03.360719 25740 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:03.349797 25689 raft_consensus.cc:359] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.361999 25643 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:03.362771 25689 raft_consensus.cc:385] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.362367 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:03.363193 25689 raft_consensus.cc:740] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
W20260709 12:28:03.364364 25458 leader_election.cc:343] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.364173 25689 consensus_queue.cc:260] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.365437 25459 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:03.366568 25952 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.366950 25952 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.367255 25952 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.374383 25690 tablet_bootstrap.cc:654] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.374905 25689 ts_tablet_manager.cc:1434] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:28:03.382725 25952 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.384680 25689 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:03.393440 25952 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:03.393671 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:03.394570 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:03.397076 25643 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:03.402112 25458 leader_election.cc:343] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:03.411114 25532 consensus_peers.cc:597] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:03.396016 25695 raft_consensus.cc:359] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.417663 25695 raft_consensus.cc:385] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.417759 25643 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:03.418644 25740 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.418265 25695 raft_consensus.cc:740] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.419800 25740 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.424284 25689 tablet_bootstrap.cc:654] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.434685 25459 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:03.438364 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:03.422417 25695 consensus_queue.cc:260] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.439222 25641 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:03.441754 25911 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.446492 25740 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:03.447235 25740 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.447703 25740 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.450840 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:03.451529 25417 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:03.453310 25458 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:03.453568 25769 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:03.459225 25695 ts_tablet_manager.cc:1434] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.001s
I20260709 12:28:03.472684 25695 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:03.475991 25952 raft_consensus.cc:2804] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.476467 25952 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.477200 25952 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.481482 25881 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.482302 25881 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.491811 25690 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:03.492367 25690 ts_tablet_manager.cc:1403] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.139s	user 0.032s	sys 0.030s
I20260709 12:28:03.493230 25881 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:03.495047 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:03.495338 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:03.495339 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:03.497661 25384 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:03.497969 25688 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:03.498586 25688 ts_tablet_manager.cc:1403] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.194s	user 0.015s	sys 0.004s
W20260709 12:28:03.498970 25458 leader_election.cc:343] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.500663 25740 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:03.502218 25881 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.509007 25689 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:03.509613 25689 ts_tablet_manager.cc:1403] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.125s	user 0.023s	sys 0.022s
I20260709 12:28:03.509562 25688 raft_consensus.cc:359] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.510521 25688 raft_consensus.cc:385] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.510780 25688 raft_consensus.cc:740] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.512465 25688 consensus_queue.cc:260] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.503593 25911 raft_consensus.cc:697] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:03.515233 25948 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.515745 25948 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.518275 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:03.517082 25689 raft_consensus.cc:359] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.522393 25689 raft_consensus.cc:385] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.522693 25688 ts_tablet_manager.cc:1434] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 12:28:03.522666 25689 raft_consensus.cc:740] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.521549 26010 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:28:03.528016 25695 tablet_bootstrap.cc:654] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.530444 25689 consensus_queue.cc:260] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.532612 25740 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:03.536636 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:03.537395 25642 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:03.538283 25690 raft_consensus.cc:359] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.539639 25533 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:03.542624 25690 raft_consensus.cc:385] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.542922 25690 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.543493 25949 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.543998 25949 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.543635 25690 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.542405 25688 tablet_bootstrap.cc:492] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:03.541813 25769 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:03.534789 25911 consensus_queue.cc:237] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.544402 25949 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.552202 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:03.552909 25460 leader_election.cc:343] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.553421 25948 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:03.553817 25532 leader_election.cc:343] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.556020 25952 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.553433 25460 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:03.546005 25690 ts_tablet_manager.cc:1434] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.002s
I20260709 12:28:03.560086 25949 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.562096 25689 ts_tablet_manager.cc:1434] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:28:03.565408 25740 raft_consensus.cc:2749] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.567363 25689 tablet_bootstrap.cc:492] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:03.568892 25690 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:03.574542 25751 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.575142 25751 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.575788 25952 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:03.581383 25688 tablet_bootstrap.cc:654] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.581329 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:03.582176 25642 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.586078 25420 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.586820 25769 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.587296 25769 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.588953 25751 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:03.591048 25769 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:03.591781 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:03.592211 25317 catalog_manager.cc:5697] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.598634 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:03.599162 25949 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:03.599349 25640 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.606462 25695 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:03.607049 25695 ts_tablet_manager.cc:1403] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.005s
W20260709 12:28:03.607200 25532 leader_election.cc:343] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.609102 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:03.609972 25491 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:28:03.612079 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:03.613580 25608 leader_election.cc:343] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.613960 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:03.615568 25532 leader_election.cc:343] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.617352 25609 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:03.618755 25926 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.619251 25926 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.619673 25926 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.633453 25695 raft_consensus.cc:359] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.635424 25695 raft_consensus.cc:385] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.635825 25695 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
W20260709 12:28:03.626703 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 101968us
I20260709 12:28:03.646199 25695 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.633227 25640 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:03.657907 25642 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:03.658984 25533 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:03.661137 25949 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.660966 25689 tablet_bootstrap.cc:654] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.661789 25459 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:03.664052 26010 raft_consensus.cc:2804] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.664536 26010 raft_consensus.cc:697] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:03.665736 26010 consensus_queue.cc:237] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.661813 25949 raft_consensus.cc:697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:03.667255 25949 consensus_queue.cc:237] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.676400 25926 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.682919 25695 ts_tablet_manager.cc:1434] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 12:28:03.683923 26003 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.684449 26003 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.690338 26003 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:03.697553 25926 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:03.698943 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:03.699031 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:03.699759 25491 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.701411 25688 tablet_bootstrap.cc:492] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:03.702461 25688 ts_tablet_manager.cc:1403] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.160s	user 0.013s	sys 0.020s
W20260709 12:28:03.717801 25606 leader_election.cc:343] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.722071 25695 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:03.725481 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:03.726884 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:03.727550 25416 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.727679 25491 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:03.729056 25609 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:03.729552 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:03.729859 25926 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.730432 25926 raft_consensus.cc:697] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:03.794903 25690 tablet_bootstrap.cc:654] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.730655 25317 catalog_manager.cc:5697] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.731287 25926 consensus_queue.cc:237] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.812211 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:03.807682 25688 raft_consensus.cc:359] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.814570 25688 raft_consensus.cc:385] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.814867 25688 raft_consensus.cc:740] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.817866 25689 tablet_bootstrap.cc:492] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:03.818373 25689 ts_tablet_manager.cc:1403] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.251s	user 0.012s	sys 0.007s
I20260709 12:28:03.822402 25416 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:03.823447 25688 consensus_queue.cc:260] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.813021 25491 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:03.830520 25695 tablet_bootstrap.cc:654] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:03.733745 25608 leader_election.cc:343] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.830863 25316 catalog_manager.cc:5697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.858070 25535 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:03.859795 25688 ts_tablet_manager.cc:1434] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.003s
I20260709 12:28:03.863178 26011 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.863689 26011 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.861480 25689 raft_consensus.cc:359] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.866571 25689 raft_consensus.cc:385] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.866882 25689 raft_consensus.cc:740] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.843832 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:03.874413 26011 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:03.875653 26003 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.877980 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:03.878436 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 144729us
W20260709 12:28:03.879864 25460 leader_election.cc:343] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.867867 25949 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.881002 25949 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.882265 25949 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:03.880872 25608 leader_election.cc:343] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.894640 25881 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.895233 25881 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:03.887923 25689 consensus_queue.cc:260] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.909869 25881 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:03.912966 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:03.915882 25689 ts_tablet_manager.cc:1434] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260709 12:28:03.917048 25689 tablet_bootstrap.cc:492] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:03.923827 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:03.925424 25420 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.928793 25949 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.932917 25751 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.934605 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:03.934412 25751 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.937788 25751 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:03.941291 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:03.942642 25384 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:03.945106 25690 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:03.950958 25690 ts_tablet_manager.cc:1403] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.383s	user 0.010s	sys 0.007s
I20260709 12:28:03.946410 25318 catalog_manager.cc:5697] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.953822 25690 raft_consensus.cc:359] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.954478 25690 raft_consensus.cc:385] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.954751 25690 raft_consensus.cc:740] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.949262 25689 tablet_bootstrap.cc:654] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.950034 25688 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:03.961378 25695 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:03.961933 25695 ts_tablet_manager.cc:1403] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.259s	user 0.019s	sys 0.004s
I20260709 12:28:03.950317 25949 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:03.963052 25690 consensus_queue.cc:260] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:03.964875 25695 raft_consensus.cc:359] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.965637 25695 raft_consensus.cc:385] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.965976 25695 raft_consensus.cc:740] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.967749 26030 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:03.968593 25695 consensus_queue.cc:260] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:03.970276 25695 ts_tablet_manager.cc:1434] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:03.974259 25695 tablet_bootstrap.cc:492] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:03.986159 25690 ts_tablet_manager.cc:1434] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 12:28:03.987413 25689 tablet_bootstrap.cc:492] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:03.989893 25689 ts_tablet_manager.cc:1403] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 12:28:03.991633 25690 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:03.993250 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:03.994083 25688 tablet_bootstrap.cc:654] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.994609 25689 raft_consensus.cc:359] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:03.996260 25689 raft_consensus.cc:385] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.996577 25689 raft_consensus.cc:740] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.996667 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:03.997262 25494 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.994179 25416 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.002816 25976 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.010375 25689 consensus_queue.cc:260] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.015336 25911 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.015903 25911 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.016438 25494 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:04.019724 25911 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:04.021412 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:04.022866 25460 leader_election.cc:343] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.024627 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:04.025359 25640 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:04.032938 25695 tablet_bootstrap.cc:654] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.033305 25689 ts_tablet_manager.cc:1434] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
W20260709 12:28:04.010221 25458 leader_election.cc:343] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.033926 25458 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:04.035956 25689 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:04.032227 25459 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:04.041025 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:04.041914 25491 raft_consensus.cc:2393] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 1: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:04.042608 25689 tablet_bootstrap.cc:654] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.046123 25690 tablet_bootstrap.cc:654] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.047293 26011 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:04.051084 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:04.054561 25535 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:04.055461 25535 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:04.051738 25911 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.056535 25911 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.056901 25911 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.057042 25948 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.057713 25948 raft_consensus.cc:697] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:04.058794 25948 consensus_queue.cc:237] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.062342 25787 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.085433 25416 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
W20260709 12:28:04.101521 25458 consensus_peers.cc:597] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:04.114583 25911 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.115878 25787 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.116564 26011 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.117048 26011 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.117722 25695 tablet_bootstrap.cc:492] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:04.118064 25688 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:04.118220 25695 ts_tablet_manager.cc:1403] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.145s	user 0.011s	sys 0.019s
I20260709 12:28:04.118669 25688 ts_tablet_manager.cc:1403] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.023s
I20260709 12:28:04.118845 25315 catalog_manager.cc:5697] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.119884 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:04.121110 25695 raft_consensus.cc:359] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.124146 25911 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:04.137276 25695 raft_consensus.cc:385] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.121519 25688 raft_consensus.cc:359] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.139056 25688 raft_consensus.cc:385] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.139382 25688 raft_consensus.cc:740] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.131652 25952 consensus_queue.cc:1048] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:04.140048 25690 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:04.140039 25688 consensus_queue.cc:260] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.140722 25690 ts_tablet_manager.cc:1403] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.009s
I20260709 12:28:04.142354 25688 ts_tablet_manager.cc:1434] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:28:04.143530 25690 raft_consensus.cc:359] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.144215 25690 raft_consensus.cc:385] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.144641 25690 raft_consensus.cc:740] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.145527 25690 consensus_queue.cc:260] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.128221 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:04.147758 25690 ts_tablet_manager.cc:1434] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:28:04.147796 25642 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.148748 25690 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:04.131089 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:04.149610 25689 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
W20260709 12:28:04.127992 25460 leader_election.cc:343] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.150106 25689 ts_tablet_manager.cc:1403] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.004s
W20260709 12:28:04.151327 25460 leader_election.cc:343] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.152591 26011 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:04.154207 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:04.155067 25690 tablet_bootstrap.cc:654] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.155920 25689 raft_consensus.cc:359] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.156586 25689 raft_consensus.cc:385] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.138480 25695 raft_consensus.cc:740] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.157594 25689 raft_consensus.cc:740] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.159322 25695 consensus_queue.cc:260] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.162895 25641 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:04.166126 25688 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:04.175768 25689 consensus_queue.cc:260] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.174713 25459 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:04.186118 26011 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.186569 26011 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.186960 26011 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.193207 25695 ts_tablet_manager.cc:1434] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.006s
I20260709 12:28:04.194306 25695 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:04.194742 25419 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.196770 25689 ts_tablet_manager.cc:1434] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:28:04.180955 25688 tablet_bootstrap.cc:654] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.210070 25642 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:04.211980 25690 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:04.212541 25690 ts_tablet_manager.cc:1403] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.004s
I20260709 12:28:04.212850 25459 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:04.214341 25952 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.214835 25952 raft_consensus.cc:697] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:04.215581 25690 raft_consensus.cc:359] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.216814 25690 raft_consensus.cc:385] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.217208 25690 raft_consensus.cc:740] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.211612 25689 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:04.215670 25952 consensus_queue.cc:237] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.224797 26011 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.227752 26011 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:04.218225 25690 consensus_queue.cc:260] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.237807 25695 tablet_bootstrap.cc:654] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.238677 25911 consensus_queue.cc:1048] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.239574 25690 ts_tablet_manager.cc:1434] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:28:04.240625 25690 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:04.243016 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:04.243693 25640 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.245790 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:04.247613 25460 leader_election.cc:343] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.226572 25948 consensus_queue.cc:1048] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:28:04.261659 25640 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:04.293519 25690 tablet_bootstrap.cc:654] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.296708 25689 tablet_bootstrap.cc:654] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.315001 25459 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:04.321563 25952 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.325518 25952 raft_consensus.cc:697] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:04.326582 25952 consensus_queue.cc:237] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.330415 25926 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.331543 25695 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:04.331391 26003 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.332108 25695 ts_tablet_manager.cc:1403] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.035s
I20260709 12:28:04.363106 25689 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:04.364290 25689 ts_tablet_manager.cc:1403] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.013s
I20260709 12:28:04.368791 25976 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.379293 25976 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.351534 25314 catalog_manager.cc:5697] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.382203 25690 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:04.382731 25690 ts_tablet_manager.cc:1403] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.008s
I20260709 12:28:04.369834 25688 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:04.384291 25688 ts_tablet_manager.cc:1403] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.218s	user 0.035s	sys 0.014s
I20260709 12:28:04.384398 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:04.396797 25494 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:04.386934 25693 consensus_queue.cc:1048] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.390123 25695 raft_consensus.cc:359] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.387705 25689 raft_consensus.cc:359] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.398379 25695 raft_consensus.cc:385] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.398459 25689 raft_consensus.cc:385] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.398730 25695 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.405442 25386 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:04.407845 25976 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:04.398790 25689 raft_consensus.cc:740] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.408298 25695 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.415733 25689 consensus_queue.cc:260] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.417857 25695 ts_tablet_manager.cc:1434] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.000s
I20260709 12:28:04.413275 25911 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.414542 26032 raft_consensus.cc:2804] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.419220 26032 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.419596 26032 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.419876 25689 ts_tablet_manager.cc:1434] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:28:04.420961 25689 tablet_bootstrap.cc:492] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:04.422701 25690 raft_consensus.cc:359] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.427227 25690 raft_consensus.cc:385] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.427887 25690 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.428845 25690 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.432508 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:04.425406 25911 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.451347 25911 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:04.452432 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:04.453378 25640 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 0.
I20260709 12:28:04.453470 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:04.455005 25459 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:04.456319 25458 leader_election.cc:343] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.458961 26013 raft_consensus.cc:2804] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.459352 26013 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.459669 26013 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.466560 25695 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:04.468287 25787 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.468920 25787 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.470991 25690 ts_tablet_manager.cc:1434] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.000s
I20260709 12:28:04.474530 25690 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:04.486613 25690 tablet_bootstrap.cc:654] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.484944 25314 catalog_manager.cc:5697] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.501528 25926 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.502135 25926 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.504312 25926 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:04.505940 25787 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:04.508294 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:04.508989 25491 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:04.511026 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:04.514788 25535 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:04.512431 25608 leader_election.cc:343] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.516088 25787 raft_consensus.cc:2804] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.516635 25787 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.517043 25787 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.565588 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:04.570549 26032 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.572705 26032 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:04.573544 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:04.574218 25494 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.577000 25751 consensus_queue.cc:1048] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:04.577466 25532 leader_election.cc:343] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.587262 25688 raft_consensus.cc:359] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.587970 25688 raft_consensus.cc:385] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.588251 25688 raft_consensus.cc:740] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.589022 25688 consensus_queue.cc:260] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.591303 25688 ts_tablet_manager.cc:1434] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.191s	user 0.005s	sys 0.000s
I20260709 12:28:04.594077 25688 tablet_bootstrap.cc:492] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:04.596690 25494 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:04.600121 25386 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:04.604444 25787 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.594228 26032 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.595333 25562 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:04.603971 26055 raft_consensus.cc:2804] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.611105 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:04.612021 25494 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.612425 25690 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:04.612864 25690 ts_tablet_manager.cc:1403] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.141s	user 0.034s	sys 0.009s
I20260709 12:28:04.609658 25787 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:04.623178 25420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:04.623921 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:04.617700 26055 raft_consensus.cc:697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:04.611586 26032 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.628408 26055 consensus_queue.cc:237] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.634030 25494 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:04.635382 25535 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:04.636396 25787 raft_consensus.cc:2804] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.636940 25787 raft_consensus.cc:697] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:04.637944 25690 raft_consensus.cc:359] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.638975 25690 raft_consensus.cc:385] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.639395 25690 raft_consensus.cc:740] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.631547 26031 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.639362 25787 consensus_queue.cc:237] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:04.638574 25532 leader_election.cc:343] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:04.652824 25606 leader_election.cc:343] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.647445 26031 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:04.654074 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:04.654336 25606 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:04.656440 26003 raft_consensus.cc:2749] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.657735 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:04.659261 25458 leader_election.cc:343] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.659700 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:04.661505 25460 leader_election.cc:343] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.661966 25460 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:04.662618 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:04.663617 26011 raft_consensus.cc:2749] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.663864 25642 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:04.669083 25751 consensus_queue.cc:1048] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:04.670796 25689 tablet_bootstrap.cc:654] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.671468 25384 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:04.676312 25695 tablet_bootstrap.cc:654] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.651099 26032 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:04.679102 26032 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.679525 26032 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.679888 26032 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.656169 26031 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:04.700413 25689 tablet_bootstrap.cc:492] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:04.701020 25689 ts_tablet_manager.cc:1403] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.280s	user 0.007s	sys 0.009s
I20260709 12:28:04.704080 25689 raft_consensus.cc:359] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.704860 25689 raft_consensus.cc:385] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.711795 25689 raft_consensus.cc:740] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.717558 25689 consensus_queue.cc:260] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.725593 25690 consensus_queue.cc:260] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:04.736759 26053 log.cc:927] Time spent T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:28:04.737308 26052 log.cc:927] Time spent T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:28:04.742055 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:04.746680 25690 ts_tablet_manager.cc:1434] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.002s
I20260709 12:28:04.759855 25690 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:04.766932 25314 catalog_manager.cc:5697] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.717389 26013 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.783707 26013 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:04.785612 26030 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.785753 25415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:04.786324 26030 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:04.787563 25458 leader_election.cc:343] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.794759 26030 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:04.796572 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:04.797310 25640 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:04.799345 25385 leader_election.cc:343] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.800911 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:04.803154 25911 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.804608 25911 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.806213 25976 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.806756 25976 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.785157 25688 tablet_bootstrap.cc:654] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.814077 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:04.809775 25460 leader_election.cc:343] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:04.819584 25386 leader_election.cc:343] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.820556 25640 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:04.822453 25689 ts_tablet_manager.cc:1434] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.001s
I20260709 12:28:04.831930 25315 catalog_manager.cc:5697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.816956 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:04.809149 25976 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:04.792312 26032 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.846956 25689 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:04.848071 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:04.848199 25641 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:04.853034 25384 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
W20260709 12:28:04.860272 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 84186.7us
I20260709 12:28:04.863507 25881 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:04.875505 25460 consensus_peers.cc:597] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:04.877473 26032 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:04.879889 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:04.882234 25385 leader_election.cc:343] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.889319 25689 tablet_bootstrap.cc:654] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.874622 25881 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.897441 25690 tablet_bootstrap.cc:654] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.898512 25695 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:04.899297 25695 ts_tablet_manager.cc:1403] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.465s	user 0.021s	sys 0.047s
I20260709 12:28:04.901783 25688 tablet_bootstrap.cc:492] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:04.902312 25688 ts_tablet_manager.cc:1403] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.310s	user 0.015s	sys 0.039s
W20260709 12:28:04.902777 26063 log.cc:927] Time spent T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.143s	user 0.001s	sys 0.003s
I20260709 12:28:04.902668 25695 raft_consensus.cc:359] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.903581 25695 raft_consensus.cc:385] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.903874 25695 raft_consensus.cc:740] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.899021 25881 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.918068 25459 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:04.920040 25459 leader_election.cc:343] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.920817 25459 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:04.945623 25911 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.923326 26011 raft_consensus.cc:2804] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:04.926187 25460 consensus_peers.cc:597] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:04.930755 25688 raft_consensus.cc:359] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.948776 25688 raft_consensus.cc:385] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.949107 25688 raft_consensus.cc:740] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.950183 25688 consensus_queue.cc:260] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:04.950184 25695 consensus_queue.cc:260] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.953042 25688 ts_tablet_manager.cc:1434] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:28:04.948391 26011 raft_consensus.cc:697] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:04.958235 25695 ts_tablet_manager.cc:1434] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.001s
I20260709 12:28:04.958711 26011 consensus_queue.cc:237] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.960886 25688 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
W20260709 12:28:04.939775 26059 log.cc:927] Time spent T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:04.959357 25695 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:04.976722 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:04.977406 25643 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.984169 26066 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.955060 25881 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:04.984771 26066 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:04.987283 26066 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:04.987897 25688 tablet_bootstrap.cc:654] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.990151 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:04.991081 25690 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:04.991586 25690 ts_tablet_manager.cc:1403] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.232s	user 0.008s	sys 0.009s
W20260709 12:28:04.992193 25608 leader_election.cc:343] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:04.994460 25643 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
W20260709 12:28:04.987357 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 51368us
I20260709 12:28:05.004827 25690 raft_consensus.cc:359] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.012764 25690 raft_consensus.cc:385] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.013221 25690 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.017398 25384 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:05.018534 25690 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.025841 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:05.026860 25643 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.031618 25690 ts_tablet_manager.cc:1434] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:28:05.033684 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:05.035565 25386 leader_election.cc:343] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.036840 25689 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:05.025770 26055 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.039441 26055 raft_consensus.cc:697] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:05.040308 26055 consensus_queue.cc:237] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.043315 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:05.044355 25881 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:05.046871 25689 ts_tablet_manager.cc:1403] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.200s	user 0.030s	sys 0.029s
I20260709 12:28:05.056792 25690 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:05.060236 25643 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:05.061607 25384 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:05.071521 26032 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:05.076777 26032 raft_consensus.cc:697] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:05.077841 26032 consensus_queue.cc:237] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:05.083176 25606 leader_election.cc:343] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.083703 25606 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:05.085574 25926 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.105798 25695 tablet_bootstrap.cc:654] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.125869 25690 tablet_bootstrap.cc:654] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:05.144681 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:05.145450 26068 consensus_queue.cc:1048] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:28:05.148135 25689 raft_consensus.cc:359] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.150425 25689 raft_consensus.cc:385] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.150684 25689 raft_consensus.cc:740] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.151297 25689 consensus_queue.cc:260] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.153306 25689 ts_tablet_manager.cc:1434] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.001s
I20260709 12:28:05.166762 25688 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:05.167413 25688 ts_tablet_manager.cc:1403] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.207s	user 0.024s	sys 0.009s
I20260709 12:28:05.172431 25695 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:05.173004 25695 ts_tablet_manager.cc:1403] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.214s	user 0.009s	sys 0.010s
I20260709 12:28:05.184552 25695 raft_consensus.cc:359] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.186949 25695 raft_consensus.cc:385] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.189960 25419 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.187023 25315 catalog_manager.cc:5697] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:05.187440 25695 raft_consensus.cc:740] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.179750 25688 raft_consensus.cc:359] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.193871 25688 raft_consensus.cc:385] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.194411 25689 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:05.194177 25695 consensus_queue.cc:260] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.206918 25695 ts_tablet_manager.cc:1434] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:28:05.206702 25314 catalog_manager.cc:5697] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:05.208093 25695 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:05.210300 25693 consensus_queue.cc:1048] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.194310 25688 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.212072 25688 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.214183 25688 ts_tablet_manager.cc:1434] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 12:28:05.208467 25314 catalog_manager.cc:5697] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:05.241374 25722 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.242139 25722 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.243136 25688 tablet_bootstrap.cc:492] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:05.245559 25722 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:05.372018 25690 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:05.336537 26013 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.248133 25417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:05.410307 25690 ts_tablet_manager.cc:1403] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.354s	user 0.019s	sys 0.010s
I20260709 12:28:05.261257 25693 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.411229 25693 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:05.412000 25606 leader_election.cc:343] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:05.262310 25532 consensus_peers.cc:597] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:05.413566 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 151372us
I20260709 12:28:05.413471 25690 raft_consensus.cc:359] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:05.414248 25690 raft_consensus.cc:385] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.414520 25690 raft_consensus.cc:740] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.415180 25690 consensus_queue.cc:260] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:05.410392 26013 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.418193 26013 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:05.420738 25563 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.422103 25688 tablet_bootstrap.cc:654] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.422919 25690 ts_tablet_manager.cc:1434] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:28:05.423980 25690 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:05.391954 25689 tablet_bootstrap.cc:654] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.430063 25690 tablet_bootstrap.cc:654] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.435595 25695 tablet_bootstrap.cc:654] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.440483 25693 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:05.440775 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:05.252038 25562 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.471917 25642 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 1: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:05.472327 25415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:05.510088 25415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:05.502450 25695 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:05.513790 26055 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:28:05.514218 25695 ts_tablet_manager.cc:1403] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.306s	user 0.011s	sys 0.004s
I20260709 12:28:05.523629 25695 raft_consensus.cc:359] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.531208 25695 raft_consensus.cc:385] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.533011 25695 raft_consensus.cc:740] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.533187 25532 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:05.534819 25695 consensus_queue.cc:260] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.545511 25948 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.552754 25492 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.553802 26032 consensus_queue.cc:1048] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.533776 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:05.559306 25688 tablet_bootstrap.cc:492] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:05.559767 25688 ts_tablet_manager.cc:1403] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.317s	user 0.031s	sys 0.043s
I20260709 12:28:05.560354 25695 ts_tablet_manager.cc:1434] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:28:05.562446 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:05.563365 25642 raft_consensus.cc:2393] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 1: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:05.567566 25948 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:05.534121 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 108808us
I20260709 12:28:05.574153 25695 tablet_bootstrap.cc:492] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
I20260709 12:28:05.571398 26032 consensus_queue.cc:1048] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:28:05.579509 25609 leader_election.cc:343] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.579949 25609 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:05.581753 26066 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.596902 25459 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:05.605752 26013 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.583827 26032 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:28:05.611692 25690 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:05.612416 25690 ts_tablet_manager.cc:1403] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.189s	user 0.020s	sys 0.008s
I20260709 12:28:05.622401 25689 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:05.622936 25689 ts_tablet_manager.cc:1403] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.443s	user 0.030s	sys 0.023s
I20260709 12:28:05.626085 25689 raft_consensus.cc:359] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:05.626691 25689 raft_consensus.cc:385] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.626933 25689 raft_consensus.cc:740] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.627542 25689 consensus_queue.cc:260] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:05.637889 25689 ts_tablet_manager.cc:1434] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:28:05.639081 25689 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
I20260709 12:28:05.632364 25949 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:05.639910 25949 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:05.643647 25949 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:05.645608 25689 tablet_bootstrap.cc:654] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.648166 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:05.651892 25690 raft_consensus.cc:359] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.652877 25690 raft_consensus.cc:385] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.653707 25690 raft_consensus.cc:740] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.662567 25688 raft_consensus.cc:359] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:05.665642 25688 raft_consensus.cc:385] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.665930 25688 raft_consensus.cc:740] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.668972 25690 consensus_queue.cc:260] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.672163 25695 tablet_bootstrap.cc:654] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:05.676573 25458 consensus_peers.cc:597] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:05.675634 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:05.688441 25533 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:05.689770 26064 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:05.692972 25911 consensus_queue.cc:1048] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.708146 25688 consensus_queue.cc:260] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:05.711014 25688 ts_tablet_manager.cc:1434] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.151s	user 0.008s	sys 0.001s
I20260709 12:28:05.702353 26068 consensus_queue.cc:1048] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:28:05.718022 26086 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.718588 26086 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.723044 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:05.724705 25608 leader_election.cc:343] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.728823 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:05.730531 25606 leader_election.cc:343] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.730975 25606 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:05.741081 25690 ts_tablet_manager.cc:1434] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.128s	user 0.017s	sys 0.005s
I20260709 12:28:05.736294 26086 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:05.739308 26066 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.761567 25688 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:05.763152 25689 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:05.763572 25689 ts_tablet_manager.cc:1403] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.018s
I20260709 12:28:05.766266 25416 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:05.784336 25690 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:05.804563 25688 tablet_bootstrap.cc:654] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.807170 25695 tablet_bootstrap.cc:492] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:05.807700 25695 ts_tablet_manager.cc:1403] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.237s	user 0.009s	sys 0.005s
I20260709 12:28:05.822521 25695 raft_consensus.cc:359] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:05.823235 25695 raft_consensus.cc:385] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.823506 25695 raft_consensus.cc:740] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.824091 25695 consensus_queue.cc:260] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:05.836117 25911 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.836691 25911 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:05.840255 25695 ts_tablet_manager.cc:1434] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:28:05.840371 25689 raft_consensus.cc:359] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.841292 25689 raft_consensus.cc:385] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.847502 25689 raft_consensus.cc:740] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.852525 25690 tablet_bootstrap.cc:654] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.848206 25911 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:05.849627 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:05.849865 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:05.850201 25695 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Bootstrap starting.
W20260709 12:28:05.854671 25460 leader_election.cc:343] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.856827 25689 consensus_queue.cc:260] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.866672 25689 ts_tablet_manager.cc:1434] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260709 12:28:05.867954 25689 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361: Bootstrap starting.
W20260709 12:28:05.862988 25458 leader_election.cc:343] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:05.868662 25458 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:05.869444 25911 raft_consensus.cc:2749] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:05.870906 25695 tablet_bootstrap.cc:654] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.916694 25689 tablet_bootstrap.cc:654] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.924675 25695 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: No bootstrap required, opened a new log
I20260709 12:28:05.925237 25695 ts_tablet_manager.cc:1403] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.026s
I20260709 12:28:05.927965 25695 raft_consensus.cc:359] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.928503 25688 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:05.928659 25695 raft_consensus.cc:385] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.929039 25695 raft_consensus.cc:740] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.929097 25688 ts_tablet_manager.cc:1403] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.168s	user 0.008s	sys 0.004s
I20260709 12:28:05.929737 25695 consensus_queue.cc:260] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.932171 25695 ts_tablet_manager.cc:1434] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:05.931900 25688 raft_consensus.cc:359] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.932636 25688 raft_consensus.cc:385] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.932907 25688 raft_consensus.cc:740] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.934044 25688 consensus_queue.cc:260] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.936199 25688 ts_tablet_manager.cc:1434] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:05.938458 25688 tablet_bootstrap.cc:492] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:05.939321 25690 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:05.939829 25690 ts_tablet_manager.cc:1403] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.156s	user 0.008s	sys 0.017s
I20260709 12:28:05.942759 25690 raft_consensus.cc:359] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:05.943428 25690 raft_consensus.cc:385] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.943688 25690 raft_consensus.cc:740] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.944366 25690 consensus_queue.cc:260] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:05.946919 25690 ts_tablet_manager.cc:1434] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:28:05.954841 25690 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:05.954947 25688 tablet_bootstrap.cc:654] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.960304 25689 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361: No bootstrap required, opened a new log
I20260709 12:28:05.960907 25689 ts_tablet_manager.cc:1403] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.000s
I20260709 12:28:05.961457 25690 tablet_bootstrap.cc:654] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:05.963832 25689 raft_consensus.cc:359] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.969298 25689 raft_consensus.cc:385] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.972098 25689 raft_consensus.cc:740] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.972856 25689 consensus_queue.cc:260] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:05.975605 25690 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:05.976248 25690 ts_tablet_manager.cc:1403] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 12:28:05.976970 25689 ts_tablet_manager.cc:1434] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:28:05.978853 25690 raft_consensus.cc:359] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.979645 25690 raft_consensus.cc:385] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:05.979911 25690 raft_consensus.cc:740] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:05.988927 25690 consensus_queue.cc:260] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:05.991353 25690 ts_tablet_manager.cc:1434] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:28:05.992415 25690 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:06.002832 25690 tablet_bootstrap.cc:654] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.005342 25688 tablet_bootstrap.cc:492] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:06.008057 25688 ts_tablet_manager.cc:1403] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.006s
I20260709 12:28:06.010908 25688 raft_consensus.cc:359] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:06.011600 25688 raft_consensus.cc:385] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.011869 25688 raft_consensus.cc:740] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.012490 25688 consensus_queue.cc:260] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:06.013991 25688 ts_tablet_manager.cc:1434] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:06.025449 25568 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.043159 25948 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.043675 25948 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:06.045353 25688 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:06.046147 25690 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:06.046645 25690 ts_tablet_manager.cc:1403] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.003s
I20260709 12:28:06.049368 25690 raft_consensus.cc:359] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.050009 25690 raft_consensus.cc:385] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.050287 25690 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.050908 25690 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.051905 25688 tablet_bootstrap.cc:654] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.053033 25690 ts_tablet_manager.cc:1434] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:06.061859 25926 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.062816 25690 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:06.062428 25926 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:06.067991 25948 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:06.068193 26086 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.068753 26086 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.070828 26086 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:06.071625 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.072501 25493 raft_consensus.cc:2468] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:06.078925 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.079586 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:06.082506 25535 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:06.085634 25949 raft_consensus.cc:2804] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.086153 25949 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.086567 25949 raft_consensus.cc:3060] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.081804 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.087570 25491 raft_consensus.cc:2468] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:28:06.081406 26099 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.089299 25690 tablet_bootstrap.cc:654] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.089522 25926 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:06.089612 26099 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.079620 25492 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 0.
I20260709 12:28:06.093492 26099 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:06.093565 25606 leader_election.cc:343] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:06.090659 25609 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:06.095084 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:06.102725 25609 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:06.104357 25722 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.104797 25722 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.105195 25722 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.106142 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:06.106865 25641 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:06.097910 26086 raft_consensus.cc:2804] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.107698 26086 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.108070 26086 raft_consensus.cc:3060] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.101711 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:06.101428 26032 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.113989 26032 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.116001 25384 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:06.117098 26098 raft_consensus.cc:2804] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.117494 26098 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.117813 26098 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.118806 25722 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.120829 25722 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:06.121685 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.122268 26032 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:06.123267 25492 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:06.123207 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:06.125435 25385 leader_election.cc:343] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:06.126760 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:06.128355 25606 leader_election.cc:343] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:06.130502 25690 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:06.131011 25690 ts_tablet_manager.cc:1403] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.002s
I20260709 12:28:06.131738 25949 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:06.132905 25563 raft_consensus.cc:2393] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:06.133855 25690 raft_consensus.cc:359] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.134541 25690 raft_consensus.cc:385] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.134790 25690 raft_consensus.cc:740] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.135581 25690 consensus_queue.cc:260] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.138273 26086 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:06.139497 25642 raft_consensus.cc:2393] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 1: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:06.139837 25690 ts_tablet_manager.cc:1434] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:28:06.143641 26098 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.147312 26098 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:06.148576 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:06.149303 25491 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.149762 25688 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:06.150043 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:06.150283 25688 ts_tablet_manager.cc:1403] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.105s	user 0.027s	sys 0.007s
I20260709 12:28:06.150655 25492 raft_consensus.cc:3060] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.153064 25688 raft_consensus.cc:359] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.153820 25688 raft_consensus.cc:385] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.154093 25688 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.154597 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:06.155200 25495 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.155110 25688 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.157910 25688 ts_tablet_manager.cc:1434] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:06.158721 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:06.159504 25643 raft_consensus.cc:2393] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 1: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:06.141987 25949 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:06.160422 25949 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.160912 25949 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.161159 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:06.161844 25639 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:06.164222 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:06.164333 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:06.165017 25563 raft_consensus.cc:2393] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 1: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:06.164906 25419 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:06.165779 25949 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:06.166118 25532 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:06.167471 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:06.168129 25639 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.168071 25384 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:06.169703 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:06.170449 26099 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.170671 26086 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:06.170843 26099 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.171238 26099 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.171900 25491 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.173225 25688 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:06.176481 25495 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:06.177467 25386 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:06.178295 26068 raft_consensus.cc:2804] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.178781 26068 raft_consensus.cc:697] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:06.181143 25609 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:06.179664 26068 consensus_queue.cc:237] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.183382 26066 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:06.184957 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:06.185593 25641 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 0.
I20260709 12:28:06.186051 25492 raft_consensus.cc:2468] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:06.189803 26032 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.193104 25949 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.193943 25949 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.193782 26032 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.196525 26032 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:06.196533 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.194341 25949 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.197063 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:06.197769 25690 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:06.198522 25609 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:06.198800 25385 leader_election.cc:343] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:06.197432 25494 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:06.199793 26066 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.200278 26066 raft_consensus.cc:697] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:06.200372 25386 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:06.201508 26032 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.201969 26032 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.202370 26032 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.201119 26066 consensus_queue.cc:237] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.220525 25535 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:06.222417 25948 raft_consensus.cc:2804] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.222992 25948 raft_consensus.cc:697] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:06.223855 25948 consensus_queue.cc:237] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:06.225600 25690 tablet_bootstrap.cc:654] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.229491 25639 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.241932 25688 tablet_bootstrap.cc:654] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.238570 26099 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.256340 26099 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:06.262789 25315 catalog_manager.cc:5697] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.269480 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:06.270171 25563 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.272610 25690 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:06.276580 25690 ts_tablet_manager.cc:1403] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.004s
I20260709 12:28:06.252409 26032 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.279803 25690 raft_consensus.cc:359] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.280580 25690 raft_consensus.cc:385] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.280905 25690 raft_consensus.cc:740] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.281780 25690 consensus_queue.cc:260] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.264343 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:06.285581 25641 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.286512 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:06.287344 25495 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:06.276013 25365 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:06.259603 25949 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.301934 25690 ts_tablet_manager.cc:1434] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.004s
I20260709 12:28:06.303092 25690 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:06.306787 25314 catalog_manager.cc:5697] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 1 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.310850 25949 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:06.312557 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:06.315795 25495 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.317826 25386 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:06.318641 26068 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.319154 26068 raft_consensus.cc:697] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:06.320320 25416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:06.320036 26068 consensus_queue.cc:237] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.320955 25416 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.327308 25642 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.343138 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:06.344954 25385 leader_election.cc:343] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:06.339777 26032 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:06.351776 25313 catalog_manager.cc:5697] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.356501 25690 tablet_bootstrap.cc:654] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.357662 25642 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:06.359673 25533 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:06.360499 25948 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.361085 25948 raft_consensus.cc:697] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:06.361989 25948 consensus_queue.cc:237] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.371934 25688 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:06.371928 25416 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:06.372645 25688 ts_tablet_manager.cc:1403] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.200s	user 0.022s	sys 0.034s
I20260709 12:28:06.374799 25641 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.375526 25688 raft_consensus.cc:359] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.378523 25688 raft_consensus.cc:385] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.384886 25384 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:06.385756 26068 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.386634 26068 raft_consensus.cc:697] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:06.387740 26068 consensus_queue.cc:237] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.378868 25688 raft_consensus.cc:740] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.390745 25688 consensus_queue.cc:260] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.394050 25688 ts_tablet_manager.cc:1434] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:28:06.397146 25563 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.397883 25688 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:06.418284 25688 tablet_bootstrap.cc:654] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.425913 25690 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:06.426462 25690 ts_tablet_manager.cc:1403] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.019s
I20260709 12:28:06.430135 25314 catalog_manager.cc:5697] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.431377 25690 raft_consensus.cc:359] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.434302 25690 raft_consensus.cc:385] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.434582 25690 raft_consensus.cc:740] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.435258 25690 consensus_queue.cc:260] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.438163 25690 ts_tablet_manager.cc:1434] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:28:06.439229 25690 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:06.440510 26068 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.441051 26068 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.444866 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.445598 25495 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:06.443933 26068 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:06.446841 25386 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:06.449404 26099 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.454947 25688 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:06.455554 25688 ts_tablet_manager.cc:1403] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.005s
I20260709 12:28:06.453645 26099 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.458770 26099 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.462489 25690 tablet_bootstrap.cc:654] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.467156 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:06.469468 25385 leader_election.cc:343] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:06.474794 26099 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.479226 25688 raft_consensus.cc:359] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.479974 25688 raft_consensus.cc:385] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.480753 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:06.483891 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:06.484673 25492 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.491000 25688 raft_consensus.cc:740] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.495822 25688 consensus_queue.cc:260] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.497134 25563 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.502686 25492 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.481667 26099 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:06.478670 25315 catalog_manager.cc:5697] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.504369 25563 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.505787 25690 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: No bootstrap required, opened a new log
I20260709 12:28:06.506263 25690 ts_tablet_manager.cc:1403] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.013s
I20260709 12:28:06.505578 25315 catalog_manager.cc:5697] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:06.504189 25386 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:06.509317 25690 raft_consensus.cc:359] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.509977 25690 raft_consensus.cc:385] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.510174 26068 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.510761 26068 raft_consensus.cc:697] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:06.511700 26068 consensus_queue.cc:237] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.518946 25688 ts_tablet_manager.cc:1434] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 12:28:06.534159 25688 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659: Bootstrap starting.
I20260709 12:28:06.510231 25690 raft_consensus.cc:740] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.533617 25315 catalog_manager.cc:5697] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:06.535228 25690 consensus_queue.cc:260] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.542510 25688 tablet_bootstrap.cc:654] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:06.543206 25690 ts_tablet_manager.cc:1434] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:28:06.551581 25688 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659: No bootstrap required, opened a new log
I20260709 12:28:06.552102 25688 ts_tablet_manager.cc:1403] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 12:28:06.555905 25688 raft_consensus.cc:359] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.556615 25688 raft_consensus.cc:385] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:06.557876 25688 raft_consensus.cc:740] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Initialized, Role: FOLLOWER
I20260709 12:28:06.558941 25688 consensus_queue.cc:260] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.569420 26099 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.569957 26099 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:06.572227 26099 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:06.573964 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:06.573976 25688 ts_tablet_manager.cc:1434] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:28:06.576550 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.578231 25386 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:06.579586 26068 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:06.613845 26099 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.614467 26099 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.616912 26099 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:06.619323 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:06.620095 25639 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:06.621526 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:06.622689 25563 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 0.
I20260709 12:28:06.624863 25385 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:06.626080 26066 consensus_queue.cc:1048] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:06.626909 26099 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:06.627461 26099 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.627841 26099 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.638244 26099 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.640512 26099 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:06.641729 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:06.642544 25563 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.643816 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:06.644519 25639 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.652683 25639 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.653900 25384 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:06.655494 26068 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:06.656042 26068 raft_consensus.cc:697] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:06.656950 26068 consensus_queue.cc:237] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:06.659930 26098 consensus_queue.cc:1048] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:06.667819 25563 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:06.673005 25419 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.682629 25315 catalog_manager.cc:5697] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:06.715469 26073 consensus_queue.cc:1048] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:06.717355 26032 consensus_queue.cc:1048] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:06.730742 25416 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.736380 26064 consensus_queue.cc:1048] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:06.783794 26064 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.784377 26064 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:06.789427 26064 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:06.790259 25419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:06.791496 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:06.794281 25495 raft_consensus.cc:2393] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 1: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:06.797878 25535 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:06.799384 26064 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:06.809620 26064 raft_consensus.cc:2749] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:06.840821 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 51450.6us
W20260709 12:28:06.864743 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 74970us
I20260709 12:28:06.867991 26032 consensus_queue.cc:1048] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:06.869622 26086 consensus_queue.cc:1048] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:06.902746 26032 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:06.914424 26032 consensus_queue.cc:1048] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:06.915935 26064 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:06.934062 26032 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:06.977118 25949 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:07.055336 26032 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:07.059857 26032 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:07.232004 26032 consensus_queue.cc:1048] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:07.244596 26099 consensus_queue.cc:1048] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:08.461112 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
W20260709 12:28:08.488745 25606 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:28:08.496218 25606 consensus_peers.cc:597] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.530596 25532 consensus_peers.cc:597] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.534652 25532 consensus_peers.cc:597] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.540625 25458 consensus_peers.cc:597] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.543586 25606 consensus_peers.cc:597] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.545238 25532 consensus_peers.cc:597] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.550824 25532 consensus_peers.cc:597] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.553622 25458 consensus_peers.cc:597] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.554610 25606 consensus_peers.cc:597] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.558096 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:08.559048 20873 tablet_replica.cc:333] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.560030 20873 raft_consensus.cc:2243] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.561061 20873 raft_consensus.cc:2272] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.563665 20873 tablet_replica.cc:333] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.564637 20873 raft_consensus.cc:2243] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.565268 20873 raft_consensus.cc:2272] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.569121 20873 tablet_replica.cc:333] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.570001 20873 raft_consensus.cc:2243] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.571050 20873 raft_consensus.cc:2272] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.573863 20873 tablet_replica.cc:333] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.576009 20873 raft_consensus.cc:2243] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.576637 20873 raft_consensus.cc:2272] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.580643 20873 tablet_replica.cc:333] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
W20260709 12:28:08.580971 25458 consensus_peers.cc:597] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.581666 20873 raft_consensus.cc:2243] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.582634 20873 raft_consensus.cc:2272] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:08.584224 25458 consensus_peers.cc:597] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.585238 20873 tablet_replica.cc:333] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.586236 20873 raft_consensus.cc:2243] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.586841 20873 raft_consensus.cc:2272] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:08.591028 25532 consensus_peers.cc:597] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.593421 20873 tablet_replica.cc:333] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.594430 20873 raft_consensus.cc:2243] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.595472 20873 raft_consensus.cc:2272] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.598132 20873 tablet_replica.cc:333] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.598985 20873 raft_consensus.cc:2243] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.600003 20873 raft_consensus.cc:2272] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.602386 20873 tablet_replica.cc:333] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.603252 20873 raft_consensus.cc:2243] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.603788 20873 raft_consensus.cc:2272] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.606218 20873 tablet_replica.cc:333] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.607077 20873 raft_consensus.cc:2243] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.607628 20873 raft_consensus.cc:2272] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.610028 20873 tablet_replica.cc:333] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.610855 20873 raft_consensus.cc:2243] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.611403 20873 raft_consensus.cc:2272] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:08.612373 25458 consensus_peers.cc:597] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.613818 20873 tablet_replica.cc:333] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.614785 20873 raft_consensus.cc:2243] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.615357 20873 raft_consensus.cc:2272] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.617682 20873 tablet_replica.cc:333] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.618425 20873 raft_consensus.cc:2243] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.618889 20873 raft_consensus.cc:2272] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.621061 20873 tablet_replica.cc:333] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.621876 20873 raft_consensus.cc:2243] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.622344 20873 raft_consensus.cc:2272] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.624506 20873 tablet_replica.cc:333] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.625274 20873 raft_consensus.cc:2243] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.625778 20873 raft_consensus.cc:2272] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.628067 20873 tablet_replica.cc:333] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.628885 20873 raft_consensus.cc:2243] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.629431 20873 raft_consensus.cc:2272] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.631402 20873 tablet_replica.cc:333] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.632037 20873 raft_consensus.cc:2243] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.632472 20873 raft_consensus.cc:2272] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.634366 20873 tablet_replica.cc:333] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.634887 20873 raft_consensus.cc:2243] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.635710 20873 raft_consensus.cc:2272] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.637661 20873 tablet_replica.cc:333] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.638237 20873 raft_consensus.cc:2243] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.638679 20873 raft_consensus.cc:2272] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.640560 20873 tablet_replica.cc:333] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.641086 20873 raft_consensus.cc:2243] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.641507 20873 raft_consensus.cc:2272] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.643378 20873 tablet_replica.cc:333] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.643913 20873 raft_consensus.cc:2243] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.644632 20873 raft_consensus.cc:2272] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.646361 20873 tablet_replica.cc:333] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.646908 20873 raft_consensus.cc:2243] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.647313 20873 raft_consensus.cc:2272] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.648944 20873 tablet_replica.cc:333] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.649613 20873 raft_consensus.cc:2243] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.650022 20873 raft_consensus.cc:2272] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.652133 20873 tablet_replica.cc:333] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.652912 20873 raft_consensus.cc:2243] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.653970 20873 raft_consensus.cc:2272] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.656356 20873 tablet_replica.cc:333] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.656891 20873 raft_consensus.cc:2243] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.657362 20873 raft_consensus.cc:2272] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.659308 20873 tablet_replica.cc:333] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.660071 20873 raft_consensus.cc:2243] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.660647 20873 raft_consensus.cc:2272] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.662930 20873 tablet_replica.cc:333] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.663632 20873 raft_consensus.cc:2243] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.664111 20873 raft_consensus.cc:2272] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.665832 20873 tablet_replica.cc:333] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.666399 20873 raft_consensus.cc:2243] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.666818 20873 raft_consensus.cc:2272] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.669085 20873 tablet_replica.cc:333] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.669665 20873 raft_consensus.cc:2243] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.670102 20873 raft_consensus.cc:2272] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.672226 20873 tablet_replica.cc:333] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.672948 20873 raft_consensus.cc:2243] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.673491 20873 raft_consensus.cc:2272] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.675819 20873 tablet_replica.cc:333] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.676540 20873 raft_consensus.cc:2243] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:08.677295 25532 consensus_peers.cc:597] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.677668 20873 raft_consensus.cc:2272] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.679586 20873 tablet_replica.cc:333] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.680126 20873 raft_consensus.cc:2243] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.680904 20873 raft_consensus.cc:2272] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.683028 20873 tablet_replica.cc:333] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.683599 20873 raft_consensus.cc:2243] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.684386 20873 raft_consensus.cc:2272] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.686237 20873 tablet_replica.cc:333] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.686810 20873 raft_consensus.cc:2243] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.687613 20873 raft_consensus.cc:2272] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.689718 20873 tablet_replica.cc:333] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.690268 20873 raft_consensus.cc:2243] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.690706 20873 raft_consensus.cc:2272] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.692703 20873 tablet_replica.cc:333] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.693284 20873 raft_consensus.cc:2243] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.693697 20873 raft_consensus.cc:2272] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.695500 20873 tablet_replica.cc:333] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.696003 20873 raft_consensus.cc:2243] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.696444 20873 raft_consensus.cc:2272] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.698616 20873 tablet_replica.cc:333] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.699306 20873 raft_consensus.cc:2243] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.699811 20873 raft_consensus.cc:2272] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.702266 20873 tablet_replica.cc:333] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
W20260709 12:28:08.702426 25532 consensus_peers.cc:597] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.702966 20873 raft_consensus.cc:2243] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.703449 20873 raft_consensus.cc:2272] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.705396 20873 tablet_replica.cc:333] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.705909 20873 raft_consensus.cc:2243] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.706328 20873 raft_consensus.cc:2272] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.708298 20873 tablet_replica.cc:333] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.708829 20873 raft_consensus.cc:2243] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.709309 20873 raft_consensus.cc:2272] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.711385 20873 tablet_replica.cc:333] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.711969 20873 raft_consensus.cc:2243] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.712508 20873 raft_consensus.cc:2272] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.714569 20873 tablet_replica.cc:333] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.715279 20873 raft_consensus.cc:2243] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.716343 20873 raft_consensus.cc:2272] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.718637 20873 tablet_replica.cc:333] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.719328 20873 raft_consensus.cc:2243] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:08.719837 20873 raft_consensus.cc:2272] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.722172 20873 tablet_replica.cc:333] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: stopping tablet replica
I20260709 12:28:08.722792 20873 raft_consensus.cc:2243] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.723855 20873 raft_consensus.cc:2272] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:08.727950 25458 consensus_peers.cc:597] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.737525 25532 consensus_peers.cc:597] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.753002 25458 consensus_peers.cc:597] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.765314 25532 consensus_peers.cc:597] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.778447 25606 consensus_peers.cc:597] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.799772 25458 consensus_peers.cc:597] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.804982 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
W20260709 12:28:08.855307 25532 consensus_peers.cc:597] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.881114 25606 consensus_peers.cc:597] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.882009 25606 consensus_peers.cc:597] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.898885 25532 consensus_peers.cc:597] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.907954 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:08.916344 26170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:08.917658 26171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:08.925985 26173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:08.926303 20873 server_base.cc:1061] running on GCE node
I20260709 12:28:08.929819 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:08.930182 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:08.930447 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600088930430 us; error 0 us; skew 500 ppm
I20260709 12:28:08.931532 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:28:08.932789 25458 consensus_peers.cc:597] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.936622 25532 consensus_peers.cc:597] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.943325 25532 consensus_peers.cc:597] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.944880 20873 webserver.cc:533] Webserver started at http://127.20.98.65:39189/ using document root <none> and password file <none>
I20260709 12:28:08.945744 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:08.946249 20873 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:28:08.951953 20873 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:08.964051 26178 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:08.965245 20873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:28:08.966074 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "3e2fd10beaf04318be94c0a3430cef3e"
format_stamp: "Formatted at 2026-07-09 12:27:55 on dist-test-slave-g3x6"
I20260709 12:28:08.966676 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:28:08.976346 25532 consensus_peers.cc:597] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:08.988499 25458 consensus_peers.cc:597] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.999264 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:09.001246 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 12:28:09.023480 25458 consensus_peers.cc:597] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:09.046173 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:09.884678 26185 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:28:09.907560 26186 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:09.909912 26186 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:09.912882 26186 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:09.927578 26186 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:09.928167 26186 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:09.931416 26186 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:09.963848 26193 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:09.978986 26191 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:09.979691 26191 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:09.974624 26193 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.010577 26194 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.011471 26194 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.014729 26194 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:10.030102 25532 leader_election.cc:336] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.036438 25532 leader_election.cc:336] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.037580 26189 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:09.986096 26196 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.018014 26188 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.038211 26189 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.043016 26189 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.038343 26191 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.046372 26193 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.049254 26196 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.039594 26200 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.053930 26200 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:10.055150 25532 leader_election.cc:336] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.055792 25532 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.052826 26196 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.062633 26188 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:10.065706 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 44614.6us
I20260709 12:28:10.065498 26193 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.066762 26194 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.067742 26186 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.080057 26198 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.217350 26206 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.289669 26206 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.292698 26206 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.219767 26201 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.117707 26200 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.332755 26212 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.333516 26212 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.336208 26212 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.294234 26197 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.336992 26197 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.315243 26210 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.085390 26194 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.339671 26188 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.340093 26210 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.342579 26210 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.094251 26186 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.345050 26186 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.084008 26193 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.319181 26209 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.345770 26209 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.346933 26193 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.347958 26209 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.332705 26201 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.278993 26198 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.350057 26194 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.350104 26201 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.350382 26198 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.306175 26196 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.316227 26187 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.309774 26203 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.348407 26193 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.393503 26202 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.394238 26202 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.392993 26193 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.398192 26193 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.339753 26197 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.351806 26198 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.382733 26200 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.387665 26212 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.387324 26196 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.397049 26202 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.443918 26197 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.500751 26215 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.501096 26214 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.501246 26218 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.501572 26190 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.501524 26215 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.502197 26218 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.502794 26216 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.503377 26216 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.504304 26215 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.504921 26218 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.390395 26187 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.505738 26216 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.505621 26214 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.507150 26210 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.507295 26187 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.507769 26210 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.508059 26214 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.502306 26190 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.473878 26198 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.478811 26212 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.478473 26200 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.504884 26215 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.553501 26186 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.560297 26198 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.392221 26203 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.561640 26207 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.562265 26207 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.563066 26203 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.507162 26216 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.564165 26216 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.571146 26202 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.563560 26219 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.571817 26202 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.572260 26219 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.560563 26186 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:10.584079 25532 leader_election.cc:336] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.587975 25606 leader_election.cc:336] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.590040 26186 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.496002 26197 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.555575 26218 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.613889 26218 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.615213 26197 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.616307 26218 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.593120 26219 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:10.597769 25606 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.617512 25606 leader_election.cc:336] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.599273 26216 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.599321 26223 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.600683 26196 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.601307 26194 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.601763 26206 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.602553 26212 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.602602 26221 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.571729 26215 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.603374 26193 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.603731 26209 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.604094 26190 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.604171 26201 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.604779 26188 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.606640 26200 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.693277 26196 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.564759 26207 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.598493 26202 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:10.618360 25606 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.617826 26208 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.690573 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.713764 25562 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
W20260709 12:28:10.714444 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 96071.4us
I20260709 12:28:10.701771 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.688582 26216 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.690537 26197 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.688612 26227 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.607806 26210 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.720327 26227 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.707211 26212 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.721544 26212 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.722661 26227 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.723160 26227 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.723677 26212 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.723599 26227 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.713279 26202 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.724665 26202 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.715188 26207 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.725622 26207 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.725962 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.726660 25566 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:10.698282 26187 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.727183 26202 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.727823 26207 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.727620 26187 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.705651 26209 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.729475 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.730052 26187 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.730155 25564 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:10.704105 26193 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.730880 26209 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.732237 26193 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.732435 26209 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.711736 26188 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.696261 26206 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.700837 26221 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.709012 26211 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:10.715644 25606 leader_election.cc:336] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.693856 26223 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.719528 26229 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.711872 26200 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.693223 26194 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.720623 26215 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:10.741032 25532 leader_election.cc:336] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.795162 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 53739.7us
W20260709 12:28:10.795855 25532 leader_election.cc:336] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.796437 25532 leader_election.cc:336] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.797036 25532 leader_election.cc:336] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.783432 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 67804.6us
I20260709 12:28:10.739606 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.735864 26190 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.709247 26201 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:10.801770 25532 leader_election.cc:336] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.720680 26233 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.802582 26215 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.793959 26229 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.807320 26194 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.805428 26227 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.805447 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.807844 26223 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.735808 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.711944 26196 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.739559 26216 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.733294 26197 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.793696 26200 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.733098 26209 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.718045 26208 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.845141 26193 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.788370 26211 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:10.856232 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 157390us
I20260709 12:28:10.857470 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.858124 25562 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:10.859167 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.859660 26188 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.860236 26197 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.831226 26190 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.861459 26216 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.862239 26221 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.862324 26190 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.863662 26209 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.861475 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.866894 26201 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.867092 26200 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.868881 26196 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.869925 26234 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.870479 26234 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.871093 26211 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.853770 25565 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:10.872661 26234 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.874445 26234 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.874897 26234 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.877030 26234 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:10.877516 25532 leader_election.cc:336] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.877862 26232 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
W20260709 12:28:10.878309 25532 leader_election.cc:336] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.878525 26229 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.878436 26232 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.843894 26233 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.880836 26232 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.881057 26233 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.881364 26232 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.881639 26193 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.881841 26232 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.883667 26193 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:10.883455 25532 leader_election.cc:336] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.884670 25532 leader_election.cc:336] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.885048 26208 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.885692 26206 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:10.886772 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.887365 25563 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:10.846088 26215 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.888988 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.889609 25565 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:10.890673 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.890671 26215 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.892380 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.894147 25639 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.892863 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.895351 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.895617 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.895978 25639 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.896221 25640 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.895563 25642 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.883667 26232 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.899384 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.899677 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:10.905407 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 47892.4us
I20260709 12:28:10.900120 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.906560 25641 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.900365 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:10.892007 25532 leader_election.cc:336] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:10.908141 25532 leader_election.cc:336] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.911355 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.912431 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.912701 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.913117 25643 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.914095 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.914005 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.914810 25642 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.915784 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.915908 26232 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.915822 26236 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:10.916561 25641 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.916944 26236 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.919430 26239 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:10.920719 26236 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.922464 25533 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:10.920011 26239 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.923580 25533 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:10.925438 26239 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.926291 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.926918 25493 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.927014 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.927736 25563 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:10.884140 25608 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:10.903788 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 46805.9us
I20260709 12:28:10.901127 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.933202 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:10.934664 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 50937.1us
I20260709 12:28:10.936337 25608 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:10.905114 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:10.938573 26215 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.938966 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.939181 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.939627 25493 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.940403 26211 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.934237 25639 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.940856 26211 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.941553 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.942219 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.941519 26211 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.943048 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.943539 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.944926 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.944182 25490 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.946379 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.947209 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.938977 26215 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.949370 26215 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.949481 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.950188 25490 raft_consensus.cc:2468] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
W20260709 12:28:10.951041 25606 leader_election.cc:336] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.941574 26190 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.951620 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.952116 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.952833 25494 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.953351 26200 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.953507 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.949034 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.953964 26200 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.953994 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.952075 26190 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.942340 25568 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:10.954840 25492 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.955034 26190 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.940909 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.955794 25565 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:10.956012 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.942792 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.957580 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.958262 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.958909 25493 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.958954 25533 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:10.951691 25606 leader_election.cc:336] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:10.960397 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:10.916693 26232 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:10.962966 26232 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:10.943073 25491 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:10.968108 26237 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.968554 26237 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.969625 26237 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.972210 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.969220 25608 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:10.973551 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.975181 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.978844 26188 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.979303 26188 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.979698 26188 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.979864 26208 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.980309 26208 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:10.980657 26208 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.954530 26200 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.983640 26231 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.984144 26231 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.986562 26231 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.987054 26231 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.987478 26231 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.987694 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:10.989012 26208 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:10.989985 26203 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:10.992030 26203 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:10.994165 26203 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:10.995668 26231 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:10.994812 26215 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.001324 26215 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.002110 25533 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:11.002858 25606 leader_election.cc:336] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.002895 26222 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:11.003465 25606 leader_election.cc:336] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.003927 25533 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:28:11.004154 25606 leader_election.cc:336] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.004551 25606 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.004714 26222 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:10.990516 26237 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:10.991093 25535 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.005267 26222 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:11.006147 25606 leader_election.cc:336] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.008042 26222 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:11.008194 25606 leader_election.cc:336] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.008736 25606 leader_election.cc:336] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.009217 25606 leader_election.cc:336] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.009756 25606 leader_election.cc:336] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.010598 25535 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.009254 26186 raft_consensus.cc:2804] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.011368 26186 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.011765 26186 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.011979 26185 ts_tablet_manager.cc:548] Loading tablet metadata (11/45 complete)
I20260709 12:28:11.013785 26212 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.014933 25535 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.015187 26190 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.015668 26210 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.016127 26210 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.016490 26210 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.017604 26190 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.018908 25535 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.019732 26190 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.006160 25533 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.006408 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:10.996060 26208 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:11.020098 25535 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.020098 26190 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
W20260709 12:28:11.023022 25458 leader_election.cc:336] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.023567 25458 leader_election.cc:336] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.024324 25458 leader_election.cc:336] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.024406 26210 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:11.025288 26212 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.025445 26208 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.025602 25608 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.026038 26208 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.026463 26208 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.027923 26210 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:11.028113 26206 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.028990 25608 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.027948 26222 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.029767 26206 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.029646 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.031313 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.031884 25494 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:11.032279 26222 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.032065 26188 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.033131 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.033438 26208 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.033756 25494 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:11.034113 25533 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:11.034858 26210 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.026429 25535 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.021157 26190 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.034714 26188 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:11.036257 25606 leader_election.cc:336] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.035056 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.030128 25608 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.040459 26211 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.041090 26206 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.043037 26237 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.044862 25608 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:11.035447 26222 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.045714 26222 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:11.046094 26222 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.049237 26215 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.049554 26208 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.035023 25533 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.018730 26200 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.050676 26212 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.053625 25535 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.054067 26206 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.054445 26206 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:11.054661 26188 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.054824 26206 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.055451 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.056023 26186 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:11.051172 25533 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:11.057729 25533 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:11.058029 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.058542 25535 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.058655 25491 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:11.059303 26212 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.059710 26212 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:11.060078 26212 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.060382 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.052157 26200 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.050228 26210 raft_consensus.cc:2804] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.061573 26210 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:11.062019 26210 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.062609 26206 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.064653 26206 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:11.065507 25608 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.066258 26208 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.066537 25608 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:11.066721 26208 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.067472 26208 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.068090 26188 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.068536 26188 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:11.067292 26212 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.067318 26215 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.070314 26211 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.070737 26215 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:11.071208 26215 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.072718 25637 raft_consensus.cc:1240] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.073249 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.073853 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.074584 25641 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:11.075515 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.076225 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.076661 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.077764 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.078303 25642 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:11.078441 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.078553 26215 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.079246 25638 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:11.079623 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.080403 26240 consensus_queue.cc:1059] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.080852 25643 raft_consensus.cc:1240] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.081215 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.081444 26240 raft_consensus.cc:3055] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.081799 26240 raft_consensus.cc:740] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:11.081861 26212 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.083007 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.082679 26240 consensus_queue.cc:260] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.083329 25639 raft_consensus.cc:1240] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.083678 25637 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:11.084035 26240 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.084800 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:11.085695 25532 leader_election.cc:336] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.081951 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:11.086236 25532 leader_election.cc:336] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.086704 25532 leader_election.cc:336] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.079174 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:11.087385 25642 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:11.087775 26208 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:11.024933 25458 leader_election.cc:336] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.088891 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 63983.8us
W20260709 12:28:11.091368 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 52890.9us
I20260709 12:28:11.091741 26215 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:11.093482 26208 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:11.095801 25606 leader_election.cc:336] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.097482 25458 leader_election.cc:336] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.068905 26188 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.099987 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.101331 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.101429 26212 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.101541 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.102038 26212 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.099638 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.099570 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.102443 26212 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:11.103401 25458 leader_election.cc:336] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.103945 25458 leader_election.cc:336] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.104388 25458 leader_election.cc:336] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.104823 25458 leader_election.cc:336] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.106600 25459 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.107640 26236 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.108018 26236 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.108355 26236 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.111327 26212 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:11.113435 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 54971.4us
I20260709 12:28:11.068926 26210 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.114133 25535 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.114912 26211 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.115269 26211 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:11.115629 26211 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.116465 25535 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.116359 26236 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.117274 26200 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.117723 26200 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.118145 26200 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:11.125366 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 67717.8us
I20260709 12:28:11.125977 25459 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.127143 26239 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.127753 25533 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.128510 26187 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.128530 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.129017 26187 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.129482 26187 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.129685 26236 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.130589 25459 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.131338 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.131685 25459 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.132172 25494 raft_consensus.cc:2393] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:11.132452 26239 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.132872 26239 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.133270 26239 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.133841 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.135345 26210 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.136757 26187 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.143038 26222 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.144169 26231 raft_consensus.cc:2804] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.144588 26231 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.138366 26186 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:11.145676 26187 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.147977 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.148622 25490 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:11.140084 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.149425 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.140815 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.141415 26212 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:11.125006 26200 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:11.152415 25532 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.142319 26239 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.144981 26231 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.155928 26240 consensus_queue.cc:1059] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.156328 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.156927 26240 raft_consensus.cc:3055] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.146449 26203 consensus_queue.cc:1059] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.146868 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.157732 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.158175 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.157917 26203 raft_consensus.cc:3055] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.157660 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.159143 26203 raft_consensus.cc:740] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:11.159248 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.159844 25640 raft_consensus.cc:2393] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:11.160167 25637 raft_consensus.cc:2393] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:11.160109 26203 consensus_queue.cc:260] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.161185 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.161482 26203 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.161895 25640 raft_consensus.cc:2393] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:11.156869 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.164611 25639 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.167691 26188 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.140607 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:11.157792 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.158687 25642 raft_consensus.cc:2393] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:11.169682 25634 raft_consensus.cc:2393] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:11.157142 25641 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:11.170032 26190 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.171936 25459 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.169694 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.173102 25637 raft_consensus.cc:2393] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
W20260709 12:28:11.173655 25606 leader_election.cc:336] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.174177 25606 leader_election.cc:336] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.174364 26240 raft_consensus.cc:740] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
W20260709 12:28:11.174664 25606 leader_election.cc:336] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.175118 25606 leader_election.cc:336] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.175204 26240 consensus_queue.cc:260] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.175760 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.176333 26240 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.176537 25637 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:11.177114 25606 leader_election.cc:336] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.177657 25606 leader_election.cc:336] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.178107 25606 leader_election.cc:336] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.175971 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 59589.7us
I20260709 12:28:11.179152 25535 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.138554 26211 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.181206 26211 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.145072 26222 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.181669 25459 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.182439 26232 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.182802 26232 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.183175 26232 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.184561 26231 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.185735 26186 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.186614 25639 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
W20260709 12:28:11.146178 25458 leader_election.cc:336] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.187879 25458 leader_election.cc:336] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.190572 26232 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.192623 26232 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.193984 25459 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.194762 26233 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.195135 26233 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.195493 26239 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.195631 26233 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.197053 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.198311 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.198911 25634 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.201576 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.202154 25642 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.202162 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.203086 26211 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.206387 25634 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:11.207650 25459 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.209757 26203 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.210304 26203 raft_consensus.cc:697] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:11.211615 26203 consensus_queue.cc:237] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.212705 25642 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:11.172051 26190 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.213903 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.214017 25459 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.195055 25535 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.214880 26236 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.215595 26236 raft_consensus.cc:697] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:11.215864 26186 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.216267 26186 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:11.216661 26186 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.216482 26236 consensus_queue.cc:237] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.218685 25533 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.214401 26232 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:11.221937 25532 leader_election.cc:336] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.224459 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:11.225896 25532 leader_election.cc:336] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.226593 25532 leader_election.cc:336] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.228806 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.229441 25494 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:11.227065 25532 leader_election.cc:336] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.230476 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.231045 25495 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.231786 25533 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.230652 25532 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.235368 25533 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.236380 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.239101 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.239818 25490 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.240254 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.241346 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.245427 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.245682 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.245448 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.246814 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.247089 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.247406 26188 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.248612 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.250924 25562 raft_consensus.cc:2393] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
W20260709 12:28:11.252089 25606 leader_election.cc:336] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.252756 25606 leader_election.cc:336] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.253698 25494 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:11.152554 26200 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:11.206568 26233 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.257764 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.258244 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.258800 25495 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:11.239614 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.237285 26187 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:28:11.264364 25458 leader_election.cc:336] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.232761 26222 raft_consensus.cc:2749] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.237077 26210 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.267266 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:11.268360 25458 leader_election.cc:336] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.273269 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.286489 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.274580 26231 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:11.274765 25489 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:11.275501 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.275957 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.276556 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.303037 25639 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.277513 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:11.260746 25461 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:11.280081 25532 leader_election.cc:336] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.280397 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:11.254667 26190 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.282197 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:11.283089 25606 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.273701 25492 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
W20260709 12:28:11.301110 25458 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.299440 25609 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.287586 25637 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:11.309314 25460 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:11.313066 25606 leader_election.cc:336] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.313970 25609 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.318723 25609 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.319481 25460 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.320091 25609 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.322399 25460 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.311739 25486 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.323865 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:11.324800 25568 raft_consensus.cc:2393] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:11.315299 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:11.328392 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:11.328548 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:11.329478 25569 raft_consensus.cc:2393] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:11.329591 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:11.330407 26201 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:11.318558 26190 raft_consensus.cc:697] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:11.330845 26201 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:11.331269 26201 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.331457 26190 consensus_queue.cc:237] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:11.331614 25459 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.332605 26232 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.333117 26232 raft_consensus.cc:697] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:11.333307 25490 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:11.334017 26232 consensus_queue.cc:237] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.335728 25639 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:11.337046 25459 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:11.338605 25609 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.337088 26209 raft_consensus.cc:2764] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:28:11.335803 25461 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.340438 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:11.341444 25561 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:11.341763 26239 raft_consensus.cc:2804] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.342229 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:11.343050 25567 raft_consensus.cc:2393] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:11.341776 25564 raft_consensus.cc:1240] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.344427 26233 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:11.314381 25664 debug-util.cc:398] Leaking SignalData structure 0x7b080010d380 after lost signal to thread 20876
I20260709 12:28:11.347235 25486 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
W20260709 12:28:11.347853 25664 debug-util.cc:398] Leaking SignalData structure 0x7b08000fad60 after lost signal to thread 25352
I20260709 12:28:11.347872 25609 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.346526 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.318064 26196 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.355104 25460 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
W20260709 12:28:11.354301 25458 leader_election.cc:336] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.358269 25458 leader_election.cc:336] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.323316 26231 raft_consensus.cc:2764] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:28:11.358146 25608 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.359512 25609 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.361560 25460 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:11.362699 25458 leader_election.cc:336] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:11.364663 25459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.368830 26233 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.370544 25608 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.371603 25608 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.371726 25460 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.372749 25535 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.376140 25460 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.386225 25567 raft_consensus.cc:1240] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.386466 26233 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.339911 26208 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.368898 26236 raft_consensus.cc:2764] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:28:11.388324 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.389106 26236 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.389345 26228 raft_consensus.cc:2749] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.390745 25460 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.375934 26240 raft_consensus.cc:2764] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:28:11.351825 26237 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.336756 26203 raft_consensus.cc:2749] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.393862 25460 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.401726 25460 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.394762 25609 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:11.392253 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 55821.3us
I20260709 12:28:11.404879 25608 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.406955 25608 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.392357 25535 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.354295 26227 raft_consensus.cc:2764] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:28:11.393034 25664 debug-util.cc:398] Leaking SignalData structure 0x7b08000fccc0 after lost signal to thread 25519
I20260709 12:28:11.390898 26209 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.411499 25609 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.415055 25609 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.409302 26208 raft_consensus.cc:2749] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.408257 26236 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.394345 26186 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.399351 26196 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.420260 25460 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.397939 26233 raft_consensus.cc:2749] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.412343 26221 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.422046 26203 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.412629 26228 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.424556 26228 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.425248 26229 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.425140 25609 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.427448 26229 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.428898 25609 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.422709 26237 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.431391 26221 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.395468 26210 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.432987 25609 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.420336 26186 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:11.441241 26227 raft_consensus.cc:2764] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:28:11.437104 26188 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.442066 26188 raft_consensus.cc:697] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:11.443005 26188 consensus_queue.cc:237] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:11.444522 25458 leader_election.cc:336] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.421751 26233 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:11.421512 25664 debug-util.cc:398] Leaking SignalData structure 0x7b0800177100 after lost signal to thread 25593
I20260709 12:28:11.429965 25491 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:11.411995 25608 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.439209 25535 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.444881 25609 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.446275 26221 raft_consensus.cc:2749] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.446794 25460 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:11.471024 25458 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.471555 25460 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.473345 26240 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.473984 26240 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:11.449465 25664 debug-util.cc:398] Leaking SignalData structure 0x7b0800259a00 after lost signal to thread 25667
I20260709 12:28:11.449710 26210 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.477092 26210 raft_consensus.cc:697] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:11.478011 26210 consensus_queue.cc:237] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:11.482669 25567 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.491387 26243 consensus_queue.cc:1059] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.463452 25535 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.470357 26201 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.496400 26237 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.445459 26239 raft_consensus.cc:697] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:11.497391 26201 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:11.466717 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.498255 25637 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:11.498690 25608 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.498483 25535 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.503113 26226 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.498270 26221 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.504987 26210 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.505888 26201 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.506819 26201 consensus_queue.cc:1059] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:11.497529 26239 consensus_queue.cc:237] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.510003 26237 raft_consensus.cc:3055] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:28:11.510207 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 65401.2us
I20260709 12:28:11.510445 26237 raft_consensus.cc:740] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:11.511060 25609 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.511303 26237 consensus_queue.cc:260] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.511835 26221 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.512272 25609 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.512661 26237 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.513046 26221 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.513674 25609 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.514401 26221 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.514245 25314 catalog_manager.cc:5697] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:11.515636 25606 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:11.516985 25609 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.518316 26221 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.519387 25459 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.520900 26246 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.509513 26233 raft_consensus.cc:3055] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.524346 26233 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:11.525285 26233 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.526683 26233 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.528087 25609 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.529222 25609 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:11.529872 26201 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.530169 25535 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.530469 26201 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.531002 26201 raft_consensus.cc:697] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:11.531800 26201 consensus_queue.cc:237] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.531823 26188 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.535224 26188 raft_consensus.cc:697] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:11.537292 26188 consensus_queue.cc:237] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.531327 25535 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.545987 26190 raft_consensus.cc:2804] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.546574 26190 raft_consensus.cc:697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:11.544896 25609 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.547394 26190 consensus_queue.cc:237] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:11.550645 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.551491 25491 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:11.553323 25535 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.554886 26201 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.556170 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:11.559760 26211 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.560281 25609 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.562544 26201 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.565270 25535 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:11.569864 25315 catalog_manager.cc:5697] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.584386 26211 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.584986 26211 raft_consensus.cc:697] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:11.585929 26211 consensus_queue.cc:237] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:11.592227 25535 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.596042 26190 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.598065 25535 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:11.601083 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:28:11.601527 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 2.023s	user 0.007s	sys 0.004s
I20260709 12:28:11.601876 20873 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:28:11.602347 26188 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.603317 26188 raft_consensus.cc:697] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:11.604344 26188 consensus_queue.cc:237] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.613595 26185 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:11.618552 25634 raft_consensus.cc:1275] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.620410 26239 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.621891 26237 consensus_queue.cc:1059] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:11.623315 26237 raft_consensus.cc:3055] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.623760 26237 raft_consensus.cc:740] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:11.624890 26237 consensus_queue.cc:260] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:11.629093 25606 consensus_peers.cc:597] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:11.629931 26237 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.643532 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:11.665457 26185 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:28:11.666400 25458 consensus_peers.cc:597] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:11.666544 26185 tablet_bootstrap.cc:492] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:11.667454 26185 ts_tablet_manager.cc:1403] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.001s
I20260709 12:28:11.670568 26185 raft_consensus.cc:359] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.671289 26185 raft_consensus.cc:740] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.673475 26185 consensus_queue.cc:260] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:11.684482 26185 ts_tablet_manager.cc:1434] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 12:28:11.685412 26185 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:11.687405 25567 raft_consensus.cc:1240] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.688891 25564 raft_consensus.cc:1240] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:11.697711 26237 consensus_queue.cc:1059] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:11.699069 26221 raft_consensus.cc:3055] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.699445 26221 raft_consensus.cc:740] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:11.700263 26221 consensus_queue.cc:260] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.701992 26221 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.704492 25535 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:11.705328 26188 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:11.719897 26221 consensus_queue.cc:1059] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.720815 26237 raft_consensus.cc:3055] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.721215 26237 raft_consensus.cc:740] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:11.722038 26237 consensus_queue.cc:260] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:11.725363 26237 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.735700 25642 raft_consensus.cc:1275] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:11.741508 26188 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:11.736701 25314 catalog_manager.cc:5697] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.743990 25314 catalog_manager.cc:5697] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.746963 25315 catalog_manager.cc:5697] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.752568 25315 catalog_manager.cc:5697] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.753963 25314 catalog_manager.cc:5697] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.754137 25315 catalog_manager.cc:5697] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.764210 25634 raft_consensus.cc:1275] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:11.767699 25458 consensus_peers.cc:597] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:11.769126 26239 consensus_queue.cc:1048] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:11.769790 25315 catalog_manager.cc:5697] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.771713 25315 catalog_manager.cc:5697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.773231 25315 catalog_manager.cc:5697] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.775152 25315 catalog_manager.cc:5697] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:11.870121 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 48638.5us
W20260709 12:28:11.870424 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 55964.7us
I20260709 12:28:11.875895 26185 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:28:11.877417 26255 log.cc:927] Time spent T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:28:11.879292 26185 tablet_bootstrap.cc:492] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:11.880003 26185 ts_tablet_manager.cc:1403] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.011s
I20260709 12:28:11.898672 26185 raft_consensus.cc:359] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:11.899434 26185 raft_consensus.cc:740] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.900110 26185 consensus_queue.cc:260] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:11.906042 26185 ts_tablet_manager.cc:1434] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:28:11.908722 26185 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:11.912837 25642 raft_consensus.cc:1275] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:11.940723 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 53945.2us
I20260709 12:28:11.925288 26246 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:28:12.071688 25532 consensus_peers.cc:597] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.086578 26185 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.088692 26185 tablet_bootstrap.cc:492] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.090112 26185 ts_tablet_manager.cc:1403] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.183s	user 0.020s	sys 0.001s
W20260709 12:28:12.090346 25532 consensus_peers.cc:597] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:12.097784 25532 consensus_peers.cc:597] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.098874 25532 consensus_peers.cc:597] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.113241 25532 consensus_peers.cc:597] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.122967 26185 raft_consensus.cc:359] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:12.124745 26185 raft_consensus.cc:740] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
W20260709 12:28:12.127251 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 62186.8us
I20260709 12:28:12.130127 25642 raft_consensus.cc:1275] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:12.133368 25532 consensus_peers.cc:597] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.133945 25532 consensus_peers.cc:597] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.140004 25634 raft_consensus.cc:1275] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:12.154779 25532 consensus_peers.cc:597] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.125689 26185 consensus_queue.cc:260] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:12.160467 26185 ts_tablet_manager.cc:1434] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 12:28:12.160341 26276 consensus_queue.cc:1048] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.161983 26185 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:12.167186 25493 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.169822 26279 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.174367 26280 consensus_queue.cc:1048] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.178299 25639 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.182520 25492 raft_consensus.cc:1275] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:12.182708 25532 consensus_peers.cc:597] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.184356 25486 raft_consensus.cc:1275] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.190260 25494 raft_consensus.cc:1275] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.192047 25495 raft_consensus.cc:1275] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:12.199751 25532 consensus_peers.cc:597] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:12.200165 25532 consensus_peers.cc:597] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:12.205766 25532 consensus_peers.cc:597] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.201040 26278 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 12:28:12.223820 25458 consensus_peers.cc:597] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.224531 25564 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.239398 26221 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.250075 26190 consensus_queue.cc:1048] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.250808 25489 raft_consensus.cc:1275] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:12.275532 25606 consensus_peers.cc:597] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:12.276863 25458 consensus_peers.cc:597] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.284283 25532 consensus_peers.cc:597] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.312645 25492 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.327713 26210 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.368418 26188 consensus_queue.cc:1048] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.368955 26226 consensus_queue.cc:1048] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.370628 26188 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:12.380306 26185 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.381497 26185 tablet_bootstrap.cc:492] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.382172 26185 ts_tablet_manager.cc:1403] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.010s
I20260709 12:28:12.384683 26185 raft_consensus.cc:359] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.386029 26185 raft_consensus.cc:740] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.387084 26185 consensus_queue.cc:260] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.389608 26185 ts_tablet_manager.cc:1434] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:12.390722 26185 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:12.392094 26226 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:12.454928 25532 consensus_peers.cc:597] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.496672 26276 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:12.497607 26276 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:12.502576 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:12.503558 25564 raft_consensus.cc:2393] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:12.505162 26185 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.505761 26276 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:12.506202 26185 tablet_bootstrap.cc:492] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.506918 26185 ts_tablet_manager.cc:1403] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.012s
I20260709 12:28:12.507507 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:12.508314 25634 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:12.509730 25459 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:12.509763 26185 raft_consensus.cc:359] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:12.510565 26185 raft_consensus.cc:740] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.511121 26281 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:12.511554 26281 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:12.511269 26185 consensus_queue.cc:260] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:12.511940 26281 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:12.513684 26185 ts_tablet_manager.cc:1434] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:12.514868 26185 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:12.532861 26281 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:12.539722 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:12.540880 25564 raft_consensus.cc:2393] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:12.555795 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:12.556418 26281 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:12.580788 25634 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:12.582041 25459 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:12.583045 26281 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:12.583520 26281 raft_consensus.cc:697] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:12.584538 26281 consensus_queue.cc:237] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:12.587620 26185 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.588655 26185 tablet_bootstrap.cc:492] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.589339 26185 ts_tablet_manager.cc:1403] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.075s	user 0.033s	sys 0.008s
I20260709 12:28:12.592177 26185 raft_consensus.cc:359] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:12.592861 26185 raft_consensus.cc:740] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.593713 26185 consensus_queue.cc:260] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:12.596216 26185 ts_tablet_manager.cc:1434] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:12.597223 26185 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:12.601585 26232 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:12.602545 26232 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:12.616650 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:12.617569 25564 raft_consensus.cc:2393] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:12.618415 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:12.619503 25634 raft_consensus.cc:2468] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:12.620683 25459 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:12.621870 20873 ts_tablet_manager.cc:600] Registering tablets (33/45 complete)
I20260709 12:28:12.623198 26232 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:12.624078 26232 raft_consensus.cc:2804] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:12.624454 26232 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:12.624828 26232 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:12.629405 25532 consensus_peers.cc:597] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.631949 25314 catalog_manager.cc:5697] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:12.647523 26232 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:12.659344 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:12.660154 25564 raft_consensus.cc:2393] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:12.660521 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
W20260709 12:28:12.665155 25458 consensus_peers.cc:597] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.667183 26185 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.670038 26185 tablet_bootstrap.cc:492] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.671985 26185 ts_tablet_manager.cc:1403] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.005s
W20260709 12:28:12.670686 25532 consensus_peers.cc:597] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.679425 26185 raft_consensus.cc:359] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:12.683064 26185 raft_consensus.cc:740] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
W20260709 12:28:12.686292 25606 consensus_peers.cc:597] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.684669 26185 consensus_queue.cc:260] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:12.690567 26185 ts_tablet_manager.cc:1434] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:28:12.692880 26185 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:12.707818 25634 raft_consensus.cc:2468] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:12.709390 25459 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:12.711112 26281 raft_consensus.cc:2804] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:12.729017 26185 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.723053 26281 raft_consensus.cc:697] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:12.732161 26185 tablet_bootstrap.cc:492] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.732052 26281 consensus_queue.cc:237] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:12.734186 26185 ts_tablet_manager.cc:1403] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.000s
I20260709 12:28:12.740638 26185 raft_consensus.cc:359] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:12.742121 26185 raft_consensus.cc:740] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.742410 26232 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:12.743377 26185 consensus_queue.cc:260] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:12.748312 26185 ts_tablet_manager.cc:1434] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:28:12.752182 26185 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:12.753783 25606 consensus_peers.cc:597] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:12.757968 25458 consensus_peers.cc:597] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.774539 26185 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.775571 26185 tablet_bootstrap.cc:492] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.776177 26185 ts_tablet_manager.cc:1403] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:28:12.779007 26185 raft_consensus.cc:359] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.779872 26185 raft_consensus.cc:740] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.780542 26185 consensus_queue.cc:260] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.783007 26185 ts_tablet_manager.cc:1434] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:12.783843 26185 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:12.785388 25314 catalog_manager.cc:5697] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:12.790604 25532 consensus_peers.cc:597] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:12.794435 25458 consensus_peers.cc:597] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.811462 26279 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.811869 26185 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.811986 26279 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:12.818549 26185 tablet_bootstrap.cc:492] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.819319 26185 ts_tablet_manager.cc:1403] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.000s
I20260709 12:28:12.822070 26185 raft_consensus.cc:359] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.822759 26185 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.823282 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:12.823410 26185 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.824079 25489 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:12.825438 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:12.826272 25564 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:12.827158 25609 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:12.828294 26221 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:12.828650 26221 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.828999 26221 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.829316 26185 ts_tablet_manager.cc:1434] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:28:12.830542 26185 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:12.834101 25532 consensus_peers.cc:597] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.824101 26279 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:12.842761 25458 consensus_peers.cc:597] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:12.843024 25532 consensus_peers.cc:597] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.849037 26221 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:12.851377 25458 consensus_peers.cc:597] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.853652 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:12.854321 25489 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.869102 26270 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.870051 26270 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:12.874204 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:12.874985 25637 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:12.875015 26270 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:12.885612 26263 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.896867 25533 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:12.897346 26263 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.878983 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:12.877630 26221 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:12.900738 25564 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.898010 26270 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:12.902086 26270 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.902473 26270 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:12.901311 25532 leader_election.cc:336] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:12.927145 25564 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:12.931298 25608 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:12.932163 26279 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:12.932638 26279 raft_consensus.cc:697] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:12.933350 25606 consensus_peers.cc:597] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.933528 26279 consensus_queue.cc:237] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:12.933991 25606 consensus_peers.cc:597] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:12.939055 26270 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:12.943434 26263 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:12.948210 25489 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:12.951665 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:12.966272 26270 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:12.967027 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:12.967723 25637 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:12.973340 25532 leader_election.cc:336] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:12.975417 25315 catalog_manager.cc:5697] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:12.976408 25637 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:12.977487 20873 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:28:12.977854 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 1.376s	user 0.329s	sys 0.060s
I20260709 12:28:12.977835 25533 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:12.978348 26185 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:12.979374 26270 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:12.979427 26185 tablet_bootstrap.cc:492] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:12.979979 26270 raft_consensus.cc:697] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:12.980381 26185 ts_tablet_manager.cc:1403] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.150s	user 0.039s	sys 0.047s
I20260709 12:28:12.980939 26270 consensus_queue.cc:237] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:12.984459 26185 raft_consensus.cc:359] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.985280 26185 raft_consensus.cc:740] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:12.986002 26185 consensus_queue.cc:260] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:12.988596 26185 ts_tablet_manager.cc:1434] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:12.989579 26185 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:12.995004 25637 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:13.005941 26279 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:12.998721 26276 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:28:13.006507 26279 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.009382 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:13.009528 26279 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:13.010121 25492 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:13.011034 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:13.011780 25564 raft_consensus.cc:2393] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
W20260709 12:28:13.012912 25458 consensus_peers.cc:597] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:13.012988 25609 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:13.015602 26221 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:13.017319 26221 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:13.017683 26221 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:13.030468 25315 catalog_manager.cc:5697] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:13.043344 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:13.045226 26182 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:13.047118 26263 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:13.061635 25458 consensus_peers.cc:597] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:13.064486 26263 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.065269 26263 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:13.067716 26263 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:13.074007 25564 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:28:13.075807 25458 consensus_peers.cc:597] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:13.075836 26232 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:13.076524 25458 consensus_peers.cc:597] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:13.077762 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:13.090979 26221 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.096071 26185 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:13.097419 26185 tablet_bootstrap.cc:492] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:13.098296 26185 ts_tablet_manager.cc:1403] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.008s
I20260709 12:28:13.102008 26185 raft_consensus.cc:359] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:13.102877 26185 raft_consensus.cc:740] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.103626 26185 consensus_queue.cc:260] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:13.107425 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:13.112253 26185 ts_tablet_manager.cc:1434] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:28:13.115064 26185 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:13.115705 26279 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.116243 26279 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:13.122929 26237 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.123529 26237 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:13.124442 25606 leader_election.cc:336] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:13.125226 26279 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:13.131429 25561 raft_consensus.cc:1275] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:13.133224 26281 consensus_queue.cc:1048] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:13.137418 25492 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:13.138307 26221 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:13.144243 26185 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:13.144222 25609 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:13.145318 26221 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:13.145669 26237 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:13.146917 26221 raft_consensus.cc:697] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:13.148324 26221 consensus_queue.cc:237] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.149667 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:13.150426 25492 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
W20260709 12:28:13.152861 25606 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:13.155822 25609 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:13.157080 26279 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:13.157595 26279 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.158056 26279 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.162250 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:13.163146 25567 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:13.163676 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:13.164507 25566 raft_consensus.cc:2393] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:13.169874 26185 tablet_bootstrap.cc:492] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:13.169493 26279 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.170622 26185 ts_tablet_manager.cc:1403] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.000s
I20260709 12:28:13.172684 26279 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:13.173251 26190 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.173554 26185 raft_consensus.cc:359] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:13.174196 26185 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.174645 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:13.174868 26185 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:13.175251 25492 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.173833 26190 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.176977 26185 ts_tablet_manager.cc:1434] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:13.179401 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:13.178732 26190 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:13.177923 26185 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:13.183584 25606 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:13.190341 26321 log.cc:927] Time spent T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:28:13.202550 25637 raft_consensus.cc:1275] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:13.204463 26276 consensus_queue.cc:1048] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:13.218526 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:13.219663 26237 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:13.220043 26237 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.220391 26237 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.226665 25314 catalog_manager.cc:5697] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:13.229969 26237 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:13.232170 26270 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.232772 26270 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.235905 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:13.236616 25634 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:13.237829 25533 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:13.238632 26190 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:13.239022 26190 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.239401 26190 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.244501 26270 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:13.248792 25458 consensus_peers.cc:597] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:13.249388 25458 consensus_peers.cc:597] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:13.251351 25492 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:13.261957 26270 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.262687 26270 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:13.265646 26270 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:13.266413 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:13.267429 25637 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:13.268571 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:13.272373 26270 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:13.272766 26270 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.273070 26270 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.286808 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:13.287545 25564 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.290153 25609 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:13.291473 26221 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:13.291616 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:13.292002 26221 raft_consensus.cc:697] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:13.292383 25489 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:13.292953 26221 consensus_queue.cc:237] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.296466 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:13.297201 25489 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:13.302263 25564 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:13.303619 26237 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:13.311720 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:13.314131 26279 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:13.314766 26279 raft_consensus.cc:697] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:13.315286 25606 leader_election.cc:336] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:13.313624 25532 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:13.326845 25535 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:13.352824 26185 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:13.360939 26185 tablet_bootstrap.cc:492] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:13.336256 26226 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:13.359489 26270 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:13.361869 26185 ts_tablet_manager.cc:1403] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.184s	user 0.037s	sys 0.023s
I20260709 12:28:13.326030 26279 consensus_queue.cc:237] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:13.370482 26263 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.371222 26263 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:13.373950 26263 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:13.374528 26190 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.374923 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:13.335881 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:13.363601 26226 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.376631 26190 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:13.376359 26185 raft_consensus.cc:359] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:13.377336 26185 raft_consensus.cc:740] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.377025 26226 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.378261 26185 consensus_queue.cc:260] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:13.404668 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 74298us
I20260709 12:28:13.408280 26185 ts_tablet_manager.cc:1434] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 12:28:13.409941 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:13.410857 25639 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:13.414489 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 75150.9us
I20260709 12:28:13.425123 25639 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:13.428793 26185 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:13.430472 26270 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:13.476595 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:13.477547 25637 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.474918 25315 catalog_manager.cc:5697] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:13.506863 26190 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.507601 26190 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:13.509959 26190 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:13.512140 25458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111) [suppressed 332 similar messages]
I20260709 12:28:13.536844 26226 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:13.539223 26226 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:13.535400 25533 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:13.558436 25639 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:13.548554 26190 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:13.561008 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:13.583279 25492 raft_consensus.cc:1275] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:13.585228 26346 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:13.570649 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:13.590294 25634 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:13.569860 26190 raft_consensus.cc:697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:13.591872 25637 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:13.592018 26190 consensus_queue.cc:237] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:13.606712 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 191524us
I20260709 12:28:13.613088 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:13.613729 25495 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.613891 26181 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:13.615693 26263 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:13.616577 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:13.617215 25494 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:13.626235 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 57866.3us
I20260709 12:28:13.628304 25533 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:13.632292 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:13.641456 25494 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:13.637728 25495 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:13.646082 25315 catalog_manager.cc:5697] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:13.649152 26356 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:13.655063 26356 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.655419 26356 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:13.659754 25561 raft_consensus.cc:1275] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:13.671206 26356 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:13.654866 26211 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:13.687157 26211 raft_consensus.cc:697] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:13.707105 26237 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 12:28:13.741909 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 46336.8us
I20260709 12:28:13.740957 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:13.750011 26263 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.793879 26185 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:13.790464 26211 consensus_queue.cc:237] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:13.793027 25606 consensus_peers.cc:597] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:13.796566 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:13.798437 25639 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:13.811611 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 54103.5us
I20260709 12:28:13.789794 26356 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:13.813024 25535 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:13.749645 26353 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.154s
I20260709 12:28:13.823246 26226 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:13.828920 26226 raft_consensus.cc:697] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:13.846423 25639 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:13.848044 25533 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:13.865721 26185 tablet_bootstrap.cc:492] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:13.866788 26185 ts_tablet_manager.cc:1403] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.443s	user 0.023s	sys 0.005s
I20260709 12:28:13.829897 26226 consensus_queue.cc:237] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:13.891386 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 64545.3us
I20260709 12:28:13.798146 26263 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:13.902594 26341 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:28:13.918244 25532 leader_election.cc:336] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:13.889025 26181 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:13.931357 25532 consensus_peers.cc:597] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:13.908181 26341 raft_consensus.cc:697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:13.935258 25495 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:13.935117 26341 consensus_queue.cc:237] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:13.952764 25606 consensus_peers.cc:597] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:13.960250 26185 raft_consensus.cc:359] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:13.961349 26185 raft_consensus.cc:740] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:13.963230 26185 consensus_queue.cc:260] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:13.976652 25532 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:13.980120 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 63353.8us
W20260709 12:28:13.982307 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 59788.4us
I20260709 12:28:13.998926 25491 raft_consensus.cc:1275] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:14.000313 26373 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.000944 26373 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:14.004526 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:14.017405 26185 ts_tablet_manager.cc:1434] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.150s	user 0.007s	sys 0.008s
I20260709 12:28:14.003490 26373 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:14.051509 26185 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:14.052855 26373 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.091501 25567 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:14.103543 26263 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:14.133018 26373 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.156594 26373 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:14.158661 26373 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:14.141965 26384 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.170810 26384 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:14.143519 26376 log.cc:927] Time spent T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:28:14.145519 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.147915 25568 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:14.179212 26384 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:14.150835 26374 consensus_queue.cc:1059] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:14.150852 26237 consensus_queue.cc:1048] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:14.131558 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 286200us
I20260709 12:28:14.153153 26387 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.132575 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.180028 25314 catalog_manager.cc:5697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:14.193887 26384 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.203504 26384 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:14.202356 26387 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:14.206460 26384 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:14.186416 26374 raft_consensus.cc:3055] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:14.207528 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.209482 26374 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:14.222901 25532 leader_election.cc:336] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:14.234768 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:14.235510 26387 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:14.238827 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:14.245760 26374 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:14.247503 26374 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:14.283818 26382 log.cc:927] Time spent T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.185s	user 0.004s	sys 0.000s
I20260709 12:28:14.285184 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:14.287293 26394 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.287161 26180 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:14.287940 26394 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:14.289505 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 84379.7us
I20260709 12:28:14.291159 26387 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.294708 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:14.295409 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:14.290570 26394 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:14.303231 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:14.308107 26181 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:14.303272 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 369039us
I20260709 12:28:14.389894 25637 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:14.317956 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:14.319475 26335 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:14.335532 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.336333 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.351179 25634 raft_consensus.cc:1275] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:14.315781 26185 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:14.354312 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:14.390502 26394 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.395828 26185 tablet_bootstrap.cc:492] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:14.402045 26185 ts_tablet_manager.cc:1403] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.380s	user 0.025s	sys 0.040s
W20260709 12:28:14.402627 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 76173.3us
W20260709 12:28:14.390050 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 82025.9us
I20260709 12:28:14.397114 26182 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:14.411633 26181 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:14.412557 26394 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.412763 26387 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.416097 26181 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:14.410427 25635 raft_consensus.cc:1275] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:28:14.408481 25532 consensus_peers.cc:597] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:14.410405 26185 raft_consensus.cc:359] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:14.422468 25495 raft_consensus.cc:1275] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:14.420526 26185 raft_consensus.cc:740] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
W20260709 12:28:14.427332 25532 consensus_peers.cc:597] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:14.427368 26185 consensus_queue.cc:260] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:14.465407 26185 ts_tablet_manager.cc:1434] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:28:14.466495 26185 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:14.469031 26398 log.cc:927] Time spent T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:28:14.473901 25634 raft_consensus.cc:1275] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:28:14.474391 25634 pending_rounds.cc:85] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 1
I20260709 12:28:14.474654 25634 pending_rounds.cc:107] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:28:14.474970 25634 raft_consensus.cc:2889] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:14.445504 26387 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:14.499439 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 54602.7us
W20260709 12:28:14.505221 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 48411.4us
W20260709 12:28:14.506685 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 90706.6us
I20260709 12:28:14.516371 26181 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:14.517486 26394 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.518127 26181 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:14.519258 26394 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.522245 26359 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:14.511693 25458 consensus_peers.cc:597] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:14.534130 26190 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:14.535727 26190 consensus_queue.cc:1048] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:14.537216 26381 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:14.551088 25458 consensus_peers.cc:597] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:14.553555 26211 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:14.624951 26185 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:28:14.647993 25606 consensus_peers.cc:597] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:14.660202 26185 tablet_bootstrap.cc:492] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:14.660966 26185 ts_tablet_manager.cc:1403] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.195s	user 0.030s	sys 0.006s
I20260709 12:28:14.668735 25318 catalog_manager.cc:5697] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
W20260709 12:28:14.720747 25532 consensus_peers.cc:597] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:14.723388 26185 raft_consensus.cc:359] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:14.724224 26185 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.725762 25492 raft_consensus.cc:1275] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:28:14.728601 25532 consensus_peers.cc:597] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:14.731163 26371 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:14.725021 26185 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:14.744858 25314 catalog_manager.cc:5697] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:14.746766 25314 catalog_manager.cc:5697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:14.750211 26185 ts_tablet_manager.cc:1434] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.000s
I20260709 12:28:14.751188 26185 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:14.757599 26414 log.cc:927] Time spent T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:28:14.767935 26394 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.768595 26394 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:14.772590 26394 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:14.773346 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:14.774751 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.776664 26180 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:14.777828 26394 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.834268 26185 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:14.836591 26185 tablet_bootstrap.cc:492] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:14.837258 26185 ts_tablet_manager.cc:1403] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.000s
I20260709 12:28:14.846287 26394 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.846935 26394 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:14.847306 25532 consensus_peers.cc:597] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:14.847896 25532 consensus_peers.cc:597] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:14.849193 26394 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:14.850914 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.851672 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:14.853123 26181 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:14.854254 26394 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:14.856112 26185 raft_consensus.cc:359] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:14.856873 26185 raft_consensus.cc:740] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.859984 26185 consensus_queue.cc:260] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:14.866017 26185 ts_tablet_manager.cc:1434] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:28:14.866879 26185 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:14.895602 25532 consensus_peers.cc:597] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:14.915392 25606 consensus_peers.cc:597] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:14.917380 26185 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:14.918464 26185 tablet_bootstrap.cc:492] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:14.919188 26185 ts_tablet_manager.cc:1403] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.004s
W20260709 12:28:14.920857 25532 consensus_peers.cc:597] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:14.922852 25532 consensus_peers.cc:597] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:14.928103 26185 raft_consensus.cc:359] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:14.928997 26185 raft_consensus.cc:740] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.933286 26185 consensus_queue.cc:260] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:14.937273 26185 ts_tablet_manager.cc:1434] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:28:14.938082 26185 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:14.940014 26394 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.940588 26394 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:14.942899 26394 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:14.944157 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:14.947645 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:14.949443 26180 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:14.950791 26394 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:14.971025 25532 consensus_peers.cc:597] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:14.972512 25532 consensus_peers.cc:597] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:14.973296 25532 consensus_peers.cc:597] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:14.973881 25532 consensus_peers.cc:597] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:14.992295 25606 consensus_peers.cc:597] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:15.012629 26185 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.014276 26185 tablet_bootstrap.cc:492] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.015093 26185 ts_tablet_manager.cc:1403] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.006s
I20260709 12:28:15.018561 26185 raft_consensus.cc:359] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:15.026539 25458 consensus_peers.cc:597] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:15.022939 26185 raft_consensus.cc:740] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.029592 26185 consensus_queue.cc:260] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.032186 26185 ts_tablet_manager.cc:1434] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:28:15.038437 26185 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:15.041075 25532 consensus_peers.cc:597] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:15.050693 26394 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.051302 26394 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:15.053543 26394 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:15.056118 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:15.059659 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:15.061605 26180 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:15.063603 26394 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:15.095535 26448 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:34707 every 8 connection(s)
I20260709 12:28:15.096150 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:34707
I20260709 12:28:15.109717 26185 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.110927 26185 tablet_bootstrap.cc:492] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.111647 26185 ts_tablet_manager.cc:1403] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.000s
I20260709 12:28:15.125943 26394 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.126775 26394 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:15.131431 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:15.138933 26394 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:15.115070 26185 raft_consensus.cc:359] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:15.162611 26185 raft_consensus.cc:740] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.163486 26185 consensus_queue.cc:260] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:15.151376 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:15.166996 26185 ts_tablet_manager.cc:1434] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:28:15.177950 26185 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:15.220110 26181 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:15.225419 26394 raft_consensus.cc:2749] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:15.260986 25532 consensus_peers.cc:597] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:15.270488 26418 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:15.272986 26449 heartbeater.cc:344] Connected to a master server at 127.20.98.126:39987
I20260709 12:28:15.273554 26449 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:15.282089 26449 heartbeater.cc:507] Master 127.20.98.126:39987 requested a full tablet report, sending...
W20260709 12:28:15.296521 25458 consensus_peers.cc:597] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:15.336225 26185 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.337316 26185 tablet_bootstrap.cc:492] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.338048 26185 ts_tablet_manager.cc:1403] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.008s
I20260709 12:28:15.341491 26185 raft_consensus.cc:359] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:15.342201 26185 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.342995 26185 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:15.344405 25458 consensus_peers.cc:597] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:15.345233 26185 ts_tablet_manager.cc:1434] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:15.346714 26185 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:15.380645 25314 ts_manager.cc:194] Re-registered known tserver with Master: 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:15.417685 26185 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.418828 26185 tablet_bootstrap.cc:492] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.419549 26185 ts_tablet_manager.cc:1403] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.031s
I20260709 12:28:15.422567 26185 raft_consensus.cc:359] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.423297 26185 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.424110 26185 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.426326 26185 ts_tablet_manager.cc:1434] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:15.427145 26185 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:15.480234 26185 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.481350 26185 tablet_bootstrap.cc:492] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.481988 26185 ts_tablet_manager.cc:1403] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.008s
I20260709 12:28:15.484660 26185 raft_consensus.cc:359] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:15.485352 26185 raft_consensus.cc:740] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.486261 26185 consensus_queue.cc:260] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:15.490705 26185 ts_tablet_manager.cc:1434] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:15.491515 26185 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:15.529455 25314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47518
I20260709 12:28:15.530176 26185 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.531265 26185 tablet_bootstrap.cc:492] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.531922 26185 ts_tablet_manager.cc:1403] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.015s
I20260709 12:28:15.535259 26185 raft_consensus.cc:359] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.535928 26185 raft_consensus.cc:740] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.536509 26449 heartbeater.cc:499] Master 127.20.98.126:39987 was elected leader, sending a full tablet report...
I20260709 12:28:15.536633 26185 consensus_queue.cc:260] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.544374 26185 ts_tablet_manager.cc:1434] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:28:15.545374 26185 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:15.563786 25458 consensus_peers.cc:597] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:15.569752 26418 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:15.594449 26185 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.595643 26185 tablet_bootstrap.cc:492] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.596351 26185 ts_tablet_manager.cc:1403] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.014s
I20260709 12:28:15.599527 26185 raft_consensus.cc:359] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:15.600327 26185 raft_consensus.cc:740] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.601845 26185 consensus_queue.cc:260] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:15.607723 26185 ts_tablet_manager.cc:1434] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:28:15.608628 26185 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:15.644593 26185 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.646309 26408 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:15.650038 26185 tablet_bootstrap.cc:492] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.651149 26185 ts_tablet_manager.cc:1403] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.007s
I20260709 12:28:15.653983 26185 raft_consensus.cc:359] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.654678 26185 raft_consensus.cc:740] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.655357 26185 consensus_queue.cc:260] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.657555 26185 ts_tablet_manager.cc:1434] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:28:15.658382 26185 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:15.690056 25532 consensus_peers.cc:597] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:15.711190 26185 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.712293 26185 tablet_bootstrap.cc:492] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.713022 26185 ts_tablet_manager.cc:1403] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.013s
I20260709 12:28:15.716058 26185 raft_consensus.cc:359] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.716794 26185 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.717572 26185 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.719985 26185 ts_tablet_manager.cc:1434] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:28:15.720896 26185 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:15.741384 25458 consensus_peers.cc:597] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:15.791271 26408 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:15.868825 26185 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.869884 26185 tablet_bootstrap.cc:492] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:15.871778 26185 ts_tablet_manager.cc:1403] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.150s	user 0.018s	sys 0.020s
I20260709 12:28:15.874318 26185 raft_consensus.cc:359] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.874990 26185 raft_consensus.cc:740] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.876080 26185 consensus_queue.cc:260] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:15.878360 26185 ts_tablet_manager.cc:1434] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:15.879711 26185 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:15.998912 26185 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:15.999982 26185 tablet_bootstrap.cc:492] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.000710 26185 ts_tablet_manager.cc:1403] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.003s
I20260709 12:28:16.003526 26185 raft_consensus.cc:359] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:16.004252 26185 raft_consensus.cc:740] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.007637 26408 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.029402 26185 consensus_queue.cc:260] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:16.033190 26185 ts_tablet_manager.cc:1434] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:28:16.034051 26185 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.059067 26418 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:16.082890 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 58637.8us
I20260709 12:28:16.090312 26185 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.092232 26185 tablet_bootstrap.cc:492] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.092921 26185 ts_tablet_manager.cc:1403] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.007s
I20260709 12:28:16.095820 26185 raft_consensus.cc:359] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.096546 26185 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.097426 26185 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.099890 26185 ts_tablet_manager.cc:1434] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:28:16.100806 26185 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.152423 26185 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.153656 26185 tablet_bootstrap.cc:492] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.154337 26185 ts_tablet_manager.cc:1403] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.005s
I20260709 12:28:16.157133 26185 raft_consensus.cc:359] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.157913 26185 raft_consensus.cc:740] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.158608 26185 consensus_queue.cc:260] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.160696 26185 ts_tablet_manager.cc:1434] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:28:16.161561 26185 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.185678 26185 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.186913 26185 tablet_bootstrap.cc:492] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.187624 26185 ts_tablet_manager.cc:1403] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.005s
I20260709 12:28:16.190243 26185 raft_consensus.cc:359] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:16.190934 26185 raft_consensus.cc:740] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.191727 26185 consensus_queue.cc:260] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:16.193888 26185 ts_tablet_manager.cc:1434] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:16.194967 26185 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.220750 26185 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.221755 26185 tablet_bootstrap.cc:492] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.222491 26185 ts_tablet_manager.cc:1403] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.000s
I20260709 12:28:16.226619 26185 raft_consensus.cc:359] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.227321 26185 raft_consensus.cc:740] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.228124 26185 consensus_queue.cc:260] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.230301 26185 ts_tablet_manager.cc:1434] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:16.231112 26185 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.276877 26185 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.277881 26185 tablet_bootstrap.cc:492] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.278602 26185 ts_tablet_manager.cc:1403] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.008s
I20260709 12:28:16.296945 26185 raft_consensus.cc:359] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:16.297761 26185 raft_consensus.cc:740] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.301481 26185 consensus_queue.cc:260] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:16.306751 26185 ts_tablet_manager.cc:1434] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:28:16.313730 26185 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
W20260709 12:28:16.358754 25606 consensus_peers.cc:597] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:16.373301 26185 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.374418 26185 tablet_bootstrap.cc:492] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.388906 26185 ts_tablet_manager.cc:1403] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.001s
I20260709 12:28:16.394390 26185 raft_consensus.cc:359] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.395124 26185 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.405246 26185 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.408169 26185 ts_tablet_manager.cc:1434] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:28:16.418375 26185 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.467185 26185 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.468225 26185 tablet_bootstrap.cc:492] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.479614 26185 ts_tablet_manager.cc:1403] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.000s
I20260709 12:28:16.482473 26185 raft_consensus.cc:359] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.483210 26185 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.483942 26185 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.485618 26185 ts_tablet_manager.cc:1434] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:16.504071 26185 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.519219 26419 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.651316 26408 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.653977 26185 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.662994 26185 tablet_bootstrap.cc:492] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.669642 26185 ts_tablet_manager.cc:1403] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.166s	user 0.042s	sys 0.067s
I20260709 12:28:16.698168 26185 raft_consensus.cc:359] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.698977 26185 raft_consensus.cc:740] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.709928 26185 consensus_queue.cc:260] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.712777 26185 ts_tablet_manager.cc:1434] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:28:16.713739 26185 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.822105 26185 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.823144 26185 tablet_bootstrap.cc:492] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.823804 26185 ts_tablet_manager.cc:1403] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.110s	user 0.026s	sys 0.016s
I20260709 12:28:16.826449 26185 raft_consensus.cc:359] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.827132 26185 raft_consensus.cc:740] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
W20260709 12:28:16.827946 25458 consensus_peers.cc:597] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:16.827854 26185 consensus_queue.cc:260] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:16.835584 26185 ts_tablet_manager.cc:1434] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:28:16.837826 26185 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:16.889303 26419 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:16.932646 26185 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:16.936260 26185 tablet_bootstrap.cc:492] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:16.937295 26185 ts_tablet_manager.cc:1403] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.012s
I20260709 12:28:16.940155 26185 raft_consensus.cc:359] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.940937 26185 raft_consensus.cc:740] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:16.941757 26185 consensus_queue.cc:260] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:16.944222 26185 ts_tablet_manager.cc:1434] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:28:17.005122 26185 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:17.033860 26419 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:17.045704 26185 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:17.047138 26185 tablet_bootstrap.cc:492] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:17.047991 26185 ts_tablet_manager.cc:1403] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.012s
I20260709 12:28:17.049135 26408 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:17.051018 26185 raft_consensus.cc:359] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:17.051931 26185 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.052847 26185 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:17.055480 26185 ts_tablet_manager.cc:1434] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:17.087894 26185 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:17.124106 26185 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:17.129112 26185 tablet_bootstrap.cc:492] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:17.134577 26185 ts_tablet_manager.cc:1403] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.004s
I20260709 12:28:17.140193 26185 raft_consensus.cc:359] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:17.140956 26185 raft_consensus.cc:740] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.141922 26185 consensus_queue.cc:260] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:17.148773 26185 ts_tablet_manager.cc:1434] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:28:17.164433 26185 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:17.224901 26185 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:17.226006 26185 tablet_bootstrap.cc:492] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:17.226773 26185 ts_tablet_manager.cc:1403] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.015s
I20260709 12:28:17.244604 26185 raft_consensus.cc:359] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:17.245505 26185 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.246533 26185 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:17.249017 26185 ts_tablet_manager.cc:1434] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:28:17.250000 26185 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:17.298473 26185 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:17.299605 26185 tablet_bootstrap.cc:492] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:17.300411 26185 ts_tablet_manager.cc:1403] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.009s
I20260709 12:28:17.303287 26185 raft_consensus.cc:359] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:17.304044 26185 raft_consensus.cc:740] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.304955 26185 consensus_queue.cc:260] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:17.311337 26185 ts_tablet_manager.cc:1434] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:28:17.312371 26185 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap starting.
I20260709 12:28:17.335922 26185 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:17.337005 26185 tablet_bootstrap.cc:492] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Bootstrap complete.
I20260709 12:28:17.337787 26185 ts_tablet_manager.cc:1403] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 12:28:17.340636 26185 raft_consensus.cc:359] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:17.341405 26185 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Initialized, Role: FOLLOWER
I20260709 12:28:17.342206 26185 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:17.344591 26185 ts_tablet_manager.cc:1434] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:17.417644 26408 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:17.496658 26408 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:17.508838 26415 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:18.085608 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 89040.1us
I20260709 12:28:25.224465 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:25.274173 25560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1704016a67e740008ce23d578992ecaa"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:25.275115 25560 raft_consensus.cc:606] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:25.278442 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:25.279004 25564 raft_consensus.cc:606] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:25.281065 26525 raft_consensus.cc:993] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:25.281684 26525 raft_consensus.cc:1081] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:25.283820 25635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1704016a67e740008ce23d578992ecaa"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53066
I20260709 12:28:25.284382 25635 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:25.284822 25635 raft_consensus.cc:3060] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.293396 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:25.294001 25489 raft_consensus.cc:606] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:25.293820 25635 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:25.297084 25635 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:25.297785 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:25.298570 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:25.298632 25489 raft_consensus.cc:3060] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.299271 25560 raft_consensus.cc:3055] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:25.299599 25560 raft_consensus.cc:740] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:25.300536 25560 consensus_queue.cc:260] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:25.297794 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:25.301817 25564 raft_consensus.cc:606] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:25.302145 25560 raft_consensus.cc:3060] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.305156 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:25.305426 26523 raft_consensus.cc:993] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.305789 25564 raft_consensus.cc:606] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:25.305946 26525 raft_consensus.cc:1081] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.307760 26415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:25.308245 26415 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:25.308486 26415 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.309634 25489 raft_consensus.cc:2468] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:25.311156 25609 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:25.312783 26335 raft_consensus.cc:2804] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:25.313197 25560 raft_consensus.cc:2468] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:25.313313 26335 raft_consensus.cc:697] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:25.314437 26335 consensus_queue.cc:237] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:25.312796 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:25.315742 25564 raft_consensus.cc:606] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:25.316962 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:28:25.318514 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:25.319005 26415 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:25.319653 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:25.321620 26415 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:25.322566 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:25.323251 25564 raft_consensus.cc:3055] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:25.323511 25564 raft_consensus.cc:740] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:25.324566 25564 consensus_queue.cc:260] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:25.326050 25564 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.330528 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:25.332284 25489 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.335763 25564 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:25.337875 26181 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:25.350028 26530 raft_consensus.cc:2804] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:25.339555 25489 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:25.370455 26530 raft_consensus.cc:697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:25.373374 25314 catalog_manager.cc:5697] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:25.378077 26530 consensus_queue.cc:237] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:25.399238 25315 catalog_manager.cc:5697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:25.427559 26523 raft_consensus.cc:993] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.428206 26518 raft_consensus.cc:1081] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.429783 26408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:25.430325 26408 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:25.430684 26408 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:25.438644 26408 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:25.440719 26408 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:25.441391 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:25.442037 25560 raft_consensus.cc:3055] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:25.442088 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:25.442399 25560 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:25.442684 25634 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:25.443154 25560 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:25.444543 25560 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:25.450393 25634 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:25.451771 26180 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:25.451802 25560 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:25.452664 26530 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:25.453150 26530 raft_consensus.cc:697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:25.454023 26530 consensus_queue.cc:237] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:25.464015 26518 raft_consensus.cc:993] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.464468 26523 raft_consensus.cc:1081] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.466694 26408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:25.467211 26408 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:25.467545 26408 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:25.474470 26408 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:25.474843 25315 catalog_manager.cc:5697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 3 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:25.477061 26408 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:25.477241 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:25.477844 25634 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:25.481611 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:25.482218 25560 raft_consensus.cc:3055] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:25.482491 25560 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:25.483243 25560 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:25.484582 25560 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:25.484792 25634 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:25.487138 26180 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:25.487882 26530 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:25.488356 26530 raft_consensus.cc:697] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:25.489279 26530 consensus_queue.cc:237] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:25.491779 25560 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:25.500012 25315 catalog_manager.cc:5697] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 3 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:25.509474 26533 raft_consensus.cc:993] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.510191 26522 raft_consensus.cc:1081] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.511746 26408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:25.512284 26408 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:25.512645 26408 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.517860 26408 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:25.519553 26408 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:25.520267 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:25.520735 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:25.521464 25487 raft_consensus.cc:3055] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:25.521744 25487 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:25.520920 25634 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.522574 25487 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:25.523869 25487 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.529021 25634 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:25.530498 26180 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:25.531176 25487 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:25.531250 26530 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:25.532053 26530 raft_consensus.cc:697] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:25.532990 26530 consensus_queue.cc:237] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:25.542789 25315 catalog_manager.cc:5697] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:25.738857 25487 raft_consensus.cc:1275] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:25.740214 26524 consensus_queue.cc:1048] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.755209 25564 raft_consensus.cc:1275] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:25.757659 26524 consensus_queue.cc:1048] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.827344 25564 raft_consensus.cc:1275] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:25.828517 26530 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.837904 26518 raft_consensus.cc:993] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.838418 26525 raft_consensus.cc:1081] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:25.840194 26408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:25.840338 25489 raft_consensus.cc:1275] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:25.840777 26408 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:25.841203 26408 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.841944 26530 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.851655 26408 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:25.860057 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:25.860347 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:25.860657 25487 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.860926 25564 raft_consensus.cc:3055] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:25.861191 26408 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:25.861286 25564 raft_consensus.cc:740] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:25.862330 25564 consensus_queue.cc:260] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:25.865293 25564 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:25.871490 25487 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:25.872427 25564 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:25.872641 26182 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:25.873759 26530 raft_consensus.cc:2804] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:25.874238 26530 raft_consensus.cc:697] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:25.875087 26530 consensus_queue.cc:237] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:25.901088 25314 catalog_manager.cc:5697] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:25.922168 25564 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:25.923437 26530 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:25.944196 25636 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:25.946722 26531 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:26.004166 25634 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:26.005915 26530 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:26.018465 25560 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:26.019881 26552 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:26.068132 25636 raft_consensus.cc:1275] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:26.069454 26552 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:26.079303 25489 raft_consensus.cc:1275] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:26.081362 26530 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:26.293530 25487 raft_consensus.cc:1275] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:26.294821 26530 consensus_queue.cc:1048] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:26.309342 25560 raft_consensus.cc:1275] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:26.315193 26552 consensus_queue.cc:1048] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:26.417526 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:26.465310 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1212a262e8424670b13c83406b35dae8"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:26.465837 25564 raft_consensus.cc:606] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:26.468376 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:26.468961 25564 raft_consensus.cc:606] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:26.471215 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:26.471680 25564 raft_consensus.cc:606] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:26.474161 25487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:26.474620 25487 raft_consensus.cc:606] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:26.477383 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:26.478034 25564 raft_consensus.cc:606] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:26.480145 26518 raft_consensus.cc:993] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:26.480583 26525 raft_consensus.cc:1081] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:26.481719 25564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:26.482208 26418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:26.482421 25564 raft_consensus.cc:606] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:26.482779 26418 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.483171 26418 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.483569 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:28:26.484869 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:26.485786 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:26.494521 26418 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:26.496826 26418 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:26.497509 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:26.498109 25487 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.505067 25487 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:26.506925 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:26.507575 25564 raft_consensus.cc:3055] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:26.507869 25564 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:26.509835 26182 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:26.510970 26559 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:26.511462 26559 raft_consensus.cc:697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:26.508661 25564 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:26.512293 26559 consensus_queue.cc:237] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:26.512883 25564 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.523519 25564 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:26.524514 25315 catalog_manager.cc:5697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:26.634646 26518 raft_consensus.cc:993] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:26.635076 26523 raft_consensus.cc:1081] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:26.636396 25636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53066
I20260709 12:28:26.636871 25636 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.637238 25636 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:26.643610 25636 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.645295 25636 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:26.645807 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:26.646252 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:26.646551 25487 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:26.646831 25564 raft_consensus.cc:3055] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:26.647166 25564 raft_consensus.cc:740] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:26.647751 25564 consensus_queue.cc:260] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.648658 25564 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:26.651810 25487 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:26.653079 25609 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:26.653465 25564 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:26.654054 26524 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:26.654706 26524 raft_consensus.cc:697] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:26.655716 26524 consensus_queue.cc:237] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.673203 25315 catalog_manager.cc:5697] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 3, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:26.697841 26525 raft_consensus.cc:993] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:26.698474 26523 raft_consensus.cc:1081] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:26.700183 26418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:26.700740 26418 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.700924 26525 raft_consensus.cc:993] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:26.701119 26418 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.701543 26523 raft_consensus.cc:1081] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:26.703739 26415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1212a262e8424670b13c83406b35dae8"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:26.704205 26415 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.704555 26415 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.708444 26418 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:26.709882 26415 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:26.710907 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:26.711477 25560 raft_consensus.cc:3055] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:26.711727 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:26.711773 25560 raft_consensus.cc:740] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:26.712462 25636 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.715833 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:26.712754 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:26.712836 25560 consensus_queue.cc:260] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:26.719607 25487 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.719488 25564 raft_consensus.cc:3055] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:26.720202 25560 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.720407 25564 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:26.712286 26418 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:26.721323 25564 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:26.712779 26415 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:26.749492 26533 raft_consensus.cc:993] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:26.750025 26533 raft_consensus.cc:1081] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:26.751876 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53082
I20260709 12:28:26.752466 25634 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.752842 25634 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:26.753492 25636 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:26.755057 25560 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:26.755915 26180 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:26.756769 26561 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:26.757277 26561 raft_consensus.cc:697] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:26.758191 26561 consensus_queue.cc:237] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:26.763152 25634 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.749974 25564 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:26.766021 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:26.766619 25489 raft_consensus.cc:3055] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:26.766944 25489 raft_consensus.cc:740] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:26.767851 25489 consensus_queue.cc:260] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.768879 25489 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:26.768994 25634 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:26.770119 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:26.770720 25560 raft_consensus.cc:3060] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:26.776113 25489 raft_consensus.cc:2468] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:26.777274 25609 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:26.778345 26543 raft_consensus.cc:2804] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:26.818367 25487 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:26.820675 26182 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:26.821936 26562 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:26.822417 26562 raft_consensus.cc:697] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:26.823298 25560 raft_consensus.cc:2468] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:26.823366 26562 consensus_queue.cc:237] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:26.834978 25564 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:26.823693 26543 raft_consensus.cc:697] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:26.847466 26543 consensus_queue.cc:237] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.861018 25315 catalog_manager.cc:5697] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:26.869617 26525 raft_consensus.cc:993] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:26.870115 26525 raft_consensus.cc:1081] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:26.872365 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53066
I20260709 12:28:26.872978 25634 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.873493 25634 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:26.884629 25315 catalog_manager.cc:5697] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:26.888883 25634 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.895583 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:26.896209 25564 raft_consensus.cc:3055] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:26.896570 25564 raft_consensus.cc:740] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:26.897478 25564 consensus_queue.cc:260] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.898602 25564 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:26.908524 25564 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:26.909524 25608 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:26.910321 26570 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:26.910816 26570 raft_consensus.cc:697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:26.911752 26570 consensus_queue.cc:237] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:26.913619 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:26.914258 25489 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:26.924048 25489 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:26.927462 25489 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:26.928803 26561 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:26.929121 25315 catalog_manager.cc:5697] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 3, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:26.943251 25634 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:26.947515 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 75691.7us
I20260709 12:28:26.975069 25564 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:26.976568 26531 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:26.982858 25314 catalog_manager.cc:5697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:27.036389 25564 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:27.037849 26570 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:27.051594 25489 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:27.052762 26570 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:27.294230 25489 raft_consensus.cc:1275] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:27.295706 26524 consensus_queue.cc:1048] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:27.313853 25564 raft_consensus.cc:1275] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:27.314201 25560 raft_consensus.cc:1275] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:27.316229 26574 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:27.316485 26573 consensus_queue.cc:1048] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:27.320328 25634 raft_consensus.cc:1275] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.324862 25561 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.328631 26561 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.329895 25489 raft_consensus.cc:1275] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:27.332326 26543 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:27.334828 26530 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:27.393460 25560 raft_consensus.cc:1275] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.401288 25487 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:27.403023 26561 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.406174 26561 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:27.626971 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:28.771101 26598 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.771922 26598 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:28.778303 26598 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:28.781594 26599 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.781035 26598 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.782954 26598 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:28.784770 26599 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:28.787158 26598 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:28.787479 26599 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:28.856374 26601 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.857125 26601 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:28.858376 26182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.008s	sys 0.011s
I20260709 12:28:28.859746 26601 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:28.860044 26600 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
W20260709 12:28:28.860463 26182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.009s	sys 0.011s
I20260709 12:28:28.860737 26600 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:28.863068 26570 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:28.864081 26599 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:28.864377 26570 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.864797 26599 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:28.866917 26570 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:28.867479 26599 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:28.864028 26602 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:28.868988 26602 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.863260 26600 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:28.872552 26602 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:28.878655 26561 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.879398 26561 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:28.885815 25349 debug-util.cc:398] Leaking SignalData structure 0x7b080010f6a0 after lost signal to thread 20876
I20260709 12:28:28.887552 26599 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:28.888278 26599 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.891425 26599 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:28.883672 26606 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
W20260709 12:28:28.892237 26530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.000s	sys 0.014s
W20260709 12:28:28.892602 26530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.361s	user 0.000s	sys 0.015s
I20260709 12:28:28.892396 26606 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:28.895287 26606 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:28.895423 26599 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.895800 26606 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.896353 26606 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:28.896260 26599 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:28.902983 26599 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:28.906870 26606 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:28.908905 26606 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.917196 26531 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.918303 26531 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:28.920643 26599 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.921734 26599 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:28.909641 26606 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:28.931437 26610 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:28.928992 26570 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:28.941090 26601 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.966863 26601 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:28.967216 26522 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:28.968302 26522 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:28.970094 26601 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:28.970286 26522 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:28.970834 26601 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:28.971465 26601 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:28.941725 26570 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.958900 26600 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.957454 26602 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:28.985443 26613 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:28.959183 26608 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:28.983857 26530 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:28.989135 26530 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.990240 26611 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:28.990837 26611 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.976465 26531 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:28.991508 26530 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:28.973994 26610 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:28.994727 26609 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:28.989076 26601 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.007081 26522 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:28.996567 26599 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.010609 26522 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.995306 26606 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:28.992538 26602 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:28.995612 26600 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:28.995368 26613 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.021054 26531 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.022199 26611 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.021847 26531 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.022606 26613 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.022794 26611 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.023186 26613 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.023299 26611 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.023669 26613 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.024628 26531 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.025517 26570 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.026005 26611 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.026067 26570 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.026671 26570 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.017331 26606 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:28.995818 26608 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.028237 26606 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.030256 26608 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.030277 26606 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.030957 26612 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.031526 26612 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.011816 26601 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.013018 26615 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.033036 26601 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.033663 26615 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.034094 26612 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.037129 26522 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.037997 26602 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.020124 26561 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.042856 26602 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.046003 26602 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.044286 26615 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.047034 25489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43702 (request call id 865) took 1513 ms. Trace:
I20260709 12:28:29.008832 26609 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.047484 25489 rpcz_store.cc:276] 0709 12:28:27.533536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:29.046247 (+1512711us) service_pool.cc:224] Handling call
0709 12:28:29.046560 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:29.046722 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:29.046747 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:29.046785 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:29.046814 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:29.046864 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:29.046977 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:29.048425 26615 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.050024 26601 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.050653 26613 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.051833 26600 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.052433 26615 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.048822 26602 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.053745 26610 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.057595 26602 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.053737 26609 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.059423 26615 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.062978 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.058367 26602 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.066414 26533 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.067620 26533 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.069813 26533 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:29.071678 26562 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.539s	user 0.008s	sys 0.007s
I20260709 12:28:29.072028 26533 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.073458 26607 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.073980 26607 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.076099 26607 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.072605 26533 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.081699 26533 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.082870 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.085608 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.086331 25567 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
W20260709 12:28:29.072182 26562 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.540s	user 0.008s	sys 0.007s
I20260709 12:28:29.104455 26609 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.105679 26561 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.106696 26531 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.107383 26621 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.110251 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.111632 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.111919 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.114662 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.116168 26602 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.116982 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.126434 25491 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:29.126606 26401 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:29.127660 26522 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.125665 26408 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.130450 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.128808 26415 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:29.128720 26522 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.122870 26612 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.128707 26524 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.131974 26614 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.118953 26533 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.132247 26612 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.127651 26531 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.134408 26612 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.130684 26561 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.134794 26531 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.132544 26614 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.128906 26609 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.136636 26561 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.137094 26609 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.137377 26614 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.138226 26522 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.139267 26533 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.131057 26611 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.140755 26611 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.141506 26533 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.142758 26611 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.132427 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.127842 26610 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.146952 26610 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.145011 26621 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.148418 26418 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.149035 26610 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.149760 26621 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.150735 26614 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.151230 26614 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.152668 26618 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.153425 26618 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.154937 26617 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.155503 26620 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.155685 26612 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.156035 26620 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.156515 26612 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.155494 26617 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.158000 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.158604 26419 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.128010 26599 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.159356 26612 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.160152 26612 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.159974 26599 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.155519 26623 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.162465 26599 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.162200 26623 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.163183 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.163944 26420 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.164690 26605 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.132408 26524 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.165256 26605 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.165706 26603 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.166291 26603 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.166908 26623 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.167407 26524 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.167517 26605 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.159377 26617 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.168356 26603 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.153156 26614 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.168468 26609 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.169301 26561 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.169140 26609 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.169819 26561 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.171321 26609 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.171850 26609 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.172127 26604 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.172389 26609 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.172684 26604 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.174516 26609 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.174692 26604 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.178618 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.181864 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.168174 26605 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.183511 26605 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.185739 26605 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.186645 26543 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.187204 26543 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.188109 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.189520 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.189852 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.190521 25560 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:29.169039 26603 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.192850 26603 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.195047 26603 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.188028 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.196843 26618 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.197094 26418 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:29.160833 26612 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.198752 26570 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.199738 26612 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.171869 26561 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.203263 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.204833 26524 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.205309 26543 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.205478 26524 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.206938 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.207659 26415 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:29.207031 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.210680 26524 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.211521 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.207067 26620 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.212630 26627 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.213811 26602 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.214376 26602 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.216535 26602 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.216881 26561 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.217510 26561 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.218621 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.219146 26622 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.219653 26561 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.220175 26600 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.220762 26600 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.220254 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.220254 26543 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.222597 26543 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.223762 26613 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.224287 26613 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.224579 26543 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.224975 26619 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.225195 26543 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.225585 26619 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.225728 26543 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.226364 26613 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.225835 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.227839 26619 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.227957 25560 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.222851 26600 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.219687 26622 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.227833 26543 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.231612 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.232723 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.232951 26622 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.233424 25495 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.233495 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.234208 26419 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:29.234361 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.237273 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.237690 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.237922 25495 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.238435 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.239236 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.239861 25562 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.240077 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.213446 26627 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.241586 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.242095 26627 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.242909 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.244735 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.246670 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.247575 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.248163 25491 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.248956 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:29.249532 26180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.646s	user 0.012s	sys 0.004s
W20260709 12:28:29.249853 26180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.646s	user 0.012s	sys 0.004s
W20260709 12:28:29.250123 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 1.64659e+06us
I20260709 12:28:29.250280 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.252650 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.254391 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.256067 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.254848 26627 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.261566 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.262198 25634 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.258623 26619 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.263072 26619 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.265463 26619 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.266414 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.254391 26614 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.268386 26614 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.268750 26562 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.269016 26603 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.269095 26531 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.269397 26562 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.269690 26603 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.269748 26531 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.270628 26614 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.271490 26562 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.271842 26531 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.272840 26603 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.267042 25489 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.275286 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.275748 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.275883 25635 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.276475 25634 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.279378 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.279935 25636 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.280156 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.281055 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.281685 25636 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.282501 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.283136 26419 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:29.283313 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.283934 25637 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.284267 25535 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:29.285079 25349 debug-util.cc:398] Leaking SignalData structure 0x7b080033e660 after lost signal to thread 25352
I20260709 12:28:29.286326 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.286670 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.288699 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.289659 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.290855 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.291458 26415 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:29.292678 25313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57464 (request call id 146) took 1799 ms. Trace:
I20260709 12:28:29.294620 25313 rpcz_store.cc:276] 0709 12:28:27.496233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.531779 (+ 35546us) service_pool.cc:224] Handling call
0709 12:28:29.292496 (+1760717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":288,"reported_tablets":2}
I20260709 12:28:29.295195 25315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47518 (request call id 69) took 1766 ms. Trace:
I20260709 12:28:29.295619 25315 rpcz_store.cc:276] 0709 12:28:27.529157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.529314 (+   157us) service_pool.cc:224] Handling call
0709 12:28:29.295128 (+1765814us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103315,"reported_tablets":1}
I20260709 12:28:29.296454 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:29.293038 25349 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9f00 after lost signal to thread 25519
I20260709 12:28:29.298277 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.294054 25314 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57448 (request call id 169) took 1870 ms. Trace:
I20260709 12:28:29.298852 25314 rpcz_store.cc:276] 0709 12:28:27.423675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.468902 (+ 45227us) service_pool.cc:224] Handling call
0709 12:28:29.293998 (+1825096us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":214171,"reported_tablets":1}
I20260709 12:28:29.300117 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.283360 26593 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.297049 25637 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.292750 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.305898 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.306620 25569 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.292033 26627 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:29.308995 25349 debug-util.cc:398] Leaking SignalData structure 0x7b0800260620 after lost signal to thread 25593
W20260709 12:28:29.310295 25349 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba260 after lost signal to thread 25667
I20260709 12:28:29.310621 26627 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:29.311568 25349 debug-util.cc:398] Leaking SignalData structure 0x7b0800399660 after lost signal to thread 26448
I20260709 12:28:29.310317 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.314396 26617 raft_consensus.cc:2804] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.314867 26617 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.315264 26617 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.317916 26593 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.320363 26593 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.329696 26617 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.330930 25561 raft_consensus.cc:1240] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.332463 26617 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.334283 25561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:29.334889 25561 raft_consensus.cc:606] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.336534 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.338394 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.338985 25643 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.338908 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.339836 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.340617 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.340951 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.341240 26415 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:29.336966 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.342672 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.344172 25561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:29.345130 25561 raft_consensus.cc:606] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.347918 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.348605 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.350297 25562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:29.351114 25562 raft_consensus.cc:606] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.366675 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.369474 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.370666 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.371225 25564 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.371819 26182 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.372277 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.373301 26182 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.373695 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.374449 25567 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.374639 26596 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.375268 26596 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.375764 26596 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.377416 26593 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.377981 26593 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.378492 26593 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.380128 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.381098 25460 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.382400 26607 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:29.382764 26607 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.383126 26607 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:29.384923 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.391330 26607 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.397667 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.399161 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.399793 25492 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:29.401584 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.404035 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.404206 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.404994 25636 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.406688 26182 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.406906 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.407603 26603 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.408093 26603 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.408546 26603 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.409159 25460 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.411154 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.412328 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.414496 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.416021 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.418313 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.418825 26607 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.423053 25460 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.423528 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.425154 26626 raft_consensus.cc:2804] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.425640 26626 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.426004 26626 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.426106 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.426754 25562 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.427567 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.429360 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.424264 26603 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.434252 25460 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.435379 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.435976 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.436120 25489 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:29.436017 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.435894 26611 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.437124 26420 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:29.438062 26611 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.438511 26611 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.439091 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.441560 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.441579 25532 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.443169 26628 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:29.443583 26628 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.443950 26628 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:29.443213 26610 raft_consensus.cc:993] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:29.445405 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.445766 25460 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.446839 26612 raft_consensus.cc:2804] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.447284 26612 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.447692 26612 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.449335 26614 raft_consensus.cc:1081] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:29.449566 26419 raft_consensus.cc:1240] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.407218 25561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:29.451362 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.452368 26596 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.454201 26603 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.455467 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.456212 25639 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:29.457319 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.457604 25532 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.458789 26180 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.459371 26625 raft_consensus.cc:2749] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:29.460564 26603 raft_consensus.cc:2749] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.454428 26596 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.451505 25561 raft_consensus.cc:606] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.434820 26607 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:29.473245 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.474046 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.474442 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.475448 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.476205 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.476918 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.488250 26628 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.477530 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.477607 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.477882 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.491089 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.478274 25532 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.491057 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.496263 26610 raft_consensus.cc:2804] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.496675 26610 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.497120 26610 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.473675 26180 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.481611 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.481827 26625 raft_consensus.cc:993] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:29.491631 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.498158 26180 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.498469 26625 raft_consensus.cc:1081] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:29.482005 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.482528 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.500371 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.501102 25489 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:29.501474 26603 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.501964 26603 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.502077 25561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:29.502875 25561 raft_consensus.cc:606] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.485877 26607 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.503306 26180 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.502422 26603 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.424117 26593 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.503477 26607 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:29.504712 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:29.506568 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:29.507324 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:29.502931 26596 raft_consensus.cc:2804] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.509009 26596 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.509488 26596 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.492470 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.516772 26627 raft_consensus.cc:993] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:29.517390 26627 raft_consensus.cc:1081] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:29.517623 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.518826 26593 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.519024 26418 raft_consensus.cc:1240] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.446835 25460 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.520714 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.480628 26612 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.521307 26626 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.520032 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.520817 26618 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.522255 26618 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.522723 26618 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.523471 26626 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.492040 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.524374 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:29.520709 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 73930us
I20260709 12:28:29.526837 25460 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.527290 26628 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.529408 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.530236 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.530942 25636 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.530411 26612 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.535027 26180 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.535311 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.536586 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.536725 26180 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.537707 26561 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.537945 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.538197 26561 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.538602 26561 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.547240 25458 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.540335 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.540608 26612 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.545606 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:29.540606 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.557708 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.549469 26531 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.556061 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.558460 26531 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.540356 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.549953 26180 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.549645 26610 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.556093 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.557214 26612 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.559823 26612 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.560120 26597 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.481029 26611 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.560990 26597 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.561626 26597 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.561720 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.562893 26611 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.559043 26531 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.563980 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.567270 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.568261 26626 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.568783 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.540830 26618 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.569314 25458 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.570317 26598 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.570735 26598 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.571029 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.571141 26598 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.571506 26618 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.571687 26562 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.568759 26626 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.572629 26626 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.574364 26610 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.554140 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.575651 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.576998 26561 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.577234 26180 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.577847 25458 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.578080 26562 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.585539 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.585723 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.585960 26562 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.586033 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.586467 26562 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.579622 26561 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.580147 26180 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.571415 26531 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.587445 26621 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.587834 26621 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.588186 26621 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.580521 26626 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.538895 26593 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.592813 26593 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.593266 26593 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.594276 26180 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.594570 26626 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.595080 26605 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.595463 26605 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.595850 26605 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.595682 26598 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.596472 26562 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.597946 25458 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.598114 26626 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.598687 26623 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.599069 26623 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.553921 26603 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.599092 25458 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.600632 26624 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:29.584002 26596 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.590293 26531 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.599622 26623 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.603775 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.585050 26597 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.607123 26597 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.602625 26180 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.607961 25606 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.608187 26531 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.608574 26531 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.608786 26622 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:29.608980 26531 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.609298 26622 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.609702 26622 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:29.610630 26596 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.598495 26626 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.605373 26603 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.611510 26626 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.613094 25532 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.614254 26610 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.616036 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:29.617266 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.618275 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.618364 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.619277 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.619829 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.620363 26562 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.620745 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.621397 26404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:29.621186 26621 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.622010 26404 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:29.622198 26598 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.622449 26404 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.539927 26607 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.623960 25492 raft_consensus.cc:1240] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:29.624963 26418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:29.625451 26607 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.625546 26418 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:29.600731 26593 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.629575 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.626071 26418 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.601110 26624 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:29.633360 26624 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:29.633410 26623 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.633888 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.634209 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.635525 26623 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.635608 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.637331 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.640699 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.646999 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.625756 26612 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.646938 26418 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.647631 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.648269 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.628301 25458 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.632845 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.641534 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.650040 26531 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.652025 25458 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.652180 26531 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.652834 26572 consensus_queue.cc:1059] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:29.653127 25458 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.653923 26572 raft_consensus.cc:3055] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:29.654270 26572 raft_consensus.cc:740] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:29.654747 26607 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.655232 26607 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.655085 26572 consensus_queue.cc:260] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.655704 26607 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.656311 26572 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.656792 26598 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.657306 26598 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.652201 26610 consensus_queue.cc:1059] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:28:29.657847 26598 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.643636 26624 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.658491 26610 raft_consensus.cc:3055] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:29.658856 26610 raft_consensus.cc:740] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:29.659670 26610 consensus_queue.cc:260] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.660775 26610 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.663405 26626 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.673341 26626 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.644904 26593 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.645941 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.646176 26622 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.682847 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.657339 26597 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.674929 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.689980 26597 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.677246 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.694295 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.677559 26404 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.694943 25568 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.696523 26404 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.678256 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.678637 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.678953 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.694406 26597 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.698829 26607 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.679760 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:29.679951 26402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:29.680110 25486 raft_consensus.cc:1240] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.681061 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.700043 26402 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:29.700500 26402 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.704411 25609 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.705268 26619 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.708197 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.708981 25565 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.708648 26402 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.709793 25493 raft_consensus.cc:1240] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.710012 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.711025 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.711476 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.681351 26182 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.684068 26612 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.626021 26621 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.712443 26406 raft_consensus.cc:1240] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.712872 26621 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.684751 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.644415 25608 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:28:29.714053 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 69713.5us
I20260709 12:28:29.713663 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.714519 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.715204 25608 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.715365 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:29.715987 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 46500.9us
I20260709 12:28:29.716326 26573 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:29.716763 26573 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.717128 26573 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:29.717289 25606 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.717973 26524 raft_consensus.cc:2749] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.719987 26524 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.713529 25486 raft_consensus.cc:1240] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.684950 26622 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.674259 26605 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.685863 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.689422 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.721985 25569 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.676198 25487 raft_consensus.cc:1240] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:29.692162 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.682775 26531 consensus_queue.cc:1059] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:28:29.693471 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.723428 25459 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.682317 26624 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.723920 25564 raft_consensus.cc:2393] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 3: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:29.693728 25566 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.699335 25494 raft_consensus.cc:1240] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.725735 25606 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.681712 26408 raft_consensus.cc:1240] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.728152 25609 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.729548 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.729214 26598 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.730288 25566 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.730981 25459 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.712908 26182 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.731799 26612 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.732524 26621 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.732841 26182 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.733628 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.734362 26613 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.735301 26621 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.735569 25609 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.735776 26621 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.736182 26621 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.736340 26600 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.737342 26619 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:29.737708 26619 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:29.738082 26619 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.738276 25606 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.740002 26524 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.740882 26593 raft_consensus.cc:3055] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:29.741267 26593 raft_consensus.cc:740] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:29.742059 26593 consensus_queue.cc:260] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.742776 25606 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.743224 26593 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.743618 26613 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.744839 25606 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.750190 26605 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.751770 26621 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.752935 25565 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.650074 26418 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.712370 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.724290 26624 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:29.754534 26624 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:29.754946 26624 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:29.755267 26619 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.737351 26598 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.760596 25459 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.682111 26181 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:29.753437 25532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:29.761361 26613 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:29.761762 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 79720.1us
I20260709 12:28:29.762481 25609 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.763079 25606 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.763238 26613 consensus_queue.cc:1059] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:29.763722 26624 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.767143 25568 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.765060 26408 raft_consensus.cc:1240] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.765182 25609 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.765887 25459 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.766937 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.767203 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.783663 26623 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.764698 26612 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:29.783872 25459 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.784300 26612 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:29.784772 26612 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.784857 26623 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.785387 25460 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.786185 26623 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:29.786684 26623 raft_consensus.cc:697] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.786850 25459 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.787606 26623 consensus_queue.cc:237] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.788383 26590 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:29.768486 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.789127 25459 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.792196 26626 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:29.789729 26622 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:29.768710 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.769526 25563 raft_consensus.cc:1240] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.769464 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.794756 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.796075 26612 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.770196 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.770843 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.797475 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.798110 25491 raft_consensus.cc:2393] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 3: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:29.768847 26418 raft_consensus.cc:1240] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.771224 26562 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.771522 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.772831 26530 consensus_queue.cc:1059] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:29.799998 26530 raft_consensus.cc:3055] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:29.800374 26530 raft_consensus.cc:740] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:29.773566 26600 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.774008 26602 raft_consensus.cc:2749] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.775507 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.802992 26530 consensus_queue.cc:260] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.803838 26404 raft_consensus.cc:1240] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.804214 26530 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.804342 25564 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.791047 25609 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.806566 25609 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.807248 26600 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.807586 25609 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.807919 26600 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.775741 26613 raft_consensus.cc:3055] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:29.809062 26619 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:29.809267 26613 raft_consensus.cc:740] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:29.810215 26613 consensus_queue.cc:260] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.811539 26613 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:29.776487 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.776782 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.776487 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.761348 26573 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.777719 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.778362 26621 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.779742 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.779456 26597 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.817373 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.817963 25493 raft_consensus.cc:2393] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:29.818243 26573 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.781311 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.818753 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:29.781567 26531 consensus_queue.cc:1059] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:29.820399 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.792164 25459 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.770987 26624 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:29.711088 26402 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.822589 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.822947 26624 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.820475 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.823343 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.821882 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.823853 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.820286 26621 raft_consensus.cc:3055] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:29.828045 26621 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:29.828136 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.828449 25459 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.826879 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.827346 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.827567 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.829021 25567 raft_consensus.cc:2393] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:29.826548 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:29.828979 26621 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.830672 26621 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.820020 25460 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.833367 26622 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.833971 25565 raft_consensus.cc:1240] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.839071 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.840154 26624 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:29.841007 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.828969 26597 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.842474 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.805560 25566 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.845101 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.845273 25532 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.846071 26610 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.846383 26406 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.847800 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.847031 26404 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.848379 25532 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.848563 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.848400 25638 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.849897 26626 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:29.850191 25535 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.850462 26626 raft_consensus.cc:697] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.850975 26572 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:29.851658 26572 raft_consensus.cc:2764] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:28:29.851368 26626 consensus_queue.cc:237] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.852854 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.855700 25460 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.835693 25609 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.856909 26607 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:29.857656 26619 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.858263 26610 consensus_queue.cc:1059] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:29.858974 25460 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.859097 25609 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.859725 26572 raft_consensus.cc:3055] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:29.859792 26619 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.860252 26572 raft_consensus.cc:740] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:29.847086 25459 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.861155 26624 raft_consensus.cc:2804] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:29.861708 26624 raft_consensus.cc:697] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.861313 26572 consensus_queue.cc:260] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.861991 26598 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:29.862427 26572 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.862860 26611 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:29.862598 26624 consensus_queue.cc:237] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.862514 26598 raft_consensus.cc:697] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.864701 26404 raft_consensus.cc:1240] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.864565 26598 consensus_queue.cc:237] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.863440 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.858546 26612 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:29.867184 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.867542 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.868423 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.868952 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:29.868997 25609 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.869951 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.874023 25636 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.874102 26418 raft_consensus.cc:2393] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 3: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:29.875138 26628 consensus_queue.cc:1059] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:29.876101 26625 raft_consensus.cc:3055] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:29.876482 26625 raft_consensus.cc:740] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:29.874015 26614 consensus_queue.cc:1059] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:28:29.877627 26625 consensus_queue.cc:260] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.878386 26628 raft_consensus.cc:3055] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:29.878787 26628 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:29.878957 26625 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.879772 26628 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.881188 26619 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.882359 25609 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.883332 26628 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.884059 25636 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.885536 25609 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.885578 25459 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.888068 25459 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.888653 25535 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.886049 26180 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.886447 26619 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.889621 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.891775 26597 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:29.893533 26180 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.893388 25609 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.893409 26573 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.894829 26614 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.895972 26530 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.895037 26531 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.896823 25638 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.901027 26573 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.902586 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.903251 25609 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.895677 25568 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:29.904798 26573 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.906057 25609 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.899817 26180 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.909490 26402 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:29.911435 26406 raft_consensus.cc:1240] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.914451 26180 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.915846 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.916594 26530 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.917512 26530 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.919796 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:29.920202 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.920672 25566 raft_consensus.cc:2393] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:29.921031 26406 raft_consensus.cc:2393] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:29.923177 25495 raft_consensus.cc:1240] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.924613 26180 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.926476 26180 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.928709 26418 raft_consensus.cc:1240] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:29.929689 25318 catalog_manager.cc:5697] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 2 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:29.931305 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.932153 26406 raft_consensus.cc:2393] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:29.928603 25535 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.933259 25568 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:29.932983 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.934760 26628 raft_consensus.cc:2764] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:28:29.935369 26530 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.936057 26530 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.914031 26613 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.937148 26621 consensus_queue.cc:1059] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:29.937759 25606 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.938315 26530 raft_consensus.cc:3055] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:29.938885 26573 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.941001 25460 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:29.943298 25458 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.938695 26530 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:29.942291 26180 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:29.944726 26619 consensus_queue.cc:1059] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:29.944967 26590 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.945088 25458 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.949545 26418 raft_consensus.cc:1240] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.947395 25535 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.949491 25458 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:29.951139 25535 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.946364 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:29.951778 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:29.945363 26622 consensus_queue.cc:1059] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:29.943243 26626 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:29.961094 25608 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.962469 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.963709 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.964031 26617 consensus_queue.cc:1059] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:29.948153 26611 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:29.946746 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.956068 26593 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:29.970394 26530 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.971293 26181 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.945957 26597 consensus_queue.cc:1059] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:28:29.971741 26530 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:29.972442 26597 raft_consensus.cc:3055] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:29.972533 26603 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:29.972829 26597 raft_consensus.cc:740] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.956497 26618 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.973037 25608 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:29.969790 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:29.974128 25495 raft_consensus.cc:1240] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:29.973747 26597 consensus_queue.cc:260] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.974582 26406 raft_consensus.cc:2393] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:29.970963 26593 raft_consensus.cc:697] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:29.970290 26611 raft_consensus.cc:697] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.976013 26181 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.976646 26619 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.956346 26628 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:29.968554 26614 consensus_queue.cc:1059] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:28:29.974159 26570 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.977216 26531 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.970506 26613 raft_consensus.cc:3055] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:29.977720 26614 raft_consensus.cc:3055] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:29.977948 26613 raft_consensus.cc:740] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:29.978169 26614 raft_consensus.cc:740] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:29.978403 26181 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.978874 26613 consensus_queue.cc:260] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:29.979528 26531 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.976096 26593 consensus_queue.cc:237] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.979127 26614 consensus_queue.cc:260] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.975189 26597 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.957283 26625 raft_consensus.cc:2764] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:28:29.981099 26614 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.965312 26617 raft_consensus.cc:3055] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:29.981887 26617 raft_consensus.cc:740] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:29.982787 26617 consensus_queue.cc:260] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:29.984210 26617 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:29.987334 25609 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:29.987663 26181 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.988256 26570 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:29.978914 25638 raft_consensus.cc:1240] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:29.966657 26626 raft_consensus.cc:697] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.990828 26626 consensus_queue.cc:237] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:29.976177 26611 consensus_queue.cc:237] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:29.966881 26624 raft_consensus.cc:2804] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:29.995388 26624 raft_consensus.cc:697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:29.992888 26181 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:29.999053 26181 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:30.002563 26562 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.002918 26624 consensus_queue.cc:237] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:30.003837 26181 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:30.001322 26621 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.016013 25638 raft_consensus.cc:1240] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.027499 26613 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:30.030148 26181 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:30.030411 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 81009.4us
I20260709 12:28:30.031325 25642 raft_consensus.cc:1240] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:30.032850 26181 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:30.033535 25639 raft_consensus.cc:1240] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:30.034762 26562 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.035780 26628 consensus_queue.cc:1059] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.036402 26543 raft_consensus.cc:3055] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:30.036836 26628 raft_consensus.cc:3055] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:30.037302 26628 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:30.038169 26628 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.038862 26401 raft_consensus.cc:1240] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.039408 26628 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.041075 26602 consensus_queue.cc:1059] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:28:30.042223 26602 raft_consensus.cc:3055] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:30.042546 26602 raft_consensus.cc:740] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:30.043355 26602 consensus_queue.cc:260] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.044498 26602 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.033234 26605 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.050248 26181 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:30.051307 26621 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.052039 26621 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:30.036832 26543 raft_consensus.cc:740] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:30.053422 26543 consensus_queue.cc:260] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.054147 26181 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:30.054610 26543 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.055557 26402 raft_consensus.cc:1240] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:30.057474 26181 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:30.061081 25495 raft_consensus.cc:1240] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:30.059335 26621 raft_consensus.cc:2749] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:30.062536 26593 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.059384 26531 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.063504 26617 consensus_queue.cc:1059] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.064610 26617 raft_consensus.cc:3055] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:30.064908 26617 raft_consensus.cc:740] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:30.065477 25458 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.065713 26598 consensus_queue.cc:1059] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.066037 26628 consensus_queue.cc:1059] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.066777 26598 raft_consensus.cc:2749] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:30.067209 26625 raft_consensus.cc:3055] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:30.067344 26618 raft_consensus.cc:3055] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:30.067647 26625 raft_consensus.cc:740] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:30.067631 26605 consensus_queue.cc:1059] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.068862 26605 raft_consensus.cc:3055] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:30.068813 26625 consensus_queue.cc:260] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.070612 26625 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:30.069348 26605 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.073947 26605 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.075501 26605 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:30.066715 25458 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.077863 26618 raft_consensus.cc:740] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:30.078017 26593 raft_consensus.cc:697] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.079047 26623 raft_consensus.cc:2749] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:30.078744 26618 consensus_queue.cc:260] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.079478 26593 consensus_queue.cc:237] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:30.065740 26617 consensus_queue.cc:260] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:30.080205 26618 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.078230 25458 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.092545 26617 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:30.094740 25314 catalog_manager.cc:5697] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.098810 26607 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:30.101094 26543 consensus_queue.cc:1059] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.102245 26573 raft_consensus.cc:3055] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:30.102640 26573 raft_consensus.cc:740] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:30.000538 26530 consensus_queue.cc:1059] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:28:30.097517 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.104131 25493 raft_consensus.cc:1240] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.105688 25492 raft_consensus.cc:1240] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.107749 25458 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.110325 26531 raft_consensus.cc:3055] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:30.110765 26531 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.109247 26618 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.107206 26611 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:30.114547 26623 consensus_queue.cc:1059] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:28:30.120220 26597 raft_consensus.cc:3055] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:30.120590 26597 raft_consensus.cc:740] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:30.115223 26573 consensus_queue.cc:260] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:30.121925 26573 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:30.113684 26543 consensus_queue.cc:1059] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:28:30.122717 26543 consensus_queue.cc:1243] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer bf67e247c9e5443ea0099083f496b361 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:28:30.123253 26543 raft_consensus.cc:3055] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:30.123569 26543 raft_consensus.cc:740] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:30.124398 26543 consensus_queue.cc:260] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:30.117849 26618 consensus_queue.cc:1059] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:28:30.126184 26597 consensus_queue.cc:260] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.127625 26597 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.130213 26543 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:30.132781 26402 raft_consensus.cc:1240] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.114854 26531 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.135793 26611 raft_consensus.cc:3055] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:30.136176 26611 raft_consensus.cc:740] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:30.138955 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.142138 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.148957 25568 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:30.150103 25566 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:30.149835 26611 consensus_queue.cc:260] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.151356 26611 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:30.152252 25566 raft_consensus.cc:1240] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:30.116647 25458 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.137063 26531 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:30.156030 26618 raft_consensus.cc:2749] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.158313 25565 raft_consensus.cc:1240] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.160728 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.161226 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.161448 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.182628 26401 raft_consensus.cc:1240] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.167999 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.185026 26415 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:30.185660 25495 raft_consensus.cc:1240] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:30.169358 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.170097 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.170608 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:30.173743 25608 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.204957 25561 raft_consensus.cc:2393] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:30.205372 26543 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:30.206540 25563 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:30.206645 26181 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:30.207876 26621 raft_consensus.cc:2749] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.210119 25567 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:30.202574 25560 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:30.153755 26617 consensus_queue.cc:1059] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:28:30.211747 25608 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.213624 26181 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:30.200692 25564 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:30.215823 25569 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:30.218493 26543 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:30.218732 26181 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:30.226811 26543 raft_consensus.cc:697] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:30.227604 26181 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:30.227727 26543 consensus_queue.cc:237] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.228549 26605 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:30.218878 26621 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:30.229070 26605 raft_consensus.cc:697] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.229457 26621 raft_consensus.cc:697] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.230331 26605 consensus_queue.cc:237] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.230387 26621 consensus_queue.cc:237] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:30.232144 26561 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:30.232486 26640 consensus_queue.cc:1059] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.221941 26600 consensus_queue.cc:1059] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.218902 26625 raft_consensus.cc:3055] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:30.221297 26613 consensus_queue.cc:1059] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.232666 26561 raft_consensus.cc:697] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.228801 26618 consensus_queue.cc:1059] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:28:30.225082 25562 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:30.228823 26181 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:30.235657 26624 consensus_queue.cc:1059] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:28:30.242676 26636 raft_consensus.cc:3055] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:30.242803 26613 raft_consensus.cc:3055] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:30.243259 26636 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:30.234658 26625 raft_consensus.cc:740] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:30.245129 26561 consensus_queue.cc:237] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:30.246467 26607 raft_consensus.cc:3055] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:30.247062 25562 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.247030 26607 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:30.243360 26613 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:30.234578 26600 raft_consensus.cc:3055] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:30.257527 26600 raft_consensus.cc:740] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:30.258291 26415 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.258603 26600 consensus_queue.cc:260] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.259047 26625 consensus_queue.cc:260] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:30.260213 26600 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.260502 26625 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:30.244668 26636 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.262038 26636 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:30.262633 26607 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:30.263895 26607 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.257071 26618 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:28:30.273108 25567 raft_consensus.cc:1275] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.275377 26598 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.275933 26613 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.276216 26607 consensus_queue.cc:1048] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:30.269014 26626 consensus_queue.cc:1175] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:28:30.255668 26593 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.281663 26181 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:30.283900 26593 raft_consensus.cc:697] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.286252 26531 raft_consensus.cc:2804] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.285215 26593 consensus_queue.cc:237] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.314956 26613 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:30.319646 25564 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:30.319375 25315 catalog_manager.cc:5697] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.317620 25569 raft_consensus.cc:1275] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.331040 26401 raft_consensus.cc:1275] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.339399 26607 consensus_queue.cc:1048] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.342036 25493 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:30.318529 26531 raft_consensus.cc:697] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:30.356082 26614 consensus_queue.cc:1059] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.354723 26597 consensus_queue.cc:1048] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:28:30.367719 26614 raft_consensus.cc:3055] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:30.368202 26614 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:30.369195 26614 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:30.375455 25642 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.375326 26531 consensus_queue.cc:237] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:30.381541 26597 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.386494 26614 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:30.410112 26401 raft_consensus.cc:1275] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.440495 25567 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.444262 26597 consensus_queue.cc:1048] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:30.454870 26419 raft_consensus.cc:1275] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.449880 26621 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:28:30.476146 26590 consensus_queue.cc:1048] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:28:30.488188 25569 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.492851 26597 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.528388 26401 raft_consensus.cc:1275] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.530164 25642 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.538938 26636 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.539996 26621 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.571247 25562 raft_consensus.cc:1275] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.573328 26590 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.607146 25639 raft_consensus.cc:1275] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.608042 25315 catalog_manager.cc:5697] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:30.611690 25560 raft_consensus.cc:1275] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.613787 26623 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.635360 26636 consensus_queue.cc:1048] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:30.629537 25313 catalog_manager.cc:5697] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 2 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.644620 25564 raft_consensus.cc:1275] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:30.644743 25495 raft_consensus.cc:1275] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.651000 25313 catalog_manager.cc:5697] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.655441 26401 raft_consensus.cc:1275] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.656459 25560 raft_consensus.cc:1275] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.657743 26613 consensus_queue.cc:1048] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.666298 26593 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.658416 26621 consensus_queue.cc:1048] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.666455 25313 catalog_manager.cc:5697] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.669152 25313 catalog_manager.cc:5697] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 2 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.676905 26607 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.683465 25313 catalog_manager.cc:5697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 2 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.699960 25569 raft_consensus.cc:1275] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.703385 25564 raft_consensus.cc:1275] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.705098 26605 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.706701 26605 consensus_queue.cc:1048] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.716646 26401 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:30.717481 25639 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:30.726739 26401 raft_consensus.cc:1275] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:30.735611 26613 consensus_queue.cc:1048] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.736112 25639 raft_consensus.cc:1275] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.739272 26605 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:30.758862 25562 raft_consensus.cc:1275] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.760454 26605 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.780484 26625 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:30.781299 26625 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:30.784718 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:30.785552 25495 raft_consensus.cc:2393] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:30.789016 26625 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:30.793053 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:30.793846 25639 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:30.796828 25533 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:30.797945 26614 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:30.798323 26614 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:30.798679 26614 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:30.804385 25495 raft_consensus.cc:1275] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.806126 26530 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.805588 25318 catalog_manager.cc:5697] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.808712 25318 catalog_manager.cc:5697] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 3, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.813156 25562 raft_consensus.cc:1275] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.811614 25318 catalog_manager.cc:5697] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 3, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.826164 25318 catalog_manager.cc:5697] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.827857 25318 catalog_manager.cc:5697] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.828424 26530 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:30.830690 25639 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.836548 25493 raft_consensus.cc:1275] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:30.839198 26530 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:30.842706 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:30.842214 25318 catalog_manager.cc:5697] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 3, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.806876 26614 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:30.850215 26614 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:30.851107 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:30.852082 25492 raft_consensus.cc:2393] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:30.852151 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:30.855254 25639 raft_consensus.cc:1275] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.856804 26530 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.876571 25642 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:30.878971 25533 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:30.882635 26614 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:30.897949 26614 raft_consensus.cc:697] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:30.914469 26614 consensus_queue.cc:237] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:30.895368 25642 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.922984 25560 raft_consensus.cc:1275] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.925982 26530 consensus_queue.cc:1048] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:30.935830 25642 raft_consensus.cc:1275] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:30.951061 26530 consensus_queue.cc:1048] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:30.964985 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:30.965682 25493 raft_consensus.cc:606] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Received request to transfer leadership to TS 05cabf76554146489f61260dbdadf659
I20260709 12:28:30.970789 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:30.971530 25493 raft_consensus.cc:606] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.974378 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:30.975063 25493 raft_consensus.cc:606] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.984679 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:30.985417 25493 raft_consensus.cc:606] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Received request to transfer leadership to TS 05cabf76554146489f61260dbdadf659
I20260709 12:28:30.992311 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:30.992940 25493 raft_consensus.cc:606] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:30.993345 25493 raft_consensus.cc:614] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:30.995604 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:30.997416 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:30.998219 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:31.040311 25318 catalog_manager.cc:5697] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 4, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:31.076328 26590 raft_consensus.cc:993] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:31.076831 26590 raft_consensus.cc:1081] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:31.078622 26401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:31.079242 26401 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.079659 26401 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.091598 26597 raft_consensus.cc:993] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:31.092144 26597 raft_consensus.cc:1081] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Signalling peer 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:31.093309 26401 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.093895 25560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9"
dest_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:39666
I20260709 12:28:31.094465 25560 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.094851 25560 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.096612 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.097275 25493 raft_consensus.cc:3055] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:31.097607 25493 raft_consensus.cc:740] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:31.098480 25493 consensus_queue.cc:260] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.099757 25493 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.097298 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:31.101393 26401 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.101869 25642 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.109966 25642 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:31.116969 26180 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.113791 26590 raft_consensus.cc:993] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:31.113622 25560 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.118772 26590 raft_consensus.cc:1081] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:31.119853 25560 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.121385 26530 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:31.121968 26530 raft_consensus.cc:697] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:31.122911 26530 consensus_queue.cc:237] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.126282 26415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:31.117281 25493 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:31.132513 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.145253 25492 raft_consensus.cc:3055] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:31.145622 25492 raft_consensus.cc:740] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:31.146505 25492 consensus_queue.cc:260] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.146906 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:31.147533 26401 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.147830 25492 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.126914 26415 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.149493 26415 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.162130 26415 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.163367 26401 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:31.169406 25532 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.170181 26614 raft_consensus.cc:2804] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:31.170696 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.170665 26614 raft_consensus.cc:697] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:31.171429 25493 raft_consensus.cc:3055] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:31.172055 25493 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:31.172456 26614 consensus_queue.cc:237] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.172930 25493 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.176263 25493 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.182286 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:31.167586 25492 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:31.182895 25560 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.183269 26415 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:31.189208 25493 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:31.190663 26543 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.192502 26543 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.195060 26543 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:31.190976 25560 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:31.196410 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.197118 25492 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:31.198490 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:31.199767 26182 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.200712 26561 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:31.199790 25609 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.201318 26561 raft_consensus.cc:697] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:31.202256 26561 consensus_queue.cc:237] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.202755 26543 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:31.203198 26543 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.203528 26543 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:31.213800 26597 raft_consensus.cc:993] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:31.214380 26597 raft_consensus.cc:1081] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Signalling peer 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:31.223356 25569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041"
dest_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:39666
I20260709 12:28:31.224009 25569 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.224395 25569 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.239817 26543 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.242830 26543 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:31.243155 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.242642 25313 catalog_manager.cc:5697] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 3, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:31.243754 25493 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:31.250671 25493 raft_consensus.cc:2468] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:31.253257 25609 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.254657 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:31.267052 26543 raft_consensus.cc:2804] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:31.267657 26543 raft_consensus.cc:697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:31.257256 25318 catalog_manager.cc:5697] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.268416 26543 consensus_queue.cc:237] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.278721 25313 catalog_manager.cc:5697] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:31.279062 25569 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.290968 25569 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.292383 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:31.294164 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.294761 25493 raft_consensus.cc:3055] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:31.295044 25493 raft_consensus.cc:740] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:31.295781 25493 consensus_queue.cc:260] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.296815 25318 catalog_manager.cc:5697] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.293025 26415 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.296998 25493 raft_consensus.cc:3060] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.329351 26415 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:31.330596 25532 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.331638 26694 raft_consensus.cc:2804] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:31.351312 26694 raft_consensus.cc:697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:31.352495 26694 consensus_queue.cc:237] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.351064 25493 raft_consensus.cc:2468] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:31.374382 25313 catalog_manager.cc:5697] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 4, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.384126 25642 raft_consensus.cc:1275] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:31.387315 26694 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:31.388579 26623 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.389124 26623 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.391207 26623 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.393491 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.394053 26415 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:31.396310 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.397234 25458 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.398319 26597 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:31.398682 26597 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.399009 26597 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.406392 25493 raft_consensus.cc:1275] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:31.411283 26597 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.414324 26597 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.414762 26617 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:31.428489 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:31.428876 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:31.429600 26419 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.442883 26617 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.443488 26617 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.446033 26617 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.446167 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.447088 26415 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:31.448535 26419 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:31.448901 25532 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.449966 25458 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:31.450148 26617 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:31.451610 26617 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.452035 26617 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.454075 26597 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:31.454638 26597 raft_consensus.cc:697] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:31.455564 26597 consensus_queue.cc:237] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.463646 26617 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.465916 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.467579 25493 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:31.468809 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:31.469532 26419 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.472097 26623 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.472671 26623 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.474751 26623 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.475862 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.468869 26617 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.476521 25639 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:31.478018 25459 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.479416 26623 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:31.479796 26623 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.481313 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.480854 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.482033 25493 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.481988 26415 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:31.481462 26623 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.490123 25493 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:31.491891 25535 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.492075 26419 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:31.492753 26617 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:31.493518 26617 raft_consensus.cc:697] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:31.495285 26696 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:31.496104 26623 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.495872 26696 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.499233 26530 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.499811 26623 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.499775 26530 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.501055 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.501564 26696 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:31.501855 25493 raft_consensus.cc:2393] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:31.502413 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:31.503240 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:31.494352 26617 consensus_queue.cc:237] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.501586 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:31.503903 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.504655 25639 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.504849 25638 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:31.506657 26180 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.507174 26597 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.507498 26693 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:31.507927 26693 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.507714 26597 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.508306 26693 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.509518 26561 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.510032 26561 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.510699 26597 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.511439 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.512138 26561 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.513473 26696 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:31.513684 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.514353 25493 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:31.514238 26696 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.515216 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.516479 26182 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.521471 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.521999 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.522305 25493 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:31.522884 26401 raft_consensus.cc:2393] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 3: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:31.523979 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.524802 26415 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:31.503422 26419 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.529515 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.530606 25493 raft_consensus.cc:2393] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:31.530412 25458 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:31.531600 26597 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:31.531965 26597 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.532297 26597 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.526432 26621 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.532989 26621 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:31.503935 25569 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:31.535020 26621 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:31.535656 25608 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:31.536736 26543 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:31.516855 26696 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.537097 26543 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:31.537611 26543 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.537845 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.538466 25642 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:31.539850 25639 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:31.540066 26597 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.541963 26180 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.542186 25459 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.543123 26626 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:31.543200 26419 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:31.543704 26626 raft_consensus.cc:697] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:31.525751 26530 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.525960 25609 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:31.544548 26626 consensus_queue.cc:237] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.545600 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:31.546379 25569 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:31.545099 26605 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:31.546667 26597 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.546730 26605 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.547348 26605 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.548053 26697 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:31.548461 26697 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:31.548847 26697 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.552845 26543 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.527766 25318 catalog_manager.cc:5697] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.555814 26543 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:31.557544 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.558436 25493 raft_consensus.cc:2393] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:31.563696 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:31.564376 26415 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.564496 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:31.565841 26530 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.566545 26530 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.573325 26621 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.575460 26621 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.572867 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:31.525075 26561 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:31.593382 26561 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.590423 26605 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:31.593796 26561 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.594295 26693 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.595953 26415 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:31.599191 25562 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:31.601550 25608 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:31.589340 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.604162 25493 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:31.607764 25458 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:31.608840 25638 raft_consensus.cc:1275] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:31.608837 26597 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:31.609752 26597 raft_consensus.cc:697] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:31.610029 26530 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:31.610670 26597 consensus_queue.cc:237] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.611940 26530 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:31.612093 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.612783 25639 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:31.619058 26693 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.621642 26180 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:31.623945 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:31.632544 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:31.572721 26697 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.634032 25493 raft_consensus.cc:2393] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:31.649441 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:31.650310 25562 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:31.613859 26613 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:31.646898 26693 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:31.669042 26530 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.669654 26530 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:31.678665 26625 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:31.679260 26625 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.653885 26696 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:31.674094 25493 raft_consensus.cc:1275] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.655200 26614 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.685192 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:31.686949 25562 raft_consensus.cc:2393] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:31.682876 26617 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:31.663056 26613 raft_consensus.cc:697] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:31.665455 26693 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.680778 26696 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.684228 26626 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.705693 25642 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:31.702876 26543 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:31.702683 26605 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:31.695653 26614 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.705008 26693 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:31.753415 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.755465 25493 raft_consensus.cc:2393] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:31.730792 26694 consensus_queue.cc:1048] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:28:31.744532 26626 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.704030 26617 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:31.749660 26625 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.768643 26709 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:31.769655 26713 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.769309 26709 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.770212 26713 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:31.771835 26709 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.772450 26710 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:31.773104 26710 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.775453 26710 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.782929 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:31.783650 26415 raft_consensus.cc:2393] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 3: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:31.783427 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.784471 26419 raft_consensus.cc:2368] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:31.786007 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.790436 25318 catalog_manager.cc:5697] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.753830 26543 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.808812 25606 leader_election.cc:400] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:31.809329 25606 leader_election.cc:403] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:31.811905 26709 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.814500 26697 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.819151 26543 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.786690 26621 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.820478 26617 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.822180 26696 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.822656 26530 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:31.826988 26703 log.cc:927] Time spent T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:28:31.827200 26713 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:31.828078 26607 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.828619 26607 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.829672 26626 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.831354 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.831995 26415 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:31.832660 25313 catalog_manager.cc:5697] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.836385 26614 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:31.786779 26613 consensus_queue.cc:237] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:31.837229 25458 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.816987 26180 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:31.841734 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.842593 26415 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:31.849350 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.850353 25642 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:31.846845 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.852099 26418 raft_consensus.cc:2393] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:31.851991 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.854877 26415 raft_consensus.cc:2368] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:31.856498 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.857465 25643 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:31.858402 25532 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.864813 25606 leader_election.cc:400] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:31.866523 25606 leader_election.cc:403] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:31.865689 26180 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:31.844143 26626 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:31.892719 26180 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:31.851078 26605 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:31.896330 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:31.897877 26418 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:31.853045 26704 raft_consensus.cc:476] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Not starting pre-election -- already a leader
W20260709 12:28:31.908948 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 111803us
I20260709 12:28:31.861471 26607 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.890280 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:31.853951 26561 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.893889 26712 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:31.894189 26626 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.901582 26697 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.902163 26705 raft_consensus.cc:2804] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:31.925267 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.928892 25642 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:31.905812 26614 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.930788 25560 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.931049 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:31.933537 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.934229 25643 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:31.936657 26419 raft_consensus.cc:2368] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4.
I20260709 12:28:31.938359 25459 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:31.922684 26713 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:31.922438 26626 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.923107 26402 raft_consensus.cc:1275] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.923522 26712 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
W20260709 12:28:31.943853 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 51220.2us
I20260709 12:28:31.928555 26705 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
W20260709 12:28:31.953337 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 224218us
I20260709 12:28:31.967089 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:31.967895 25642 raft_consensus.cc:2393] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:31.969025 26720 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:31.969472 26720 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:31.969817 26720 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.962630 26705 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:31.973584 26704 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.974108 26704 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:31.945621 26712 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:31.976223 26704 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:31.939715 26614 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:31.979959 26614 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:31.941847 26713 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:31.960108 25569 raft_consensus.cc:3060] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:31.999429 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.000458 25493 raft_consensus.cc:1275] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:31.986949 26694 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.987856 26704 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:31.988092 26709 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:32.005564 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:32.016305 25492 raft_consensus.cc:2368] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:32.007175 25491 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:32.006736 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:31.997107 26713 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:32.011013 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:32.018615 25487 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:32.025138 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:32.026104 25492 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:32.026944 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.028227 25489 raft_consensus.cc:1275] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:32.004838 26605 raft_consensus.cc:697] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:32.037443 26605 consensus_queue.cc:237] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.036087 26705 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.040933 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:32.020678 26704 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.052982 26401 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:32.056582 26704 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:32.061797 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.062521 25643 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:31.997999 26693 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:32.066341 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.072722 25642 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:32.074414 26182 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:32.074887 25535 leader_election.cc:400] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:32.083739 25535 leader_election.cc:403] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:32.075341 26180 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:32.017352 26694 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.048961 26713 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.065903 26711 consensus_queue.cc:1048] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 12:28:32.099345 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 70037.7us
I20260709 12:28:32.102514 26180 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:32.082201 26708 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:28:32.070616 26726 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:28:32.112208 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:32.115163 26720 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.115688 26694 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:32.107251 26704 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:32.116832 26704 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.117235 26704 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:32.118347 26713 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:32.163715 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 140582us
I20260709 12:28:32.175806 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.176671 25643 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:32.179620 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.106455 26561 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:32.178139 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 75215.7us
I20260709 12:28:32.109475 26715 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.180294 25642 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:32.105647 26530 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:32.183657 25533 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:32.187266 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:32.189482 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 87072.2us
W20260709 12:28:32.194846 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 128096us
I20260709 12:28:32.195806 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:32.196180 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:32.120271 26727 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:28:32.197569 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:32.198386 26418 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:32.199918 25487 raft_consensus.cc:2368] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:32.201048 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:32.206346 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 106052us
I20260709 12:28:32.206421 25642 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:32.213654 25643 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:32.213836 25489 raft_consensus.cc:1275] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:32.226807 25643 raft_consensus.cc:1275] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:32.185848 26530 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.189595 26720 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:32.185561 26733 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:28:32.227586 26741 log.cc:927] Time spent T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:28:32.223904 26736 raft_consensus.cc:2804] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:32.277501 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:32.191460 26732 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:28:32.286942 25490 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:32.232455 26705 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:32.235179 26530 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:32.190099 26715 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:32.287849 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 101822us
I20260709 12:28:32.283402 26736 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.259989 26733 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.258389 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:32.296952 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:32.297739 25564 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.290127 26406 raft_consensus.cc:1275] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:32.294962 26697 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:32.303078 26626 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.307201 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:32.313480 26415 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:32.313853 26626 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:32.317498 26715 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:32.307940 26735 log.cc:927] Time spent T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:28:32.293339 26733 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:32.320749 26409 raft_consensus.cc:1275] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:32.321949 26415 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:32.307300 26712 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:32.309203 26401 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:32.293475 26736 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:32.299305 26402 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:32.333472 26712 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:32.297322 26693 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:32.338090 26733 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.341077 26733 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:32.342832 26704 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.344799 26704 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:32.345745 26736 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.347396 26736 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:32.348254 26530 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:32.362140 26530 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:32.404373 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 196342us
I20260709 12:28:32.421620 25495 raft_consensus.cc:2368] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
I20260709 12:28:32.443078 25567 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:32.300062 25569 raft_consensus.cc:1275] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:32.442279 25532 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:32.451507 25488 raft_consensus.cc:1275] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:32.456142 25488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1212a262e8424670b13c83406b35dae8"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:32.457247 25488 raft_consensus.cc:606] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:32.468441 25532 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:32.480036 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.481105 25458 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:32.483153 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.502775 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:32.503829 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:32.505501 26408 raft_consensus.cc:2368] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:32.509691 26694 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:32.512468 25643 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:32.504146 26415 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:32.519518 26712 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:32.520246 26712 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:32.520763 26712 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:32.536147 26597 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:28:32.533394 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 77745.3us
I20260709 12:28:32.536929 26597 raft_consensus.cc:697] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:32.541973 26408 raft_consensus.cc:1275] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:28:32.543663 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 75515.5us
I20260709 12:28:32.543856 26694 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:32.544507 26694 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.544909 26694 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:32.546627 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:32.547518 25489 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:32.525701 26734 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:28:32.570750 26753 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:32.520939 26708 consensus_queue.cc:1048] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:28:32.575842 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:32.577001 25564 raft_consensus.cc:2368] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
I20260709 12:28:32.525796 26714 consensus_queue.cc:1048] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:28:32.570873 25313 catalog_manager.cc:5697] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:32.556188 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:32.538618 26597 consensus_queue.cc:237] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.562376 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:32.589751 26401 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:32.601022 25606 leader_election.cc:400] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4.
I20260709 12:28:32.601409 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:32.602473 25492 raft_consensus.cc:2368] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
W20260709 12:28:32.603101 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 56636.8us
I20260709 12:28:32.601529 25606 leader_election.cc:403] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:32.604417 26696 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:32.603137 25495 raft_consensus.cc:2393] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:32.605469 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:32.607717 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:32.608371 25567 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:32.616652 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 144707us
W20260709 12:28:32.618131 26758 log.cc:927] Time spent T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:32.620536 25532 leader_election.cc:400] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:32.621057 25532 leader_election.cc:403] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:28:32.622128 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 354626us
I20260709 12:28:32.622567 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.626266 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.634439 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
W20260709 12:28:32.636040 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 48966.9us
I20260709 12:28:32.635154 26721 consensus_queue.cc:1048] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:32.644728 25643 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:32.647643 26753 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.648532 26753 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.657529 26753 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:32.661522 25640 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.661937 26623 consensus_queue.cc:1048] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:32.664378 26759 log.cc:927] Time spent T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:28:32.667894 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.674432 25491 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:32.723155 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.727738 25567 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.728978 25489 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.730605 26742 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
W20260709 12:28:32.732084 25638 consensus_meta.cc:287] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.803s	user 0.013s	sys 0.012s
I20260709 12:28:32.730000 25642 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:32.729038 26415 raft_consensus.cc:2468] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
W20260709 12:28:32.733422 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 92652.6us
I20260709 12:28:32.737517 25532 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:32.739470 26182 leader_election.cc:400] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
I20260709 12:28:32.741457 26734 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.742213 26734 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:32.735217 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 75507.9us
I20260709 12:28:32.745910 26714 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:32.746629 25459 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:32.747087 26714 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:32.747640 25634 raft_consensus.cc:1275] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:32.750080 26714 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:32.749847 26712 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.752054 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.752295 25569 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:32.752985 25640 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:32.754050 26696 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4.
I20260709 12:28:32.747732 26753 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:32.756011 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.756829 25643 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:32.742251 26182 leader_election.cc:400] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
I20260709 12:28:32.757614 26182 leader_election.cc:403] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:28:32.758266 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:32.759137 25562 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:32.761723 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:32.762403 26697 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:32.767840 26753 raft_consensus.cc:697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:32.769718 26753 consensus_queue.cc:237] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.770967 25609 leader_election.cc:400] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:32.762825 25641 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:32.771836 26709 consensus_queue.cc:1048] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:32.752144 25635 raft_consensus.cc:1275] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:32.741506 26742 raft_consensus.cc:2804] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:32.775988 26742 raft_consensus.cc:697] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:32.777400 26181 leader_election.cc:400] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
I20260709 12:28:32.778906 26181 leader_election.cc:403] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:28:32.771350 25609 leader_election.cc:403] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:32.732656 25638 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.795768 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:32.796207 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:32.796823 25492 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:32.797118 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:32.797439 26712 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:32.797849 25634 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
W20260709 12:28:32.802467 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 65281.2us
I20260709 12:28:32.804622 25492 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.810124 25563 raft_consensus.cc:1275] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:32.811424 26713 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
I20260709 12:28:32.811947 26181 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:32.747480 26734 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:32.814869 26733 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:32.815445 26733 raft_consensus.cc:697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:32.816839 26733 consensus_queue.cc:237] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:32.820555 26742 consensus_queue.cc:237] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.826543 26182 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:32.827929 26732 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:32.828576 26732 raft_consensus.cc:697] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:32.829026 26182 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:32.830957 26693 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:32.831708 26693 raft_consensus.cc:697] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:32.832211 25640 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
W20260709 12:28:32.834563 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 48261.9us
I20260709 12:28:32.835628 25460 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:32.836774 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:32.837604 26734 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:32.796854 25490 raft_consensus.cc:2393] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:32.838088 26734 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.838577 26734 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:32.840440 26693 consensus_queue.cc:237] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.844666 26711 consensus_queue.cc:1048] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:28:32.845968 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 75362.3us
I20260709 12:28:32.836364 26732 consensus_queue.cc:237] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:32.736292 26694 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:32.847940 26734 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:32.837767 26418 raft_consensus.cc:2368] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:32.849452 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:32.851675 26734 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:32.855404 25490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56b2d6e550e94756880164ae94318541"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:32.858855 26401 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:32.859798 26726 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3.
I20260709 12:28:32.863541 25488 raft_consensus.cc:1275] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:32.863752 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:32.864459 25492 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:32.864921 25490 raft_consensus.cc:606] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Received request to transfer leadership to TS 05cabf76554146489f61260dbdadf659
I20260709 12:28:32.871192 25639 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.876921 25492 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:32.906594 25459 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:32.911461 26180 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:32.891656 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:32.885586 25638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48680 (request call id 102) took 1027 ms. Trace:
I20260709 12:28:32.926496 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:32.927595 26406 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:32.928227 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:32.928308 26730 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:32.930137 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:32.930809 26626 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:32.930670 26704 consensus_queue.cc:1048] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:32.931303 26626 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:32.931723 26626 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:32.931918 25532 leader_election.cc:400] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:32.932343 25532 leader_election.cc:403] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:28:32.921566 25638 rpcz_store.cc:276] 0709 12:28:31.844874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:31.851240 (+  6366us) service_pool.cc:224] Handling call
0709 12:28:32.803735 (+952495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:32.935900 26730 raft_consensus.cc:697] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:32.936579 26717 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3.
I20260709 12:28:32.937160 26730 consensus_queue.cc:237] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:32.942158 26738 consensus_queue.cc:1048] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:28:32.944738 26739 raft_consensus.cc:993] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:32.922139 25609 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:32.946554 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 46637.2us
W20260709 12:28:32.950753 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 66448.8us
I20260709 12:28:32.945309 26739 raft_consensus.cc:1081] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Signalling peer 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:32.944350 26626 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:32.930768 25564 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:32.982266 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 117316us
I20260709 12:28:33.033764 26779 raft_consensus.cc:2764] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:28:33.034410 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:33.036031 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:33.036677 25634 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:33.037351 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 109891us
I20260709 12:28:33.030045 25563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56b2d6e550e94756880164ae94318541"
dest_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:39666
I20260709 12:28:33.038578 25563 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:33.039016 25563 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:33.044840 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 125129us
I20260709 12:28:33.046792 25459 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:33.038350 25490 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:33.055846 26180 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:33.058351 26734 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:33.071165 26734 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:33.045791 25641 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:33.071593 26734 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:33.073458 26530 consensus_queue.cc:1048] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
W20260709 12:28:33.139074 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 81261.9us
I20260709 12:28:33.144510 25535 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:33.158593 26746 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:33.159271 26746 raft_consensus.cc:697] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
W20260709 12:28:33.159543 26777 log.cc:927] Time spent T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:28:33.160311 26746 consensus_queue.cc:237] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:33.162645 26765 log.cc:927] Time spent T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:28:33.167197 25569 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:33.167977 26719 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:33.171419 25564 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:33.182988 25492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
W20260709 12:28:33.162708 26766 log.cc:927] Time spent T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:28:33.187252 26754 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:33.185272 25460 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:33.196795 25492 raft_consensus.cc:606] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:33.192350 26768 log.cc:927] Time spent T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:28:33.142786 26772 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 12:28:33.152416 26626 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:33.199918 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:33.205385 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 59270.1us
I20260709 12:28:33.208676 25563 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:33.249354 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 208134us
I20260709 12:28:33.251459 25563 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:33.254946 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 338057us
W20260709 12:28:33.309093 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 107445us
W20260709 12:28:33.398582 26770 log.cc:927] Time spent T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 12:28:33.405334 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 142249us
I20260709 12:28:33.407217 26180 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:33.406543 26715 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:33.232084 26696 consensus_queue.cc:1059] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.145s
I20260709 12:28:33.415876 25634 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
W20260709 12:28:33.421311 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 110061us
I20260709 12:28:33.425374 26715 raft_consensus.cc:697] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
W20260709 12:28:33.426626 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 162940us
I20260709 12:28:33.427022 26730 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:33.427834 26800 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:33.468802 25533 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:33.457362 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:33.479072 25493 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:28:33.447600 26712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.020s	sys 0.037s
W20260709 12:28:33.482743 26712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.020s	sys 0.038s
I20260709 12:28:33.497116 26617 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:28:33.498248 26725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.000s	sys 0.012s
W20260709 12:28:33.499810 26725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.012s
I20260709 12:28:33.460237 26800 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:33.498530 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:33.484783 26730 raft_consensus.cc:697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:33.504751 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:28:33.542578 26693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.004s	sys 0.012s
W20260709 12:28:33.543102 26693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.004s	sys 0.012s
I20260709 12:28:33.500484 26793 raft_consensus.cc:3055] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:33.508069 26617 raft_consensus.cc:697] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
W20260709 12:28:33.555105 25486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.004s
W20260709 12:28:33.573472 25486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.007s	sys 0.004s
I20260709 12:28:33.482216 26715 consensus_queue.cc:237] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:33.583623 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:33.585695 25640 raft_consensus.cc:1275] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:28:33.582686 26789 log.cc:927] Time spent T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 12:28:33.607465 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:33.574815 26793 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:33.609557 25639 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:33.594444 26734 consensus_meta.cc:287] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.009s
I20260709 12:28:33.581257 25565 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:33.583875 26800 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:33.581655 26740 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:33.581635 26757 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
W20260709 12:28:33.623039 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 137223us
I20260709 12:28:33.626490 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:33.633473 26617 consensus_queue.cc:237] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:33.649160 26757 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:33.651355 26793 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:33.659937 25639 raft_consensus.cc:2468] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
W20260709 12:28:33.664049 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 124102us
I20260709 12:28:33.664959 25495 raft_consensus.cc:1240] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:33.619174 26734 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:33.649726 26742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.008s	sys 0.010s
I20260709 12:28:33.586200 26730 consensus_queue.cc:237] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:33.674023 26694 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:33.675477 25638 raft_consensus.cc:3060] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:33.678867 26742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.008s	sys 0.011s
I20260709 12:28:33.686647 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:33.688493 26807 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:33.688119 25639 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:33.705652 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:33.689468 25490 raft_consensus.cc:1240] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:28:33.710036 25643 raft_consensus.cc:1275] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:33.689642 26807 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:33.666635 26740 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:33.717765 26807 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:33.720328 26740 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:33.726572 25561 raft_consensus.cc:1240] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:33.727242 26734 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:33.728164 26812 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:33.736340 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:33.749130 26787 consensus_queue.cc:1059] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:28:33.751364 26409 raft_consensus.cc:1275] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:33.752637 26420 raft_consensus.cc:1275] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:33.754568 26821 consensus_queue.cc:1059] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:33.765056 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:33.766000 26725 raft_consensus.cc:993] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:33.766692 26725 raft_consensus.cc:1081] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
W20260709 12:28:33.786345 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 82654.5us
I20260709 12:28:33.782573 26809 raft_consensus.cc:3055] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:33.783176 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:33.808661 26821 consensus_queue.cc:1048] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:33.798692 26809 raft_consensus.cc:740] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:33.849386 26739 raft_consensus.cc:993] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:33.849997 26739 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:33.851204 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 47438.8us
I20260709 12:28:33.854640 25639 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:33.855293 25634 raft_consensus.cc:1240] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:33.863067 25459 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:33.865394 25565 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:33.851640 26715 raft_consensus.cc:1081] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:33.868381 26734 consensus_queue.cc:1048] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:33.877521 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:33.879520 25491 raft_consensus.cc:3055] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:33.879745 25491 raft_consensus.cc:740] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
W20260709 12:28:33.874964 26732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.003s	sys 0.021s
I20260709 12:28:33.884518 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:33.884543 25491 consensus_queue.cc:260] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:33.885115 26822 consensus_queue.cc:1059] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:33.886178 25491 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:33.876310 26626 raft_consensus.cc:2804] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:33.894706 25459 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:33.905225 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:33.882973 26732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.003s	sys 0.021s
I20260709 12:28:33.897469 26829 consensus_queue.cc:1048] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:28:33.898684 26769 log.cc:927] Time spent T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.809s	user 0.006s	sys 0.000s
I20260709 12:28:33.913128 26408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53780 (request call id 610) took 1280 ms. Trace:
I20260709 12:28:33.914304 26626 raft_consensus.cc:697] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:33.915359 26626 consensus_queue.cc:237] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:33.904100 25491 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:33.918399 25533 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:33.925390 26751 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:33.925915 26751 raft_consensus.cc:697] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:33.926884 26751 consensus_queue.cc:237] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:33.913592 26408 rpcz_store.cc:276] 0709 12:28:32.633068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.633236 (+   168us) service_pool.cc:224] Handling call
0709 12:28:32.670009 (+ 36773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:32.723474 (+ 53465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:32.723505 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:32.724519 (+  1014us) log.cc:844] Serialized 26 byte log entry
0709 12:28:32.971138 (+246619us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:32.971199 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:32.971293 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:33.897751 (+926458us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:28:33.912809 (+ 15058us) raft_consensus.cc:1685] finished
0709 12:28:33.912830 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:33.913038 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":6740352,"thread_start_us":128928,"threads_started":1,"wal-append.queue_time_us":313782}
I20260709 12:28:33.938560 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:33.942215 26816 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:28:33.939956 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 45387.2us
W20260709 12:28:33.945775 25459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:33.983636 25488 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.009s	sys 0.016s
W20260709 12:28:33.984366 25488 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.009s	sys 0.016s
W20260709 12:28:33.986510 26842 log.cc:927] Time spent T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:28:33.987018 25459 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:33.991636 26816 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:33.998875 26832 log.cc:927] Time spent T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:28:34.019695 26757 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:34.030203 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:34.029009 25318 catalog_manager.cc:5697] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:34.034499 25458 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:34.037855 26406 raft_consensus.cc:1275] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:34.038481 26415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1212a262e8424670b13c83406b35dae8"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:34.040053 26415 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:34.040463 26415 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:34.042846 26734 raft_consensus.cc:2749] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:34.053978 26743 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:28:34.057129 26530 raft_consensus.cc:3055] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:34.059675 26418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:34.059958 26530 raft_consensus.cc:740] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:34.060364 26418 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:34.078130 26418 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:34.061407 25569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44842 (request call id 131) took 1451 ms. Trace:
I20260709 12:28:34.078998 25569 rpcz_store.cc:276] 0709 12:28:32.604800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.604976 (+   176us) service_pool.cc:224] Handling call
0709 12:28:34.055954 (+1450978us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540031e554. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:34.056056 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335942016}
I20260709 12:28:34.087488 26530 consensus_queue.cc:260] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:34.088083 25643 raft_consensus.cc:1240] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:34.088626 26530 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:34.090548 26793 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:34.096802 25642 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:34.105449 26415 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:34.136818 25486 raft_consensus.cc:1240] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:28:34.119390 26751 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:34.124128 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:34.170647 26751 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:34.064975 26809 consensus_queue.cc:260] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:34.177671 26804 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:34.178295 26804 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:34.185186 26805 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:34.186575 26804 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:34.188972 26861 consensus_queue.cc:1059] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 12:28:34.204090 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 82746.3us
I20260709 12:28:34.218008 26530 consensus_queue.cc:1059] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:34.221557 26862 raft_consensus.cc:3055] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:34.221980 26862 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:34.222846 26862 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:34.224177 26862 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:34.236347 26731 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:34.237020 26731 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:34.238169 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:34.239341 26731 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:34.244153 26809 raft_consensus.cc:3060] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:34.255612 26408 raft_consensus.cc:1275] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:34.259007 25634 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:34.259856 26418 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:34.281461 26418 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:34.293375 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:34.296218 25635 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:34.306090 25637 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:34.306649 26819 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:34.318461 25635 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:34.324478 25313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47518 (request call id 80) took 1914 ms. Trace:
W20260709 12:28:34.346638 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:34.322674 26819 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:34.360539 26625 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:34.353386 26614 consensus_queue.cc:1048] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:28:34.351410 26723 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
W20260709 12:28:34.368708 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 234364us
I20260709 12:28:34.369863 26625 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:34.367861 26751 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:34.325619 25313 rpcz_store.cc:276] 0709 12:28:32.402908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.404085 (+  1177us) service_pool.cc:224] Handling call
0709 12:28:34.316710 (+1912625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:32.949482 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:32.950371 (+   889us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:32.950491 (+   120us) write_op.cc:435] Acquired schema lock
0709 12:28:32.950540 (+    49us) tablet.cc:662] Decoding operations
0709 12:28:32.951046 (+   506us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:32.951176 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:32.951223 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:28:32.951557 (+   334us) tablet.cc:701] Row locks acquired
0709 12:28:32.951613 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:28:32.951794 (+   181us) write_op.cc:270] Start()
0709 12:28:32.951967 (+   173us) write_op.cc:276] Timestamp: P: 1783600112951718 usec, L: 0
0709 12:28:32.952017 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:28:32.952923 (+   906us) log.cc:844] Serialized 537 byte log entry
0709 12:28:33.930308 (+977385us) op_driver.cc:464] REPLICATION: finished
0709 12:28:34.194457 (+264149us) write_op.cc:301] APPLY: starting
0709 12:28:34.210822 (+ 16365us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:34.215323 (+  4501us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:34.237851 (+ 22528us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:34.238213 (+   362us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:34.238489 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:28:34.238550 (+    61us) write_op.cc:312] APPLY: finished
0709 12:28:34.238842 (+   292us) log.cc:844] Serialized 22 byte log entry
0709 12:28:34.239048 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:34.239152 (+   104us) write_op.cc:454] Released schema lock
0709 12:28:34.239226 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:34.239636 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:34.239664 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11709,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":189993,"apply.run_cpu_time_us":2505,"apply.run_wall_time_us":82799,"num_ops":1,"prepare.queue_time_us":271718,"prepare.run_cpu_time_us":4085,"prepare.run_wall_time_us":73581,"replication_time_us":967420,"thread_start_us":199999,"threads_started":2}]]}
I20260709 12:28:34.390975 26614 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:34.391674 26614 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:34.392562 26625 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:34.372038 26723 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:34.398162 26614 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:34.406528 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:34.406813 25535 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:34.406589 25567 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:34.421236 26819 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:34.423322 26723 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:34.425645 26409 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:28:34.426147 26409 pending_rounds.cc:85] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Aborting all ops after (but not including) 2
I20260709 12:28:34.426388 26409 pending_rounds.cc:107] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:28:34.426687 26409 raft_consensus.cc:2889] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:34.412154 26712 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:34.485338 25318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57464 (request call id 161) took 1536 ms. Trace:
I20260709 12:28:34.486470 25318 rpcz_store.cc:276] 0709 12:28:32.948702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.948985 (+   283us) service_pool.cc:224] Handling call
0709 12:28:34.485255 (+1536270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:34.210425 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:34.224044 (+ 13619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:34.224078 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:28:34.224100 (+    22us) tablet.cc:662] Decoding operations
0709 12:28:34.224448 (+   348us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:34.224500 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:34.224536 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:28:34.224753 (+   217us) tablet.cc:701] Row locks acquired
0709 12:28:34.224771 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:28:34.224905 (+   134us) write_op.cc:270] Start()
0709 12:28:34.225014 (+   109us) write_op.cc:276] Timestamp: P: 1783600114224856 usec, L: 0
0709 12:28:34.225039 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:28:34.225827 (+   788us) log.cc:844] Serialized 537 byte log entry
0709 12:28:34.227597 (+  1770us) op_driver.cc:464] REPLICATION: finished
0709 12:28:34.239996 (+ 12399us) write_op.cc:301] APPLY: starting
0709 12:28:34.240072 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:34.240168 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:34.240270 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:34.240507 (+   237us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:34.240648 (+   141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:28:34.240690 (+    42us) write_op.cc:312] APPLY: finished
0709 12:28:34.240851 (+   161us) log.cc:844] Serialized 22 byte log entry
0709 12:28:34.240995 (+   144us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:34.241069 (+    74us) write_op.cc:454] Released schema lock
0709 12:28:34.241103 (+    34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":39051,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":12193,"apply.run_cpu_time_us":1557,"apply.run_wall_time_us":28343,"num_ops":1,"prepare.queue_time_us":106297,"prepare.run_cpu_time_us":2919,"prepare.run_wall_time_us":32748,"replication_time_us":2410,"thread_start_us":218597,"threads_started":2}]]}
I20260709 12:28:34.687237 26862 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:34.713798 26862 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:34.919777 26862 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.086766 26862 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:35.087539 26862 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.090340 26862 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:35.122248 26862 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:35.123020 26862 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.158542 26862 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:35.396481 26862 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:35.558925 26862 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:35.788132 26874 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:35.788897 26874 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:35.791308 26874 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.791998 26874 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:35.792647 26875 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:35.793292 26875 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:35.798101 26862 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.799779 26876 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:35.802690 26877 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.803833 26409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53780 (request call id 626) took 1569 ms. Trace:
I20260709 12:28:35.827098 26409 rpcz_store.cc:276] 0709 12:28:34.234367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.234488 (+   121us) service_pool.cc:224] Handling call
0709 12:28:34.234790 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:34.427144 (+192354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.803455 (+1376311us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400008f54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:35.803747 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437906176}
I20260709 12:28:35.827524 26876 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:35.807596 26878 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:35.829558 26878 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:35.830096 26876 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.830775 26876 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:35.831277 26876 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:35.831759 26878 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.792502 26874 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:35.833261 26877 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.835258 26874 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.835484 26877 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:35.838680 26876 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.835317 26875 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.839718 26793 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.845832 26793 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.848837 26793 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:35.849843 26793 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:35.850454 25641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48680 (request call id 132) took 1771 ms. Trace:
I20260709 12:28:35.850577 26793 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:35.851215 25641 rpcz_store.cc:276] 0709 12:28:34.078676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.081722 (+  3046us) service_pool.cc:224] Handling call
0709 12:28:34.082013 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:34.082196 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:34.082217 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:34.104178 (+ 21961us) log.cc:844] Serialized 26 byte log entry
0709 12:28:34.376369 (+272191us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:34.376409 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.376473 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.850090 (+1473617us) raft_consensus.cc:1685] finished
0709 12:28:35.850122 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.850333 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968,"thread_start_us":240896,"threads_started":1,"wal-append.queue_time_us":330115,"wal-append.run_cpu_time_us":2443,"wal-append.run_wall_time_us":1015371}
I20260709 12:28:35.858760 26793 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.860468 26879 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.861230 26879 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:35.861255 26881 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.862746 26881 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.863735 26879 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.864588 26877 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:35.865120 26877 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.866007 26881 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:35.867419 26877 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:35.870239 26879 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.873618 26877 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:35.873621 26879 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.874330 26877 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:35.876035 26879 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:35.876361 26877 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.878183 26793 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:35.879139 26793 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.881212 26882 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.882022 26793 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:35.881852 26882 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:35.883684 26793 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.884305 26882 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.884225 26793 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.895205 26793 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:35.895767 26793 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.896314 26793 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:35.898489 26793 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.885955 26883 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:35.888448 26810 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:35.899322 26810 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:35.892134 25561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.487s	user 0.011s	sys 0.003s
W20260709 12:28:35.901496 25561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.012s	sys 0.004s
I20260709 12:28:35.902432 25561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44842 (request call id 152) took 1502 ms. Trace:
I20260709 12:28:35.904047 25560 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:35.902830 25561 rpcz_store.cc:276] 0709 12:28:34.400355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.403248 (+  2893us) service_pool.cc:224] Handling call
0709 12:28:34.403809 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:34.404089 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:28:34.404442 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 12:28:35.902014 (+1497572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.902075 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:35.902119 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.902191 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.902340 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":456,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":115,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":1497143,"threads_started":1,"wal-append.queue_time_us":42632,"wal-append.run_cpu_time_us":1616,"wal-append.run_wall_time_us":1022345}
I20260709 12:28:35.905306 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:35.907369 26881 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.907919 26881 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:35.910007 26881 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.910645 25567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39676 (request call id 543) took 1501 ms. Trace:
I20260709 12:28:35.911095 25567 rpcz_store.cc:276] 0709 12:28:34.409324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.909843 (+1500519us) service_pool.cc:224] Handling call
0709 12:28:35.910157 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.910338 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:35.910366 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.910407 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:35.910441 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.910494 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.910591 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.943696 25565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44842 (request call id 150) took 1544 ms. Trace:
I20260709 12:28:35.943686 25634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48680 (request call id 141) took 1661 ms. Trace:
I20260709 12:28:35.935078 26883 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:35.944387 26693 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:35.945895 26693 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.945360 25565 rpcz_store.cc:276] 0709 12:28:34.399354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.401935 (+  2581us) service_pool.cc:224] Handling call
0709 12:28:35.942728 (+1540793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:35.942941 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:35.943141 (+   200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:35.943303 (+   162us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:35.943405 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:35.943476 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.943631 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:35.945465 25634 rpcz_store.cc:276] 0709 12:28:34.282229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.291615 (+  9386us) service_pool.cc:224] Handling call
0709 12:28:34.302565 (+ 10950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:34.302766 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:34.302789 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:34.303265 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:28:34.382357 (+ 79092us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:34.388329 (+  5972us) log.cc:844] Serialized 14 byte log entry
0709 12:28:34.388554 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.388629 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:35.943464 (+1554835us) raft_consensus.cc:1685] finished
0709 12:28:35.943485 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:35.943625 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5527,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":74,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":78753,"threads_started":1,"wal-append.queue_time_us":107241,"wal-append.run_cpu_time_us":3232,"wal-append.run_wall_time_us":1006086}
I20260709 12:28:35.948318 26693 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:35.958667 26883 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.963024 26810 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.968766 26886 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.969878 26884 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:35.990173 26884 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:35.991210 25318 catalog_manager.cc:5697] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.992650 26884 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.970000 26793 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:35.993993 26793 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:35.996313 26793 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:35.976751 26734 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.969588 26886 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:35.997795 26734 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:36.000104 26734 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:35.977665 26882 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.000113 26886 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.001250 26882 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:36.003631 26882 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.004180 26882 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
W20260709 12:28:35.975198 25562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.568s	user 0.014s	sys 0.019s
I20260709 12:28:36.005144 26886 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:35.996970 26884 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:36.006603 26886 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:36.006753 26884 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:36.005957 25562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.015s	sys 0.019s
I20260709 12:28:36.009079 25488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43702 (request call id 934) took 3095 ms. Trace:
I20260709 12:28:36.012452 26415 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:36.012854 26709 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.024397 26887 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.162758 26709 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.004716 26882 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:36.042409 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.042719 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.165378 26882 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.165704 25566 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:36.045888 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.053419 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.167083 25567 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:36.055227 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.055891 26884 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.043181 26885 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.061975 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.038667 25488 rpcz_store.cc:276] 0709 12:28:32.913993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.916463 (+  2470us) service_pool.cc:224] Handling call
0709 12:28:33.036970 (+120507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:33.080834 (+ 43864us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:28:33.969947 (+889113us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e208df0ac 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208f9455 00007f1e273e13c7
0709 12:28:33.991465 (+ 21518us) log.cc:844] Serialized 14 byte log entry
0709 12:28:34.381237 (+389772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:34.382081 (+   844us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:34.385884 (+  3803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:34.388754 (+  2870us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.008980 (+1620226us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":341974,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":3643,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":1560,"spinlock_wait_cycles":6566144,"thread_start_us":1278936,"threads_started":2,"wal-append.queue_time_us":441777,"wal-append.run_cpu_time_us":1907,"wal-append.run_wall_time_us":1026978}
I20260709 12:28:36.057971 26889 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:36.190012 26889 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:36.192776 26889 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:36.071264 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.193470 25561 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:36.195668 25560 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:36.071916 26886 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.068063 26891 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:36.075510 26890 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:36.197788 26891 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:36.081110 26888 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:36.105845 26895 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:36.198832 26888 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.199196 26895 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.199760 26885 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.200250 26891 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:36.200852 26891 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:36.122893 26896 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.251776 26891 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:36.251912 26896 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:36.254762 26891 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:36.255162 26896 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:36.255450 26891 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.131016 26898 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:36.256222 26891 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:36.256683 26898 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.259919 26898 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:36.135288 26883 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.260821 26883 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:36.136222 25562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44842 (request call id 153) took 1735 ms. Trace:
I20260709 12:28:36.262428 25562 rpcz_store.cc:276] 0709 12:28:34.401291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.401422 (+   131us) service_pool.cc:224] Handling call
0709 12:28:34.406179 (+  4757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:34.406531 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:34.406557 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:34.407094 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:28:36.037853 (+1630759us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:36.067143 (+ 29290us) log.cc:844] Serialized 14 byte log entry
0709 12:28:36.134648 (+ 67505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:36.135847 (+  1199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:36.135912 (+    65us) raft_consensus.cc:1685] finished
0709 12:28:36.135931 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:36.136139 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36920,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":2067,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":250,"thread_start_us":1724372,"threads_started":3,"wal-append.queue_time_us":149355,"wal-append.run_cpu_time_us":2084,"wal-append.run_wall_time_us":1002106}
W20260709 12:28:36.151007 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 51073.4us
I20260709 12:28:36.267531 25608 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:36.268857 26884 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:36.134268 26897 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.269268 26884 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.269717 26884 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:36.269572 26897 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.271768 26895 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:36.272418 26897 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.153095 26904 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:36.273505 26904 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:36.276517 26904 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:36.153514 26899 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:36.162817 26887 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:36.277431 26899 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.279219 26887 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:36.012594 26793 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.127496 26793 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:36.168128 26415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53792 (request call id 520) took 2131 ms. Trace:
I20260709 12:28:36.164434 26906 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.130503 26693 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.130872 26906 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.131349 26693 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:36.187811 25565 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:37.133535 25565 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39676 (request call id 555) took 1085 ms. Trace:
I20260709 12:28:37.133965 25565 rpcz_store.cc:276] 0709 12:28:36.047797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.048969 (+  1172us) service_pool.cc:224] Handling call
0709 12:28:37.133460 (+1084491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:37.135583 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.189088 26709 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:36.197870 26890 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.137312 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.137869 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.138568 25565 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:37.138979 26890 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:36.070580 26894 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:36.122036 26900 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:36.201205 26888 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:36.202322 26885 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.140580 26885 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.280455 26899 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:36.255965 26896 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.141387 26913 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.129793 26415 rpcz_store.cc:276] 0709 12:28:34.036028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.038340 (+  2312us) service_pool.cc:224] Handling call
0709 12:28:36.011873 (+1973533us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b4c00327d80. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e21cb5a20 00007f1e21cc6a29 00007f1e21cc713f 00007f1e21c8b2ab 00007f1e21cb8f3c 00007f1e21cb93fe 00007f1e21f4688b 00007f1e23945495 00007f1e2399630f 00007f1e239e0a55 00007f1e289b0cd0
0709 12:28:36.167237 (+155364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18771200}
I20260709 12:28:37.141814 26896 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.141847 26900 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.142802 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.143476 26415 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:36.332548 26878 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.144150 26900 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.144443 26878 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:36.336201 26874 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.144791 26894 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.145412 26874 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.144160 26896 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.141969 26913 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.147607 26874 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:36.366101 26891 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.147945 26894 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.376497 26884 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.148656 26906 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.150266 26884 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:36.269029 25608 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:28:37.151088 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 882079us
I20260709 12:28:37.151463 26793 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.151752 25608 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:37.152225 26793 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:36.570919 26907 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.152884 26899 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:37.147951 26913 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.153330 26907 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:36.571766 26887 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:36.593334 26908 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.152783 26793 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:36.600821 25562 raft_consensus.cc:1275] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:36.601464 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.159178 25564 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:37.158903 26887 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:36.603292 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.604069 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.604769 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:36.606316 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.161834 25563 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:37.153357 26899 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.163164 26899 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:36.606196 26904 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.016417 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.163988 25490 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:37.163842 26904 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.165208 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.165614 26887 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.166030 26904 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.166391 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.167577 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.168129 25490 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:37.023589 25569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44842 (request call id 155) took 2617 ms. Trace:
I20260709 12:28:37.026678 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:37.169561 26693 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:37.169883 25493 raft_consensus.cc:3055] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:37.027565 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.170626 25491 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
W20260709 12:28:37.033953 25664 debug-util.cc:398] Leaking SignalData structure 0x7b080027a9a0 after lost signal to thread 20876
I20260709 12:28:37.042913 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.172253 26874 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.172560 25489 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:37.041975 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.172834 26874 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.058220 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.175016 26874 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:37.073709 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.169365 25569 rpcz_store.cc:276] 0709 12:28:34.405863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:34.409454 (+  3591us) service_pool.cc:224] Handling call
0709 12:28:37.022896 (+2613442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:37.023137 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:37.023177 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:37.023234 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:37.023278 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:37.023347 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:37.023481 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:37.176177 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.170212 25493 raft_consensus.cc:740] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:37.176812 26419 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:37.075579 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.076457 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.199574 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.199608 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.200309 26406 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:37.083900 26810 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.201112 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.201542 26810 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.201933 26418 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:37.202839 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.203723 26810 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.085826 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.110606 26910 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.204545 26910 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.205469 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.206717 26910 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:37.206781 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.110849 26911 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.207542 26911 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.207981 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.208833 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.209645 26911 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:37.210475 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.211047 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.211527 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.211670 26404 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:37.212580 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.212868 26404 raft_consensus.cc:1240] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:37.152628 25608 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:37.221398 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.221655 26884 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:37.222172 26884 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:37.222537 26884 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:37.155684 26878 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.156598 26907 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.157364 26908 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.230482 26908 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:36.599887 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:37.231218 25488 raft_consensus.cc:3055] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:37.231593 25488 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:36.607064 26734 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.233523 26734 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.174960 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.236743 26408 raft_consensus.cc:1275] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:28:37.065595 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.074693 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.237545 26402 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:37.168962 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.237025 25313 catalog_manager.cc:5697] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:37.239293 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.240711 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.177410 25493 consensus_queue.cc:260] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.241572 25493 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.178833 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.245080 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.245471 25569 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:37.245504 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.245762 25643 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:37.246631 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.246240 25313 catalog_manager.cc:5697] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:37.247293 25569 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:37.248569 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.237075 26408 pending_rounds.cc:85] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Aborting all ops after (but not including) 2
I20260709 12:28:37.249158 26408 pending_rounds.cc:107] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:28:37.249426 26408 raft_consensus.cc:2889] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:37.180238 25664 debug-util.cc:398] Leaking SignalData structure 0x7b080008da20 after lost signal to thread 25352
I20260709 12:28:37.250707 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.180840 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:37.252312 25664 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd140 after lost signal to thread 25519
I20260709 12:28:37.252928 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.181623 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.253579 25640 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:37.182264 25606 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:37.246232 25635 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
W20260709 12:28:37.254782 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 72599.9us
I20260709 12:28:37.256731 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.185268 26805 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.257324 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.257649 25492 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:37.257490 26805 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.257974 25643 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:37.258232 25641 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:37.259403 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.259680 26805 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.260164 25642 raft_consensus.cc:2393] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:37.260548 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.190634 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.260969 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.193661 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.261475 25495 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
W20260709 12:28:37.262198 25568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39676 (request call id 548) took 1358 ms (client timeout 1651 ms). Trace:
I20260709 12:28:37.262290 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:37.262604 25568 rpcz_store.cc:269] 0709 12:28:35.903826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.193308 (+1289482us) service_pool.cc:224] Handling call
0709 12:28:37.262146 (+ 68838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:28:37.262878 25639 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:37.263209 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.183638 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.264874 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.196448 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.198011 26793 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:37.152352 25318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57458 (request call id 184) took 1279 ms. Trace:
I20260709 12:28:37.232528 25488 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.195142 26883 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:37.213625 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.266474 25488 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.266781 26420 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:37.213896 25491 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:37.219566 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.268054 25562 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:37.268314 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.220693 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.144500 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:37.221550 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 68988.7us
I20260709 12:28:37.182971 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.268944 26419 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:37.269851 25608 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:37.253509 25486 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
W20260709 12:28:37.270422 25664 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3a20 after lost signal to thread 25593
I20260709 12:28:37.270627 26888 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:28:37.270778 25664 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb1c0 after lost signal to thread 25594
I20260709 12:28:37.265540 26734 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.271117 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.271698 25635 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
W20260709 12:28:37.272101 25664 debug-util.cc:398] Leaking SignalData structure 0x7b08000336c0 after lost signal to thread 25667
I20260709 12:28:37.272827 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:37.273335 25664 debug-util.cc:398] Leaking SignalData structure 0x7b080033e340 after lost signal to thread 26448
I20260709 12:28:37.271121 26888 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.274204 26888 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.274389 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.275214 25640 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:37.265949 25318 rpcz_store.cc:276] 0709 12:28:35.872863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:35.873628 (+   765us) service_pool.cc:224] Handling call
0709 12:28:35.987041 (+113413us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b5400041190. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c50b2 00007f1e2983e759 00007f1e297d6a76 00007f1e297a7d58 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc
0709 12:28:37.152296 (+1165255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:36.102379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:36.103103 (+   724us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:36.103146 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:28:36.103164 (+    18us) tablet.cc:662] Decoding operations
0709 12:28:36.103574 (+   410us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:36.103647 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:36.103682 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:28:36.103924 (+   242us) tablet.cc:701] Row locks acquired
0709 12:28:36.103947 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:28:36.104109 (+   162us) write_op.cc:270] Start()
0709 12:28:36.104251 (+   142us) write_op.cc:276] Timestamp: P: 1783600116104054 usec, L: 0
0709 12:28:36.104284 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:28:36.105079 (+   795us) log.cc:844] Serialized 537 byte log entry
0709 12:28:37.028959 (+923880us) op_driver.cc:464] REPLICATION: finished
0709 12:28:37.123678 (+ 94719us) write_op.cc:301] APPLY: starting
0709 12:28:37.123792 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:37.123918 (+   126us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:37.124057 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:37.124386 (+   329us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:37.124603 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:28:37.124669 (+    66us) write_op.cc:312] APPLY: finished
0709 12:28:37.144814 (+ 20145us) log.cc:844] Serialized 22 byte log entry
0709 12:28:37.145013 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:37.145100 (+    87us) write_op.cc:454] Released schema lock
0709 12:28:37.145141 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:37.145541 (+   400us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:37.145578 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":20433792,"child_traces":[["op",{"apply.queue_time_us":81624,"apply.run_cpu_time_us":1997,"apply.run_wall_time_us":21894,"num_ops":1,"prepare.queue_time_us":63146,"prepare.run_cpu_time_us":23520,"prepare.run_wall_time_us":247814,"raft.queue_time_us":473937,"raft.run_cpu_time_us":47843,"raft.run_wall_time_us":72982,"replication_time_us":924489,"thread_start_us":449667,"threads_started":4,"wal-append.queue_time_us":446040}]]}
I20260709 12:28:37.276295 26918 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.276793 26918 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.277150 26918 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.279227 26401 raft_consensus.cc:1240] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:37.222543 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.273422 25635 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:37.286376 26888 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.290184 26734 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.290874 26734 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.236841 26899 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.215583 25460 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:37.293612 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 78104.1us
W20260709 12:28:37.182288 26181 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.67:32857 timed out after 2.199s (SENT) [suppressed 124 similar messages]
I20260709 12:28:37.294569 26919 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.295058 26919 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.295465 26919 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.295713 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:37.296330 25565 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.299173 26885 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:28:37.300019 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 233453us
I20260709 12:28:37.303057 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.303709 25639 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:37.305008 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.305661 25635 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:37.306322 25458 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:37.306542 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.289299 25493 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:37.300800 26883 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.307734 26883 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.308885 26919 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.310161 26883 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.310992 26919 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.306520 25460 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.310794 26883 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:28:37.317425 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 135161us
I20260709 12:28:37.317559 26805 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.318171 26805 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.320240 26805 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:37.320986 26180 connection.cc:256] RPC call timeout handler was delayed by -1.2304770450000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260709 12:28:37.321345 26732 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.312067 26888 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.322260 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.300423 25640 raft_consensus.cc:1240] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:37.313933 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.315387 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.326824 25637 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:37.327946 25639 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:37.328284 26862 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.315708 26884 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.321508 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.330600 26878 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:37.331054 25635 raft_consensus.cc:2410] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:28:37.325968 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.332683 26181 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:37.294715 26734 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.312523 26899 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.322093 26732 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.328840 26862 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.333370 26884 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.326593 26805 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:37.335134 26862 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.335335 26732 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.335556 26805 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.336544 26874 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.336948 26874 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.340564 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.341152 26908 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:37.341893 26908 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.342237 26908 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.342614 25460 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.345498 25567 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:37.346439 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.342624 26908 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.346921 25488 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:37.347947 26734 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:37.348367 26734 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.348766 26734 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:37.348959 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.350033 26181 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:37.350493 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.352304 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.353917 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:37.363606 25460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.371256 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.371922 25493 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:37.374356 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.378080 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.378824 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.379207 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.380831 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:37.378683 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 105852us
I20260709 12:28:37.337342 26874 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.382227 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.383433 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.385619 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.384943 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.391911 25608 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:37.403875 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.406883 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.407645 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.377852 26793 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.414520 26181 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:37.425055 25635 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:37.417380 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:37.408537 26805 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.401631 26182 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.430011 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.422986 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.382222 26732 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.432600 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.432655 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.386703 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.440692 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.441627 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.433883 26733 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:37.442528 26733 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:37.442917 26733 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:37.432116 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.441951 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.409981 26888 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.444454 26888 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.444842 26888 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.423661 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.442977 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.447641 25635 raft_consensus.cc:1275] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:37.448194 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.448684 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.449934 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.451026 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.452066 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.452975 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.382036 26920 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:28:37.448352 25640 raft_consensus.cc:1240] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:37.455638 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.456408 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.458160 25495 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:37.459326 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.460886 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:37.461642 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 60142.1us
I20260709 12:28:37.462302 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:37.462831 25563 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.462914 26182 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.463891 25609 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.428851 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:37.459362 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.465735 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:37.482412 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.466266 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.483382 25639 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:37.486027 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.471606 26182 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.490010 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.439489 26732 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.484340 26693 raft_consensus.cc:2804] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.484565 26810 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:37.496526 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.497611 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.497789 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.497958 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.498068 26878 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:37.498497 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.511544 25634 raft_consensus.cc:2410] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:28:37.501310 26180 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:37.486325 26890 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.526197 25565 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:37.526487 26890 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.527102 26890 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.495208 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:37.502815 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.530314 25640 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:37.500977 26910 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:28:37.512806 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:37.509976 25636 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:37.532375 25642 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:37.513186 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.508965 26693 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.534157 26693 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.481613 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.510473 26182 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.513222 26862 raft_consensus.cc:2804] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:37.518770 25459 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.519696 26897 consensus_queue.cc:1048] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:37.542981 26919 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:37.544126 26793 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.531168 26734 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.496814 26918 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.506078 26732 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:37.567232 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 213527us
W20260709 12:28:37.553404 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 45547us
W20260709 12:28:37.554296 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 172833us
I20260709 12:28:37.565755 25563 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:37.545260 25459 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.572835 25460 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.573717 25459 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.575704 25533 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:28:37.577335 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 151544us
I20260709 12:28:37.578119 25459 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.500802 26885 consensus_queue.cc:1059] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:28:37.554221 26180 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.582173 26180 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.582887 25459 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.568751 26805 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:37.545116 26890 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.580621 26738 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:37.566725 26920 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.552922 26862 raft_consensus.cc:697] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
W20260709 12:28:37.588292 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 123492us
I20260709 12:28:37.590626 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:37.588791 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:37.580632 26897 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:37.580410 26912 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:37.591585 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:37.591562 25459 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.580614 26916 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:37.628942 25459 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.633379 26904 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:37.633769 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:37.601668 26810 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:37.635088 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.635285 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.636307 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.636512 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.591550 26915 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:37.602726 26920 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.586759 26805 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.608040 26922 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.607451 26862 consensus_queue.cc:237] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.620508 25606 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:37.628116 26897 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.639978 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:37.615876 25461 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:37.587595 26885 consensus_queue.cc:1243] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:28:37.652735 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.632781 26888 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.614552 25609 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.653837 25459 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
W20260709 12:28:37.667322 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 53100.4us
I20260709 12:28:37.668152 25459 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.653488 26805 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:37.663393 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.653262 26922 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.665656 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.658608 26793 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.669709 25609 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.659741 26912 raft_consensus.cc:697] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:37.655088 26900 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.669760 25459 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:37.655534 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 86479.8us
I20260709 12:28:37.661420 26897 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:37.655414 26913 consensus_queue.cc:1048] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:28:37.657644 25606 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:37.690853 25459 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.690196 26408 raft_consensus.cc:2410] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:28:37.682642 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 100541us
I20260709 12:28:37.656131 26931 raft_consensus.cc:2804] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.697547 26180 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.690584 25609 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.691783 25606 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.687536 26182 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.670818 26597 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:37.682092 26915 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.686053 26922 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.689064 26900 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:37.728134 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.681769 26934 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:37.686573 26793 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.697434 26917 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:37.691089 26884 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:37.700168 26885 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:37.699364 26887 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:37.756930 26180 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.701787 26709 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:37.757861 26935 log.cc:927] Time spent T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:28:37.703367 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:37.704473 26918 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.694988 26931 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.727140 26915 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
W20260709 12:28:37.769508 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 77830.8us
I20260709 12:28:37.769755 26180 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.733134 26900 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.756206 26793 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.757359 26734 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:37.787914 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 211752us
I20260709 12:28:37.760169 26917 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:37.773784 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 73752.5us
I20260709 12:28:37.767457 26887 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.788995 25535 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:37.790326 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 188278us
I20260709 12:28:37.791024 25606 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.790290 26180 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.765918 26938 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.779803 26931 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.785917 26915 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.781186 26884 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.800985 25535 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.796486 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:37.793869 26917 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:37.825342 25533 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:37.788901 26910 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.833997 26910 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:37.834425 26910 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.804637 26180 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.791731 26911 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:37.826768 26930 log.cc:927] Time spent T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:28:37.801367 26938 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.800786 26939 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:37.794535 26890 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.802413 26929 raft_consensus.cc:2804] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.797091 26887 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:37.848033 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 57091.8us
I20260709 12:28:37.850935 26936 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.805292 26884 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.854724 26884 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.862505 26944 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.850445 26943 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.863101 25606 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.863698 26943 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.864141 26943 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.865882 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.866457 26890 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.867206 26890 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.867733 26709 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:37.869814 26949 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.870287 26949 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.870657 26949 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.853946 26936 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.852425 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:37.871364 26936 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.849429 25535 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.797150 26693 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.872852 26937 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.864832 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:37.873960 25535 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.866643 26948 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.846700 26920 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:37.785662 26912 consensus_queue.cc:237] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.873355 26419 raft_consensus.cc:1240] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:37.874665 26948 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.870553 26785 raft_consensus.cc:3055] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:37.875188 26948 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.875373 26785 raft_consensus.cc:740] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:37.874310 26738 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:37.876277 26785 consensus_queue.cc:260] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.877308 26785 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:37.873371 26937 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.878732 26937 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:37.889433 26908 consensus_meta.cc:287] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.005s
I20260709 12:28:37.889953 26908 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:37.892486 26908 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.897715 25606 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.898583 26899 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.898952 26899 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.899359 26899 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.899999 25606 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:37.900796 26934 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.901209 26934 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.901563 26934 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.902527 26890 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.847380 26938 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.900022 26693 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:37.846468 25533 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:37.907994 25458 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:37.908751 25606 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.910372 25606 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:37.845234 26810 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:37.906325 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 59950.3us
I20260709 12:28:37.925987 25458 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:37.926268 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 238802us
I20260709 12:28:37.928377 26182 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:37.931010 26182 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:37.936409 26878 raft_consensus.cc:2804] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:37.844084 26911 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.941243 25458 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:37.847190 26939 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:37.943220 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:37.943945 25458 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:37.947124 25563 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:37.849526 26929 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.936829 26878 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:37.937333 26883 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:37.950852 26904 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:37.939816 26890 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:37.954397 25458 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:37.938097 26923 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.968151 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:37.943678 26911 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:37.963109 25563 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:37.940344 26597 raft_consensus.cc:2749] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:37.949968 26939 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:37.974578 25313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57448 (request call id 182) took 1810 ms. Trace:
I20260709 12:28:37.951107 26916 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:37.973806 26932 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:28:37.976227 26733 consensus_meta.cc:287] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.004s
I20260709 12:28:37.954298 26883 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:37.979736 26953 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:37.947255 26908 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:37.980844 26884 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:37.954614 26878 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.963909 26810 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:37.988157 26917 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:37.994036 26915 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:37.949599 26888 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:37.951488 26929 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.966946 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:37.863229 26944 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.016132 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.003237 25318 catalog_manager.cc:5697] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 4, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:38.050657 25318 catalog_manager.cc:5697] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 4, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:38.004572 25313 rpcz_store.cc:276] 0709 12:28:36.164692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:36.164862 (+   170us) service_pool.cc:224] Handling call
0709 12:28:37.042225 (+877363us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400712ad4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23953090 00007f1e239f1f3a 00007f1e297a7e9c 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:37.974507 (+932282us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:37.613394 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:37.613973 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:37.614008 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:28:37.614026 (+    18us) tablet.cc:662] Decoding operations
0709 12:28:37.614435 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:37.614493 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:37.614520 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:28:37.614836 (+   316us) tablet.cc:701] Row locks acquired
0709 12:28:37.614850 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:28:37.614997 (+   147us) write_op.cc:270] Start()
0709 12:28:37.615118 (+   121us) write_op.cc:276] Timestamp: P: 1783600117614947 usec, L: 0
0709 12:28:37.615148 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:28:37.615835 (+   687us) log.cc:844] Serialized 922 byte log entry
0709 12:28:37.800122 (+184287us) op_driver.cc:464] REPLICATION: finished
0709 12:28:37.917139 (+117017us) write_op.cc:301] APPLY: starting
0709 12:28:37.917243 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:37.917361 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:37.917503 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:37.917919 (+   416us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:37.918118 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:28:37.918169 (+    51us) write_op.cc:312] APPLY: finished
0709 12:28:37.918372 (+   203us) log.cc:844] Serialized 28 byte log entry
0709 12:28:37.942750 (+ 24378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:37.949550 (+  6800us) write_op.cc:454] Released schema lock
0709 12:28:37.951953 (+  2403us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:37.973225 (+ 21272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:37.973254 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":423042944,"child_traces":[["op",{"apply.queue_time_us":113077,"apply.run_cpu_time_us":2117,"apply.run_wall_time_us":56021,"num_ops":2,"prepare.queue_time_us":255630,"prepare.run_cpu_time_us":2800,"prepare.run_wall_time_us":26787,"replication_time_us":166103,"thread_start_us":246922,"threads_started":2}]]}
I20260709 12:28:38.029117 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:38.029281 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 74282.7us
W20260709 12:28:38.029490 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 107774us
I20260709 12:28:38.052505 25318 catalog_manager.cc:5697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
W20260709 12:28:38.036672 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 115003us
I20260709 12:28:37.942798 26793 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:38.039744 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 235154us
I20260709 12:28:37.970667 26923 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:38.021977 26883 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.996771 26934 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.060966 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.044518 26810 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.033643 26953 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:38.063755 25636 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:28:38.115593 26953 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.066295 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.061636 26180 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.032545 26920 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:28:38.117710 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 56124.6us
I20260709 12:28:38.071296 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.067888 25460 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:38.118434 26180 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.023670 26733 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.137331 26733 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:38.114143 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:38.063215 26923 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.140336 26180 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.106803 25608 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.141315 26738 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:38.141865 26738 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.142616 26734 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:38.143198 25608 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.143154 26734 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.143988 26738 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:38.146072 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 78266.7us
I20260709 12:28:38.146821 25460 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:38.120721 26946 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.126497 26934 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.129190 26917 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.130561 26915 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.134565 26949 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.145205 26734 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.158684 25608 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:38.165802 25639 raft_consensus.cc:1240] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.179072 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.110014 26918 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:38.180065 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 224174us
I20260709 12:28:38.183248 25608 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.182498 26733 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.072173 26969 consensus_queue.cc:1059] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:28:38.186704 25642 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.186991 25634 raft_consensus.cc:1240] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:28:38.187798 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.187915 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.188555 26733 raft_consensus.cc:3055] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:38.189394 26897 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.169786 26942 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:38.190696 25641 raft_consensus.cc:1240] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.191637 26897 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.192086 26943 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:38.193760 26805 consensus_meta.cc:287] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 12:28:38.194195 26805 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.196587 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.196970 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.198702 25634 raft_consensus.cc:1240] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:28:38.203491 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 45520.9us
W20260709 12:28:38.205405 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 58665.4us
I20260709 12:28:38.205255 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.207721 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.208307 25487 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.210353 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:38.160719 26775 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:38.229620 25640 raft_consensus.cc:1240] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.214047 25495 raft_consensus.cc:1240] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.156819 26970 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:38.212697 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:38.234930 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.217793 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.167526 26964 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:38.160617 26962 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.196271 26805 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:38.210965 25489 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
W20260709 12:28:38.231770 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 77042.2us
I20260709 12:28:38.204439 26934 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:38.188987 26733 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.157768 26920 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:38.230311 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
W20260709 12:28:38.204871 26732 consensus_meta.cc:287] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.003s
I20260709 12:28:38.212841 26404 raft_consensus.cc:2368] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5.
I20260709 12:28:38.241626 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.253716 25634 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:38.242462 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.243867 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.212756 26890 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:38.229815 26874 consensus_meta.cc:287] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.828s	user 0.004s	sys 0.007s
I20260709 12:28:38.257735 26874 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.259838 26874 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:38.260463 26419 raft_consensus.cc:1240] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.204604 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.212968 26947 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:38.263023 26947 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.247692 26775 raft_consensus.cc:697] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:38.265285 26920 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.266078 26775 consensus_queue.cc:237] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.244664 26738 consensus_queue.cc:1059] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:28:38.233799 26970 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:38.250921 26180 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.255513 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.270083 26970 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.244266 26597 consensus_queue.cc:1059] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:28:38.271476 26949 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.271566 26597 raft_consensus.cc:3055] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:38.272150 26597 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:38.272615 26693 raft_consensus.cc:2764] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:28:38.272356 26887 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.273037 26597 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.274032 26943 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.274482 26597 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.274583 26887 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.277828 26948 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.281437 26418 raft_consensus.cc:1240] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.281654 25486 raft_consensus.cc:1240] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.240166 26915 raft_consensus.cc:2749] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:38.253024 26964 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.272419 26968 consensus_queue.cc:1059] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:28:38.286320 26947 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.249776 26878 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.287958 26947 raft_consensus.cc:3055] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:38.288386 26947 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:38.197525 26922 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.269263 26732 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.291455 26922 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.231367 26900 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.292419 26732 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.293459 26409 raft_consensus.cc:1240] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.293751 26900 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.298472 26733 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.299651 26733 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.197077 26918 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.301679 26947 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.288944 26878 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.310410 25606 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.313974 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.280872 26948 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.278322 26899 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.315860 25487 raft_consensus.cc:2468] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:38.317822 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.296481 26929 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:38.327368 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 76509.4us
I20260709 12:28:38.326838 25459 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:38.332082 26912 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:38.332752 26912 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:38.335995 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 165855us
I20260709 12:28:38.337952 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:38.338572 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 105783us
I20260709 12:28:38.342648 25532 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.343413 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.344614 25532 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.335273 26878 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:38.337021 26887 raft_consensus.cc:2804] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:38.350085 26887 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:38.350548 26887 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.337427 26938 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.355010 26944 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:38.355330 26938 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.356666 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.356868 25609 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:38.342031 26939 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.358319 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.359297 26939 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.344142 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.331099 26937 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.362322 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.362828 26937 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:38.337302 26931 consensus_meta.cc:287] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.004s
I20260709 12:28:38.363901 25635 raft_consensus.cc:1240] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.363824 26931 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.365933 26931 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.366564 26415 raft_consensus.cc:1240] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.366833 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.367458 25493 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.368124 26887 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.368484 26883 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.337210 26810 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.370441 26887 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.371472 26734 consensus_queue.cc:1059] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:38.372865 26734 raft_consensus.cc:3055] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.373194 26917 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:38.373339 26734 raft_consensus.cc:740] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:38.373804 26917 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:38.374282 26917 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.374696 26929 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.374329 26734 consensus_queue.cc:260] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.375448 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.376037 26734 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.377386 26949 consensus_queue.cc:1059] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:38.379567 26949 raft_consensus.cc:3055] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.379977 26949 raft_consensus.cc:740] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:38.326625 26934 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.381134 26883 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.383249 25458 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:38.392609 25458 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:38.394075 26738 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:38.394840 26738 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:28:38.391269 26936 consensus_meta.cc:287] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.001s
I20260709 12:28:38.390790 26917 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.396704 26936 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.398964 26917 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:38.399629 26936 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.409075 26810 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.315514 26923 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.412797 26897 raft_consensus.cc:3055] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:38.429948 26897 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
W20260709 12:28:38.336738 26910 consensus_meta.cc:287] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.004s
W20260709 12:28:38.438074 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 89773.2us
I20260709 12:28:38.437590 25493 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:38.478953 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:38.479517 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 134956us
I20260709 12:28:38.481309 25487 raft_consensus.cc:1240] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:38.483397 26180 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.486028 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.486286 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.486749 25494 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.487681 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.488436 25635 raft_consensus.cc:1240] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.489024 25640 raft_consensus.cc:1240] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.442585 25609 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:38.522576 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 80139.1us
I20260709 12:28:38.463472 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.534669 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.529554 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.540273 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.417804 26899 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.422065 26793 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.427222 26884 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.421633 26920 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.608186 25606 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.579104 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.413658 26964 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.550642 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.431844 26897 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.492955 26937 raft_consensus.cc:2749] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.608368 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.532608 26709 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:28:38.615974 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 81519.9us
I20260709 12:28:38.523639 26933 raft_consensus.cc:2749] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:38.539151 26402 raft_consensus.cc:1240] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.620376 25635 raft_consensus.cc:2393] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:38.443892 26404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53780 (request call id 638) took 1030 ms. Trace:
I20260709 12:28:38.457679 26977 consensus_queue.cc:1059] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.154s
I20260709 12:28:38.419289 26734 consensus_queue.cc:1059] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.191s
I20260709 12:28:38.380980 26949 consensus_queue.cc:260] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.428172 26953 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.616864 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.626773 26951 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.628841 26897 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.523988 26938 consensus_queue.cc:1059] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:28:38.532342 26948 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:38.634624 25494 raft_consensus.cc:2468] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:38.484634 26910 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.633116 25640 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 6: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:38.603703 26912 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:38.637868 26419 raft_consensus.cc:1240] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.640503 26182 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:38.457201 26911 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.493628 26941 consensus_queue.cc:1059] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 12:28:38.663400 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.663892 26911 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.666220 26938 raft_consensus.cc:3055] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:38.666682 26938 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.667549 26938 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.668833 26938 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:38.669384 26401 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.669803 25561 raft_consensus.cc:1240] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.670004 26182 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:38.670431 26948 raft_consensus.cc:2804] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:38.670929 26948 raft_consensus.cc:697] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.664907 26968 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:38.671764 26182 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.641698 26404 rpcz_store.cc:276] 0709 12:28:37.400037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:37.405310 (+  5273us) service_pool.cc:224] Handling call
0709 12:28:38.428926 (+1023616us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400009454. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:38.429075 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583717760}
I20260709 12:28:38.672487 26971 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:28:38.626199 26979 log.cc:927] Time spent T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:28:38.618927 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.673014 26971 raft_consensus.cc:697] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.674093 26971 consensus_queue.cc:237] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.604331 26733 consensus_queue.cc:1059] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:28:38.650992 25560 raft_consensus.cc:1240] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.652213 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.653188 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.602887 26969 consensus_queue.cc:1059] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:28:38.679734 25564 raft_consensus.cc:2376] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6. Re-sending same reply.
I20260709 12:28:38.684973 25493 raft_consensus.cc:1240] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:38.685535 25568 raft_consensus.cc:1240] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.653724 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.654629 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.687435 25634 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.658955 25643 raft_consensus.cc:1240] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.671597 26968 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.687880 25635 raft_consensus.cc:2393] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:38.645100 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.689363 25563 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:38.648833 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:38.676673 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.633687 26878 consensus_queue.cc:1059] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:28:38.691143 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.693396 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.693823 25560 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.553025 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.643851 26810 consensus_queue.cc:1059] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:28:38.693738 25492 raft_consensus.cc:1240] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:38.699355 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.706542 25563 raft_consensus.cc:1240] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:38.692173 26911 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.694401 26949 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.714915 26970 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.718302 25567 raft_consensus.cc:1240] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
W20260709 12:28:38.719866 25534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.721532 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.702512 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.729205 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.729635 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.730981 25642 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.731158 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.732383 25642 raft_consensus.cc:1240] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.732537 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.725553 25561 raft_consensus.cc:1240] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.734045 25486 raft_consensus.cc:1275] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:38.734342 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.735869 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.719524 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.737778 25642 raft_consensus.cc:1240] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.738641 26910 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.739459 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.739593 26775 consensus_queue.cc:1059] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.671872 26948 consensus_queue.cc:237] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.684388 26709 consensus_queue.cc:1059] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:28:38.696619 26975 consensus_queue.cc:1059] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:28:38.742825 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.744859 25460 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:38.744354 26941 raft_consensus.cc:3055] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:38.726827 26977 raft_consensus.cc:3055] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:38.745759 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.767123 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.767952 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.768366 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.746117 26980 consensus_queue.cc:1059] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:28:38.771118 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.746230 26983 consensus_queue.cc:1059] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:28:38.775033 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:38.778491 26983 raft_consensus.cc:3055] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.778954 26983 raft_consensus.cc:740] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:38.779871 26983 consensus_queue.cc:260] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.771333 26980 raft_consensus.cc:3055] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.772009 25635 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.766150 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.814844 26418 raft_consensus.cc:1240] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.769554 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.747747 25460 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:38.806455 25567 raft_consensus.cc:1240] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.755800 25564 raft_consensus.cc:1275] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:38.756173 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.804919 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.800976 25634 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:38.764122 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
W20260709 12:28:38.805889 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 324388us
I20260709 12:28:38.819870 25532 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:38.821286 25532 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:38.822167 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 74784.2us
I20260709 12:28:38.749506 26975 raft_consensus.cc:3055] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:38.826088 26182 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.826581 26975 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.820379 25533 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:38.751770 26977 raft_consensus.cc:740] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.828032 26182 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.828845 26977 consensus_queue.cc:260] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.829496 26976 raft_consensus.cc:2749] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:38.830310 26977 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.830751 26969 consensus_queue.cc:1059] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:38.832471 26969 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.832819 26970 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.831038 26983 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.751446 26941 raft_consensus.cc:740] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:38.750137 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.752746 26885 raft_consensus.cc:3055] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:38.751068 26954 raft_consensus.cc:3055] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:38.764120 26981 consensus_queue.cc:1059] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:28:38.764297 26929 consensus_queue.cc:1059] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
W20260709 12:28:38.849794 25609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.850623 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:38.855098 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.857379 25560 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:38.855132 25460 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:38.858455 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.836270 25486 raft_consensus.cc:3060] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.830386 25488 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:38.856994 26922 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:38.842147 26954 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.865911 26922 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:38.866488 26922 raft_consensus.cc:697] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:38.866847 26954 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.867367 26922 consensus_queue.cc:237] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.868317 26954 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.867921 25635 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:38.843024 26785 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:38.747193 26900 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:38.871235 25636 raft_consensus.cc:1275] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:38.749490 26810 consensus_queue.cc:1243] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer bf67e247c9e5443ea0099083f496b361 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:38.759967 26947 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:38.749475 26923 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:38.747682 26942 raft_consensus.cc:3055] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.873301 26942 raft_consensus.cc:740] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:38.873415 26878 consensus_queue.cc:1048] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:38.874332 26942 consensus_queue.cc:260] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.750360 26953 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:38.747189 26968 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:38.813398 26980 raft_consensus.cc:740] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:38.878275 25561 raft_consensus.cc:1240] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.841552 26885 raft_consensus.cc:740] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:38.879565 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.880522 25561 raft_consensus.cc:2393] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 3: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:38.880148 26885 consensus_queue.cc:260] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.881386 26885 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.876657 26980 consensus_queue.cc:260] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.881606 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.882411 26980 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.882773 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.850059 26964 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.887671 26981 raft_consensus.cc:3055] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.888134 26981 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:38.883716 25566 raft_consensus.cc:2393] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:38.889008 26981 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:38.890515 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.892827 26911 raft_consensus.cc:3055] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:38.893290 26911 raft_consensus.cc:740] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.893687 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.894052 26911 consensus_queue.cc:260] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.894856 26981 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.895243 26911 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.834555 26941 consensus_queue.cc:260] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.898156 26941 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.898594 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.891630 26929 raft_consensus.cc:3055] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:38.901733 26929 raft_consensus.cc:740] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:38.902630 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.903795 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:38.833134 26969 raft_consensus.cc:3055] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:38.905588 26969 raft_consensus.cc:740] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.906370 26969 consensus_queue.cc:260] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.907184 25568 raft_consensus.cc:1240] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.907796 26969 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.913609 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:38.915073 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:38.916014 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:38.916941 25634 raft_consensus.cc:2393] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:38.917830 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.918466 25493 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:38.919924 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:38.922709 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 71793.5us
W20260709 12:28:38.923549 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 68548.6us
I20260709 12:28:38.924177 25532 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:38.924743 25458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.931234 26406 raft_consensus.cc:3055] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:38.931699 26406 raft_consensus.cc:740] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.927748 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:38.927909 25491 raft_consensus.cc:1240] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.925307 26738 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:38.928438 25489 raft_consensus.cc:1240] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:38.969942 26180 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:38.962438 25461 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:38.902880 26929 consensus_queue.cc:260] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:38.978936 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 54981.1us
I20260709 12:28:38.980536 25532 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:38.979060 26182 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:38.976938 25560 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:38.982764 26938 raft_consensus.cc:2804] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:38.986840 26938 raft_consensus.cc:697] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.987257 26948 raft_consensus.cc:2804] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:38.987797 26948 raft_consensus.cc:697] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:38.987730 26938 consensus_queue.cc:237] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:38.982411 26785 consensus_queue.cc:1059] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:38.983608 26805 consensus_queue.cc:1048] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:38.983773 26406 consensus_queue.cc:260] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:38.893733 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:38.992200 25608 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:38.997566 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:38.978999 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.000200 25608 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.003455 25608 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.005102 25535 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.006742 25535 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.007018 26182 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.007977 26953 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:39.009066 26962 raft_consensus.cc:2749] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:39.013154 26963 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:39.013978 26915 raft_consensus.cc:3055] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:39.014377 26915 raft_consensus.cc:740] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:39.015657 26952 raft_consensus.cc:3055] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:39.016081 26952 raft_consensus.cc:740] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:39.016891 26952 consensus_queue.cc:260] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.018110 26952 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.021117 25641 raft_consensus.cc:1240] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:39.021639 25609 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:39.021939 25532 leader_election.cc:400] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5.
I20260709 12:28:39.015285 26915 consensus_queue.cc:260] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.022331 25532 leader_election.cc:403] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:39.022850 26915 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.023182 26709 raft_consensus.cc:2804] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:39.023736 26709 raft_consensus.cc:697] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:39.001736 26917 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:39.024607 26709 consensus_queue.cc:237] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:38.998881 26990 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:38.993664 26932 raft_consensus.cc:2749] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.012063 25608 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.033036 26990 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.035382 26990 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:39.036159 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:39.027143 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:39.037647 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:39.038307 26404 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:39.039259 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:39.039510 25486 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:39.040443 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:38.993757 26897 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:28:39.025336 25488 raft_consensus.cc:1240] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:28:39.045499 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:39.046452 26964 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.047207 26409 raft_consensus.cc:1240] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:39.048907 26976 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:39.049468 26976 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:39.029243 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:38.998809 26883 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:38.988780 26948 consensus_queue.cc:237] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:39.063033 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 56422.4us
I20260709 12:28:39.064319 25535 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:39.064846 27001 log.cc:927] Time spent T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:39.065620 26963 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:39.066341 26963 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.060714 26982 raft_consensus.cc:2749] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5.
I20260709 12:28:39.061800 26810 consensus_queue.cc:1059] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:39.068917 25532 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.074460 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:39.075476 25532 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.076696 25532 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.077427 26932 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.078181 26932 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:39.078495 26932 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:39.078828 26932 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:39.052546 26406 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.010144 26970 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:39.057770 25562 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:39.082787 25487 raft_consensus.cc:1240] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:39.079392 26988 consensus_queue.cc:1059] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:28:39.087765 25532 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.087957 25535 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.090181 25608 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.095546 25532 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.096503 26793 consensus_queue.cc:1059] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:39.082731 26962 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:39.097681 26890 raft_consensus.cc:3055] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:39.098088 26962 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.098495 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:39.100600 26962 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:39.100831 26918 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:39.098101 26890 raft_consensus.cc:740] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:39.101867 25459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.091003 26983 consensus_queue.cc:1059] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:28:39.102260 26890 consensus_queue.cc:260] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.103751 26890 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:39.104262 26883 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:39.063808 26951 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:39.098290 26942 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:39.106971 25608 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.106171 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:39.112263 25489 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:39.105695 26918 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.115226 25641 raft_consensus.cc:1240] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:39.115736 26990 raft_consensus.cc:3055] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:39.116143 26990 raft_consensus.cc:740] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:39.116500 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.116919 26990 consensus_queue.cc:260] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:39.118137 26990 raft_consensus.cc:3060] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:39.110142 25535 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.117995 25608 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.127915 26961 raft_consensus.cc:2749] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:39.128393 26962 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:39.131420 26899 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:39.134756 25608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.090569 26929 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:39.136682 25608 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.088817 26982 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:28:39.142472 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.113304 26920 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:39.143180 26922 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:28:39.143889 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 48484.2us
I20260709 12:28:39.143674 26793 consensus_queue.cc:1059] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:39.138170 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:39.147130 25533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:39.157374 26181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:39.168985 26181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:39.164274 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.171244 26793 raft_consensus.cc:3055] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:39.171772 26793 raft_consensus.cc:740] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:39.126226 26937 consensus_queue.cc:1175] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bf67e247c9e5443ea0099083f496b361" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:28:39.171923 26899 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:39.119290 26975 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.156147 26983 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:39.183874 26181 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.192690 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:39.195709 26182 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.173339 26982 consensus_queue.cc:1059] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:39.172781 26931 raft_consensus.cc:3055] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:39.197562 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:39.172783 26899 raft_consensus.cc:697] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:39.198770 25460 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.202922 26980 raft_consensus.cc:3055] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:39.203299 26980 raft_consensus.cc:740] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:39.172772 26793 consensus_queue.cc:260] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.204180 26980 consensus_queue.cc:260] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:39.204926 26793 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.205271 26900 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.206532 25565 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:39.211669 25564 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:39.217620 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:39.218700 26181 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.220361 26899 consensus_queue.cc:237] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.220994 26950 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:39.208928 26931 raft_consensus.cc:740] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:39.224450 26931 consensus_queue.cc:260] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:39.225428 26931 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:39.229570 26985 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:39.235981 26911 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:39.236438 26911 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:39.236799 26911 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:39.235405 26985 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.245879 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:39.249540 26181 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.271409 25609 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.238467 26887 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:28:39.261853 26732 consensus_queue.cc:1059] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:28:39.273232 26181 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.271515 26418 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:39.230458 26980 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:39.253928 26406 raft_consensus.cc:1275] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:28:39.269802 26949 consensus_meta.cc:287] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:28:39.240037 26971 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:39.274163 26964 raft_consensus.cc:3055] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:39.286523 26918 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:39.286906 26910 consensus_queue.cc:1059] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:28:39.233107 26954 consensus_queue.cc:1059] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:28:39.319895 26181 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.323532 25493 raft_consensus.cc:1240] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:39.337150 25458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:39.375697 25458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:39.353319 25608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.378158 25492 raft_consensus.cc:1240] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:39.287827 26948 raft_consensus.cc:2749] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:39.324119 26939 consensus_queue.cc:1059] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 12:28:39.329742 26973 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:28:39.316807 26693 raft_consensus.cc:3055] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:28:39.297897 27003 log.cc:927] Time spent T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:28:39.369411 25641 raft_consensus.cc:1240] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:39.308408 27008 log.cc:927] Time spent T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:28:39.354326 25535 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:39.380525 25458 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:39.398133 25639 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
W20260709 12:28:39.398784 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 44555.2us
I20260709 12:28:39.352114 26964 raft_consensus.cc:740] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:39.400300 26597 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.390030 25637 raft_consensus.cc:1240] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
W20260709 12:28:39.450558 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 47766.2us
I20260709 12:28:39.370926 26982 consensus_queue.cc:1059] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:28:39.391177 26693 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:39.474435 26597 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:39.475203 26597 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.452402 26990 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:28:39.478716 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.450531 26910 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:39.484287 26597 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:39.456130 26920 consensus_queue.cc:1059] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:28:39.494242 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:39.495010 25637 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:39.475085 26950 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:39.481530 26990 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:39.491911 25561 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:39.487306 26943 consensus_queue.cc:1059] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:28:39.494516 26954 consensus_queue.cc:1243] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer bf67e247c9e5443ea0099083f496b361 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:39.594594 26938 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:39.488351 26910 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:39.618366 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 298531us
I20260709 12:28:39.499408 26971 raft_consensus.cc:697] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:39.619206 26181 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.597213 26990 raft_consensus.cc:3060] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:39.605033 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.590057 26693 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:39.610248 26969 consensus_queue.cc:1059] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:28:39.620239 26733 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:39.642812 26181 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.596050 26950 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:39.620116 27006 log.cc:927] Time spent T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 12:28:39.639987 27020 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:39.652732 27018 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:28:39.672197 27007 log.cc:927] Time spent T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:39.666865 26693 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:39.670123 27020 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:39.729326 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 86631.2us
I20260709 12:28:39.689033 26911 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:39.750842 26181 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.711673 26793 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:39.719978 25495 raft_consensus.cc:1240] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 1. Current term is 2. Ops: []
W20260709 12:28:39.708971 26932 consensus_meta.cc:287] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.623s	user 0.002s	sys 0.009s
I20260709 12:28:39.752466 26793 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.761132 27021 raft_consensus.cc:2749] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:39.763247 26793 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:39.765450 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.767138 27019 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:39.767271 26402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:39.767750 27019 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:39.768486 26402 raft_consensus.cc:606] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.770558 27019 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:39.771746 26938 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:39.772287 26938 raft_consensus.cc:697] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:39.773240 26938 consensus_queue.cc:237] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:39.773717 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:39.774602 26406 raft_consensus.cc:2393] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:39.775249 26402 raft_consensus.cc:1240] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:39.776310 26406 raft_consensus.cc:1240] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:39.779300 25495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c409decd6b41e38642164bc29adcac"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:39.780311 25495 raft_consensus.cc:606] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.780745 25495 raft_consensus.cc:614] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:39.754160 26932 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:39.755113 26980 consensus_queue.cc:1059] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:39.690462 26950 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:39.705046 26942 consensus_meta.cc:287] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.007s
W20260709 12:28:39.730357 27011 log.cc:927] Time spent T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:28:39.783560 26932 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:39.705987 27010 log.cc:927] Time spent T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:28:39.691675 26910 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:39.785974 25488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:39.786707 25488 raft_consensus.cc:606] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.787930 26980 raft_consensus.cc:3055] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:39.788061 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:39.788486 26980 raft_consensus.cc:740] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:39.789448 26980 consensus_queue.cc:260] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.790512 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:39.752822 26911 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:39.791580 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.802453 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:39.803432 25569 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:39.804235 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:39.804965 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:39.806583 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:39.807389 25569 raft_consensus.cc:1240] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:39.792364 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:39.794045 26419 raft_consensus.cc:3055] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:39.811019 26419 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:39.812125 26419 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:39.813671 26419 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:39.814420 26950 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:39.795018 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:39.815287 26980 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:39.795722 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:39.797008 25562 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:39.798187 25567 raft_consensus.cc:1275] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:39.800463 27020 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:39.801187 26941 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:39.814973 26950 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.821962 26408 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:39.823182 26950 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:39.678517 26971 consensus_queue.cc:237] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:39.828806 26181 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:39.827692 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:39.835650 26419 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:39.834694 27020 consensus_queue.cc:1059] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 12:28:39.850274 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 221784us
I20260709 12:28:39.834944 26950 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:39.853971 25606 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.863095 25606 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:39.875073 25532 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.837069 26990 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.852975 26950 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:39.838425 26910 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:28:39.849586 26911 consensus_queue.cc:1048] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:28:39.857069 26918 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:39.853020 26941 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:28:39.884769 26923 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:39.860880 26884 consensus_queue.cc:1059] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:28:39.886255 26950 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:39.887302 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 209051us
I20260709 12:28:39.899711 25634 raft_consensus.cc:2393] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 6: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:39.893743 26793 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:39.906786 27024 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:39.910229 27024 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:39.912616 27024 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:39.909330 27015 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:28:39.904549 26923 raft_consensus.cc:697] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
W20260709 12:28:39.945967 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 83024.1us
I20260709 12:28:39.950091 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:39.953231 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:39.953281 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:39.954272 25635 raft_consensus.cc:2393] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:39.954954 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:39.955757 25643 raft_consensus.cc:2393] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:39.956779 25641 raft_consensus.cc:2393] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:39.966017 26990 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:39.966353 26923 consensus_queue.cc:237] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:39.968708 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:39.977815 26938 raft_consensus.cc:993] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:39.979063 26409 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:39.981626 26180 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:39.980386 26948 raft_consensus.cc:1081] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:39.983153 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:39.983913 26948 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:39.984962 25495 raft_consensus.cc:2468] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:39.986470 26983 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:28:39.988473 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:39.993211 25535 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:39.994029 26985 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:39.994630 26982 raft_consensus.cc:2804] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:39.995285 26982 raft_consensus.cc:697] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:39.999464 26936 consensus_queue.cc:1059] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:39.999766 26982 consensus_queue.cc:237] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.004544 26964 consensus_queue.cc:260] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.006137 26964 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:40.013005 25313 catalog_manager.cc:5697] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 3, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:40.019454 25495 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:40.019701 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:40.020164 25491 raft_consensus.cc:1275] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:40.021097 25488 raft_consensus.cc:2393] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:40.022815 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:40.025247 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.025995 25566 raft_consensus.cc:2393] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:40.027063 25495 raft_consensus.cc:1275] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:40.027742 26985 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:40.027690 26938 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.016721 25313 catalog_manager.cc:5697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:40.030956 25313 catalog_manager.cc:5697] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 4 to 5, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 5 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:40.032358 25313 catalog_manager.cc:5697] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 5, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 5 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:40.033213 26180 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:40.037190 26180 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:40.044301 25637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:48680
I20260709 12:28:40.045202 25637 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:40.045682 25637 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:40.042526 26805 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:40.042665 26971 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:40.050359 27028 consensus_queue.cc:1048] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:40.028786 26936 consensus_queue.cc:1243] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:40.030578 26976 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:40.086169 25533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:40.170960 26181 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.163297 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:40.070911 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.052979 26938 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.182236 25636 raft_consensus.cc:2393] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
W20260709 12:28:40.188679 27033 log.cc:927] Time spent T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:28:40.189885 27034 log.cc:927] Time spent T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:28:40.203521 25495 raft_consensus.cc:1240] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:28:40.206612 25495 raft_consensus.cc:1240] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:40.208016 25606 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:40.209739 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:40.210847 25635 raft_consensus.cc:2393] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 6: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:40.167986 26953 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:40.201995 27006 log.cc:927] Time spent T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:28:40.219158 26941 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:40.225297 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.226545 25637 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.228219 26950 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.228540 26968 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:40.214097 26917 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:40.263073 25459 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:40.213053 27024 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.294641 25608 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:40.300624 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:40.301028 25567 raft_consensus.cc:1275] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:40.302556 25635 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
I20260709 12:28:40.301705 25637 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.220074 26938 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.312585 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:40.215655 26923 consensus_queue.cc:1059] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:28:40.314452 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:40.315316 26404 raft_consensus.cc:3055] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:40.315759 26404 raft_consensus.cc:740] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:40.317597 27021 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:40.318226 27021 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.318912 26949 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:40.319707 26949 raft_consensus.cc:697] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:40.320719 27021 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.321936 26976 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.322522 26976 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.323447 26977 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:40.320941 26949 consensus_queue.cc:237] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.324041 26977 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.316877 26404 consensus_queue.cc:260] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.215229 26922 consensus_queue.cc:1059] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:28:40.305859 26793 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:40.305414 26968 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.300097 26983 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:40.262918 26941 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.308705 27024 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.327330 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:40.353528 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.309031 26884 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:40.363273 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.334687 26597 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:40.366286 25569 raft_consensus.cc:2393] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:40.370874 26597 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.371477 26597 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:40.373628 25641 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:40.379127 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:40.379743 25567 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:40.335191 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.222075 26953 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.384027 25563 raft_consensus.cc:1240] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:40.327970 25638 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:40.383658 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:40.328365 26404 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:40.338478 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:40.340515 26941 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.336205 26918 raft_consensus.cc:3055] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:40.325136 26976 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.331059 26968 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.333520 26950 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.326408 26977 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.328838 26793 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.389022 26971 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:40.337658 26983 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.427625 26937 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.378751 26884 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.429615 26920 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:28:40.442646 26922 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:40.441656 26918 raft_consensus.cc:740] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:40.380686 26944 consensus_queue.cc:1048] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:28:40.382830 27045 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.437490 27029 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.475032 27029 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.477763 27045 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.480171 27045 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.481061 26917 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.481575 26917 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.483541 26917 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.484004 26917 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.484382 26917 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.485605 26922 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.486753 26793 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.487794 26922 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.488713 26953 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:40.450814 27038 log.cc:927] Time spent T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:28:40.469758 26597 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.444273 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.444294 27024 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.471732 25567 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:40.477003 27029 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:40.474573 27036 log.cc:927] Time spent T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:28:40.507046 26597 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:40.472240 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 149331us
W20260709 12:28:40.531495 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 157749us
W20260709 12:28:40.532119 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.526120 26953 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.480674 27045 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.543681 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.544096 26415 raft_consensus.cc:1275] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:40.544610 26418 raft_consensus.cc:2393] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:40.470527 26937 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.514228 26917 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.559850 25568 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
W20260709 12:28:40.547873 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:40.539644 27029 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.578321 26918 consensus_queue.cc:260] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.548703 27021 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.587508 26597 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:40.588167 26597 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:40.563830 27048 log.cc:927] Time spent T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:28:40.590148 26180 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:40.592720 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.600131 25637 raft_consensus.cc:1275] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:28:40.600613 25637 pending_rounds.cc:85] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 2
I20260709 12:28:40.600904 25637 pending_rounds.cc:107] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:28:40.601187 25637 raft_consensus.cc:2889] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:40.576917 26971 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.549365 26953 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.581120 27024 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:40.612327 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 349345us
I20260709 12:28:40.582024 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.604482 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:40.618563 26597 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.554822 27045 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.596449 26920 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.619663 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:40.620474 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:40.623595 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 90530.1us
I20260709 12:28:40.623749 25643 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:40.629031 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:40.629922 25493 raft_consensus.cc:2393] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:40.603986 27012 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:40.587390 27029 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.637004 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:40.659789 25635 raft_consensus.cc:2393] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 2: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:40.592293 27021 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.561547 26982 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:28:40.663316 26597 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.668640 26597 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.664093 25459 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:40.665825 26180 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:40.671703 26983 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.672142 26937 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.657994 27012 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.672609 26597 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.672742 27012 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:40.673017 26950 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:28:40.673949 27049 log.cc:927] Time spent T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:28:40.675652 26899 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:40.683667 26180 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:40.678109 26975 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:40.679392 26985 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:40.617553 26971 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.679816 27021 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.680289 26408 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:40.681079 27066 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.681329 27056 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:40.841629 27033 log.cc:927] Time spent T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:28:40.682117 25560 raft_consensus.cc:3055] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:40.623262 26406 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:40.682825 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.632321 27050 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.711452 26597 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
W20260709 12:28:40.744434 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 73870.2us
W20260709 12:28:40.842181 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 170788us
I20260709 12:28:40.670617 26917 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.617347 27024 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.911638 26883 raft_consensus.cc:3055] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:40.912097 26883 raft_consensus.cc:740] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
W20260709 12:28:40.912407 27046 log.cc:927] Time spent T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:28:40.913153 27024 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.912943 26883 consensus_queue.cc:260] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.915746 27052 raft_consensus.cc:993] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:40.916239 27052 raft_consensus.cc:1081] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
W20260709 12:28:40.916428 25460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.031s	sys 0.072s
W20260709 12:28:40.916755 25460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.031s	sys 0.072s
I20260709 12:28:40.918481 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.921205 27045 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.872602 26985 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.922995 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.923293 25638 raft_consensus.cc:1275] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:40.924139 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.924185 26985 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.924747 26408 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:40.683493 27030 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:40.632783 26920 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.928035 26920 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.881456 25560 raft_consensus.cc:740] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:40.883378 26884 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.866317 26899 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.781874 26937 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.886071 26419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53796 (request call id 309) took 1037 ms. Trace:
I20260709 12:28:40.929080 26419 rpcz_store.cc:276] 0709 12:28:39.849123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.851865 (+  2742us) service_pool.cc:224] Handling call
0709 12:28:40.682647 (+830782us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5800312098. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:28:40.885998 (+203351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31503616}
I20260709 12:28:40.931089 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.932154 25560 consensus_queue.cc:260] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.933132 25560 raft_consensus.cc:3060] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:40.933321 25533 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:40.935006 27055 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.935453 27055 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.937345 26937 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:40.937731 25561 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39676 (request call id 586) took 2058 ms (client timeout 1516 ms). Trace:
I20260709 12:28:40.938498 26923 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:40.939604 26937 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.941481 26899 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.941846 26878 raft_consensus.cc:3055] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:40.872241 26969 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:40.942911 26969 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:40.943356 26969 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:40.902045 27053 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.946272 27029 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.946514 26932 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.947027 26932 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.948441 26971 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.885129 27056 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.937338 26982 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:28:40.951874 27056 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.952373 25569 raft_consensus.cc:1240] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:40.884006 27058 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:40.953791 27058 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.954802 26953 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.956512 27058 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.957387 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:40.957512 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:40.958079 25643 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:40.958331 26409 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:28:40.958850 26883 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:40.959059 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:40.962244 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:40.916998 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 531178us
I20260709 12:28:40.962839 26415 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:40.963735 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.964277 26415 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:40.966065 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.967396 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.904508 27021 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.968725 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.969321 27021 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.971048 26885 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.948987 26932 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.971534 26885 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.971892 26932 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.898275 26597 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.973762 27035 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.973917 26597 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.974411 26597 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:40.974112 26917 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.974884 26597 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.909493 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:40.976908 25635 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:40.910502 25637 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:40.969946 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.978020 26941 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:40.978458 26597 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.978960 26597 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.978684 26941 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.910677 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.911047 26950 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.980551 26950 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.903331 26793 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:40.981774 26793 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:40.982537 26950 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.979406 26597 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.983995 26885 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.984222 26793 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.977027 27050 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:40.987046 26597 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.987665 26932 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:40.906500 27061 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:41.003398 25488 raft_consensus.cc:1275] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:41.004532 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.008260 27061 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.008884 25487 raft_consensus.cc:2368] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5.
I20260709 12:28:41.005105 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:40.989828 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:40.993956 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.009449 26406 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:40.986644 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.010471 25569 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:41.010632 27061 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:40.965018 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.942359 26878 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:41.011528 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:40.995577 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.011994 26878 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:41.012625 25642 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:41.003778 25495 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:41.013337 26878 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:40.993295 25532 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:41.014583 26408 raft_consensus.cc:2393] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:41.003841 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.015509 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.015705 25634 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:41.016147 26408 raft_consensus.cc:2393] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
W20260709 12:28:40.938294 25561 rpcz_store.cc:269] 0709 12:28:38.879612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.881297 (+  1685us) service_pool.cc:224] Handling call
0709 12:28:40.937479 (+2056182us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540009b0d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:40.937629 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454995328}
I20260709 12:28:41.016986 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:41.004794 26401 consensus_meta.cc:287] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
I20260709 12:28:40.976900 26917 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:41.018671 27055 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:40.974294 27035 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:40.988858 27050 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:40.924998 26985 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:41.021813 26985 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.024410 26932 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:41.026463 26404 consensus_meta.cc:287] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.006s
I20260709 12:28:41.027046 26404 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:40.946305 27053 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.017668 26401 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:41.035792 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.036218 26401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53780 (request call id 660) took 1184 ms. Trace:
I20260709 12:28:41.003047 25640 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:40.882274 27066 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.037622 25490 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:41.038394 26936 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.038903 26936 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.039484 26920 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.003211 25492 raft_consensus.cc:1275] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:41.005450 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.039834 27066 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:41.041069 27053 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:41.044168 25635 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:41.040658 25634 raft_consensus.cc:1275] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:41.021813 27035 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:40.971920 27021 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:40.876883 25639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48680 (request call id 177) took 2377 ms (client timeout 1825 ms). Trace:
I20260709 12:28:41.039968 26920 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:41.045413 25639 rpcz_store.cc:269] 0709 12:28:38.488221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.488334 (+   113us) service_pool.cc:224] Handling call
0709 12:28:40.865801 (+2377467us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b5400676454. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:40.865949 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504499072}
I20260709 12:28:41.011543 26415 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:41.030164 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.029701 26941 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:41.031278 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.047180 26920 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:41.047101 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.031090 27055 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:41.003765 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.032907 26181 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:41.033017 27015 consensus_queue.cc:1059] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:41.049198 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.050006 27015 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:41.033659 26733 consensus_queue.cc:1048] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:41.034560 25560 raft_consensus.cc:1275] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:41.050635 27015 raft_consensus.cc:697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
W20260709 12:28:41.051220 26981 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:28:41.052158 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.051819 27015 consensus_queue.cc:237] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.052976 25493 raft_consensus.cc:2393] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:41.033849 26180 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:41.036564 26401 rpcz_store.cc:276] 0709 12:28:39.851815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.852864 (+  1049us) service_pool.cc:224] Handling call
0709 12:28:40.338240 (+485376us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800312098. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:28:41.036135 (+697895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32633600}
I20260709 12:28:41.058127 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.058851 25493 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:41.041145 26936 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:41.040086 26983 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:41.060904 26180 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:41.048207 25490 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:41.048638 27055 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:40.925401 26182 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:41.132234 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 206894us
I20260709 12:28:41.054456 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.049219 25637 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:41.056622 25495 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:41.004220 25486 raft_consensus.cc:1275] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:41.064791 26180 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:41.122938 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.129420 26983 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.150355 25533 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:41.138933 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.151899 25495 raft_consensus.cc:2393] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:41.154654 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.155262 25533 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:41.040235 27058 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.131047 27021 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.161186 27021 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:41.162410 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.163121 26404 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:41.163321 27021 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:41.164408 26404 raft_consensus.cc:1275] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:41.164615 27021 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:41.138006 26733 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:41.137744 27018 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:41.165395 26733 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.165488 27018 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.165840 26733 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:41.165920 27018 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.166658 26969 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:41.167347 27058 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.169271 26419 raft_consensus.cc:2368] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:41.140815 26977 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:41.165403 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.131826 26732 raft_consensus.cc:3055] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:41.172284 25639 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:41.136298 27055 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:41.135814 26936 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.131122 26932 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.168763 26969 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:41.154047 27066 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.165096 27021 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.138449 26971 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:28:41.187203 26932 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.187916 26409 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:41.172776 26929 raft_consensus.cc:2804] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:41.172498 26933 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:41.192564 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.185698 25638 raft_consensus.cc:2393] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 7: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:41.176226 26732 raft_consensus.cc:740] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:41.179952 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.194936 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.184906 26936 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.201121 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.203042 27012 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.195333 27058 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:41.196089 26929 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.188572 26883 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:41.197695 26985 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:41.191021 27021 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:41.237968 25487 raft_consensus.cc:1275] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:41.217566 25495 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:41.190536 27066 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:41.227743 25486 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:41.199622 26933 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.208835 26732 consensus_queue.cc:260] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:41.233806 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:41.235292 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 336094us
I20260709 12:28:41.236897 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.229116 26941 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:41.244345 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.232339 26929 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:41.243407 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.238768 26402 raft_consensus.cc:2368] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 7. Current term is 8.
I20260709 12:28:41.232328 27056 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.234961 26915 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.261493 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.266534 25535 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:41.317903 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 51487.1us
I20260709 12:28:41.244449 26933 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.237130 26883 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.260651 26732 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.289804 25494 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:41.269021 27012 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:41.290990 25489 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 1.
I20260709 12:28:41.276932 25488 raft_consensus.cc:1240] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:41.268007 27058 consensus_queue.cc:1048] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:28:41.329610 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:41.322692 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 457411us
I20260709 12:28:41.325079 25535 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:41.327909 25460 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:41.338121 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:41.341580 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:41.342383 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 277679us
I20260709 12:28:41.338692 25569 raft_consensus.cc:2376] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2. Re-sending same reply.
I20260709 12:28:41.344478 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.345505 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.345685 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.346423 25564 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:41.351158 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.346119 25562 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:41.320518 26990 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:41.343170 26180 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:41.345060 25569 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:41.307626 26941 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:41.359165 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.359805 26941 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:41.359894 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.360584 25637 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:41.360639 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.360767 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.361828 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.362574 25635 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:41.330159 26983 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:41.362691 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.361956 25642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53082
I20260709 12:28:41.369899 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.370147 25642 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:41.363476 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.370519 25642 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.370867 25568 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:41.340727 27053 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.321115 25490 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:41.373425 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:41.342607 26976 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.374195 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.375044 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.375645 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.384339 25635 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:41.368626 25640 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:41.376374 25532 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:41.377188 25634 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:41.376391 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 48574.4us
I20260709 12:28:41.319912 27056 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.321552 26915 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.354717 26920 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:41.387840 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.388862 25637 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:41.368674 25643 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:41.374176 25608 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:41.390311 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:41.390938 25635 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:41.359941 25638 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:41.389219 27053 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.395117 26980 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:41.395519 26980 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.395848 26980 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:41.362717 26971 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:41.397908 26971 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.398267 26971 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.400027 26408 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:41.364027 26887 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:41.401360 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.403020 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.392652 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:41.404023 25637 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:41.393122 25532 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:41.407426 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.408053 25489 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:41.408715 25569 raft_consensus.cc:2393] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:41.410192 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.410362 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.410822 25639 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:41.411077 25634 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:41.396945 27053 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:41.393754 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.417258 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.372023 26936 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:41.412170 26180 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:41.426222 26182 leader_election.cc:400] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5.
I20260709 12:28:41.372097 26932 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:41.432008 26182 leader_election.cc:403] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:41.426625 25643 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:41.430167 25642 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:41.429126 25494 raft_consensus.cc:2393] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:41.426786 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:41.433058 26182 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:41.420944 25609 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:41.435520 26983 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:41.436110 26983 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:41.438431 26915 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:41.388494 26920 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.439172 26920 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.407956 26887 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.439704 26887 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.426647 25487 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:41.444463 26969 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:41.444307 27012 consensus_queue.cc:1048] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:41.444939 26969 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.445344 26969 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:41.446488 27066 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:41.449290 25640 raft_consensus.cc:1275] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:41.451068 26182 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:41.529134 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 115037us
I20260709 12:28:41.530961 25608 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:41.414641 26937 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:28:41.575918 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 155030us
I20260709 12:28:41.576853 25635 raft_consensus.cc:2468] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:41.427058 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.444365 26954 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5.
I20260709 12:28:41.391571 27074 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.190s
I20260709 12:28:41.393440 26976 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:41.650874 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 199869us
I20260709 12:28:41.536768 26975 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:41.653285 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 74090.2us
W20260709 12:28:41.654038 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 123153us
I20260709 12:28:41.659125 25608 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:41.660264 25608 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:41.661630 26182 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:41.710211 25641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.018s	sys 0.028s
W20260709 12:28:41.712610 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 52454.8us
W20260709 12:28:41.712929 25641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.018s	sys 0.028s
I20260709 12:28:41.664562 25609 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:41.449548 26953 raft_consensus.cc:2804] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:41.585536 26977 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:41.716632 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 52247.7us
I20260709 12:28:41.721894 25609 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:41.724125 25637 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 8.
I20260709 12:28:41.718824 26985 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:41.724293 25533 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:28:41.719296 27077 log.cc:927] Time spent T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:28:41.640707 26899 raft_consensus.cc:2804] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:41.725873 26418 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:41.726028 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.655128 26793 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:28:41.663911 26923 consensus_meta.cc:287] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.725s	user 0.015s	sys 0.001s
I20260709 12:28:41.594022 26949 consensus_queue.cc:1048] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 12:28:41.655789 27012 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:41.733510 25608 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:41.575007 26733 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:41.726894 27075 consensus_queue.cc:1048] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:28:41.740816 26920 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:41.662847 26937 raft_consensus.cc:697] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:41.722019 27066 raft_consensus.cc:2804] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:41.746042 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:41.735136 26950 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.058s	sys 0.069s
I20260709 12:28:41.747660 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:41.749650 26923 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:41.735680 26899 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.720752 26954 raft_consensus.cc:2749] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:41.723615 26961 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:41.751282 27056 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:41.753922 26793 raft_consensus.cc:697] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:41.754663 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:41.755119 27076 log.cc:927] Time spent T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:28:41.715191 27015 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:28:41.715886 26878 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:28:41.750991 26982 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:41.779034 25532 leader_election.cc:400] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 7. Current term is 8.
I20260709 12:28:41.956049 25532 leader_election.cc:403] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:41.736531 26932 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:41.861497 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:41.788672 26964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.011s	sys 0.032s
I20260709 12:28:41.774479 27075 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:41.934649 26887 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:41.936510 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.881232 27043 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:41.728732 26985 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.732980 27053 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:41.966401 26964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.015s	sys 0.053s
I20260709 12:28:41.736965 26953 raft_consensus.cc:697] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:41.918320 26950 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.060s	sys 0.072s
I20260709 12:28:41.960682 25489 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:41.948088 26899 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:41.934710 27078 log.cc:927] Time spent T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:28:41.829438 26949 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:41.777088 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 43664us
I20260709 12:28:41.994272 25459 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:41.917068 26961 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.000429 26961 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:42.001111 26419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53796 (request call id 317) took 1365 ms. Trace:
I20260709 12:28:42.001524 26419 rpcz_store.cc:276] 0709 12:28:40.635887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.930839 (+294952us) service_pool.cc:224] Handling call
0709 12:28:42.000914 (+1070075us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400005d54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:42.001051 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546167168}
I20260709 12:28:42.002737 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:42.003186 27018 consensus_meta.cc:287] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.004s
W20260709 12:28:41.970729 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 309145us
I20260709 12:28:41.909106 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:41.729164 26977 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.047833 26977 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:41.970373 27066 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:42.054128 27066 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:42.055922 26969 consensus_meta.cc:287] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
I20260709 12:28:42.056394 26969 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:41.881631 27065 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:41.739290 26406 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.023s
W20260709 12:28:41.966312 27055 consensus_meta.cc:287] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
I20260709 12:28:41.914740 25636 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:41.960412 26932 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:41.986536 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.958470 26409 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
W20260709 12:28:41.976006 26971 consensus_meta.cc:287] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.003s
I20260709 12:28:41.768424 26929 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:41.760937 26933 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:41.774281 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:41.999059 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.999275 26733 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.003587 26401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53780 (request call id 672) took 1101 ms. Trace:
I20260709 12:28:42.003895 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.008005 25491 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43728 (request call id 575) took 1657 ms. Trace:
W20260709 12:28:42.009747 26418 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53796 (request call id 314) took 1400 ms (client timeout 1741 ms). Trace:
I20260709 12:28:41.998317 26964 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:28:42.011365 26887 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:42.011870 25642 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.012785 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:41.993062 26949 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:42.015524 27021 consensus_meta.cc:287] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.779s	user 0.006s	sys 0.005s
I20260709 12:28:41.981500 27053 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:41.978223 27043 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.095907 27043 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.064275 27055 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.098910 25566 raft_consensus.cc:1275] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:42.099818 27055 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.100736 25564 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
W20260709 12:28:42.018695 26980 consensus_meta.cc:287] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 12:28:42.101632 26980 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.103113 26933 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.103881 26949 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:42.104333 26980 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.013360 26793 consensus_queue.cc:237] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.016705 26937 consensus_queue.cc:237] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:41.972100 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 193287us
W20260709 12:28:41.852109 26732 consensus_meta.cc:287] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 12:28:41.973366 27075 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.037772 26899 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.114868 25561 raft_consensus.cc:2393] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:42.116385 27075 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.037989 27015 consensus_queue.cc:1048] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:42.039099 27018 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.118697 26933 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:42.119040 27018 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.003193 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.119294 26933 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.119856 26420 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:42.120847 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.122021 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.123139 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.123881 26420 raft_consensus.cc:2393] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 5: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:42.124198 26976 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.041216 26878 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.124859 26878 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.127044 26878 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:41.971763 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 235561us
I20260709 12:28:42.129577 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:42.129669 25533 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:28:42.057379 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 261477us
I20260709 12:28:42.130404 25493 raft_consensus.cc:2368] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:42.130519 27089 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:42.129015 27093 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:42.130851 26929 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.131426 27093 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.130924 27089 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.132261 27089 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:42.133539 25567 raft_consensus.cc:2393] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 3: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
W20260709 12:28:42.059947 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 65758.6us
W20260709 12:28:42.060177 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 151181us
I20260709 12:28:42.135396 25459 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:42.037864 27071 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.136570 26920 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:42.059793 26406 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.012s	sys 0.024s
I20260709 12:28:42.136844 27071 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.077857 25491 rpcz_store.cc:276] 0709 12:28:40.351070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.351249 (+   179us) service_pool.cc:224] Handling call
0709 12:28:41.058688 (+707439us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800034898. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:28:41.058939 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:41.059372 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:41.059413 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:41.177981 (+118568us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b2c001b8a78. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e222e2a11 00007f1e222f2372 00007f1e23a24a01 00007f1e239e943a 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2
0709 12:28:41.185331 (+  7350us) log.cc:844] Serialized 26 byte log entry
0709 12:28:41.355184 (+169853us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:28:41.355243 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.355338 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:42.007783 (+652445us) raft_consensus.cc:1685] finished
0709 12:28:42.007803 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.007925 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34330,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5712,"spinlock_wait_cycles":18732160,"thread_start_us":166665,"threads_started":1,"wal-append.queue_time_us":240280}
I20260709 12:28:42.064321 26915 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:42.079562 26418 rpcz_store.cc:269] 0709 12:28:40.609535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.609665 (+   130us) service_pool.cc:224] Handling call
0709 12:28:40.918304 (+308639us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b5800312098. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:28:42.009594 (+1091290us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b540000a854. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:42.009688 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864261760}
I20260709 12:28:42.090001 26953 consensus_queue.cc:237] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.066607 27024 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:42.093495 27053 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:41.981701 26985 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.066843 26932 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:42.135317 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.136755 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:42.086200 25492 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 1.
I20260709 12:28:42.155699 25636 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:42.137089 25459 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:42.155965 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.142920 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:42.157912 25635 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:42.159431 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.159512 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:42.145293 27082 log.cc:927] Time spent T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.391s	user 0.004s	sys 0.000s
I20260709 12:28:42.152325 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:42.075878 26401 rpcz_store.cc:276] 0709 12:28:40.901835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.154432 (+252597us) service_pool.cc:224] Handling call
0709 12:28:41.186377 (+ 31945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:41.199690 (+ 13313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:41.213320 (+ 13630us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:41.245105 (+ 31785us) log.cc:844] Serialized 26 byte log entry
0709 12:28:41.392227 (+147122us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:41.406105 (+ 13878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.425547 (+ 19442us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:42.003345 (+577798us) raft_consensus.cc:1685] finished
0709 12:28:42.003370 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.003520 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":1126,"thread_start_us":98534,"threads_started":1,"wal-append.queue_time_us":180850}
I20260709 12:28:42.137341 27021 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.160233 25643 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:42.060959 27065 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.186879 27065 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.160537 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.157110 25459 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:42.146785 25532 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:42.151497 27054 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:42.189489 27054 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.189689 26983 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.148108 27024 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.164804 26418 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:42.171741 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.149695 26180 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:42.193383 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 43798.6us
I20260709 12:28:42.164963 26402 raft_consensus.cc:2393] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 5: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:42.151053 26920 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:42.201100 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 54409.7us
I20260709 12:28:42.154017 26976 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:42.181666 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.183647 27071 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.189851 27054 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.079070 26971 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.117002 26899 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.194259 26180 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:42.238647 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 44480.9us
I20260709 12:28:42.197397 27024 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.167310 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.166471 27056 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:42.164813 26969 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.217893 25635 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:42.236527 26418 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:42.201951 25532 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:42.284021 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 82150.4us
I20260709 12:28:42.284359 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.201808 27018 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:42.180881 27066 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.159890 26732 consensus_queue.cc:1048] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:28:42.291386 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.201647 26950 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:42.294904 25561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39676 (request call id 602) took 1251 ms. Trace:
W20260709 12:28:42.295136 27094 log.cc:927] Time spent T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:28:42.295459 26950 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.291688 26937 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:42.296779 26937 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.297132 26937 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.297746 26950 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.285719 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.300024 26418 raft_consensus.cc:2393] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 5: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:42.300848 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:42.301401 26418 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:42.301608 27092 log.cc:927] Time spent T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 12:28:42.302686 27084 log.cc:927] Time spent T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.553s	user 0.001s	sys 0.008s
I20260709 12:28:42.220796 26409 raft_consensus.cc:2393] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 4: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:42.224996 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:42.288623 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:42.223371 26983 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:42.309640 26415 raft_consensus.cc:2393] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 4: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:42.243750 27067 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:42.314064 25495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43702 (request call id 1011) took 1055 ms. Trace:
I20260709 12:28:42.213508 26920 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.339702 25606 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:42.291599 27087 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.343724 25606 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:42.342845 25643 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:42.245580 26793 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:42.347954 26793 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.295351 25561 rpcz_store.cc:276] 0709 12:28:41.043896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.057762 (+ 13866us) service_pool.cc:224] Handling call
0709 12:28:42.294634 (+1236872us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540031f954. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:42.294839 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057620736}
I20260709 12:28:42.328110 26418 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
W20260709 12:28:42.344538 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 184260us
I20260709 12:28:42.314513 26983 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.351857 26983 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:42.225445 26976 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.352332 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.353811 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.355197 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.355587 27093 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.355734 26418 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:42.339032 26947 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.357338 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.358042 26418 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:42.357740 26947 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.358386 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:42.359018 26402 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:42.359830 26406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53780 (request call id 669) took 1458 ms. Trace:
I20260709 12:28:42.359939 26947 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.351675 25532 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:42.360392 26406 rpcz_store.cc:276] 0709 12:28:40.900969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.128906 (+227937us) service_pool.cc:224] Handling call
0709 12:28:41.137250 (+  8344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:41.171562 (+ 34312us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:28:42.137461 (+965899us) log.cc:844] Serialized 14 byte log entry
0709 12:28:42.359449 (+221988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:42.359515 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:42.359567 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.359648 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.359774 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20526,"prepare.queue_time_us":757677,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":1110953,"threads_started":2}
I20260709 12:28:42.365816 26980 raft_consensus.cc:2804] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:42.366303 26980 raft_consensus.cc:697] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:42.295353 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.367307 26980 consensus_queue.cc:237] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.353892 26976 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.372233 25567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39676 (request call id 611) took 1027 ms. Trace:
I20260709 12:28:42.372763 25567 rpcz_store.cc:276] 0709 12:28:41.344444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.346501 (+  2057us) service_pool.cc:224] Handling call
0709 12:28:42.371994 (+1025493us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400630e54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:42.372158 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797277440}
I20260709 12:28:42.245314 27071 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:28:42.374365 27102 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:42.374922 27102 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.376977 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.377501 26899 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:42.377930 26899 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.378280 26899 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:42.380868 27079 log.cc:927] Time spent T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.640s	user 0.001s	sys 0.009s
I20260709 12:28:42.382150 25638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48680 (request call id 216) took 1007 ms. Trace:
I20260709 12:28:42.383234 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:42.384570 27058 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.385095 27058 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.388269 27096 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:42.390147 27021 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.390266 25533 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:42.390434 26404 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53780 (request call id 679) took 1010 ms. Trace:
I20260709 12:28:42.392138 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.391390 26936 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:42.391224 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.392299 26922 raft_consensus.cc:2804] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:42.392107 26961 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.309312 27018 raft_consensus.cc:697] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:42.391252 25533 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:42.351231 26793 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.244988 27075 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:42.328075 25495 rpcz_store.cc:276] 0709 12:28:41.249936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.250230 (+   294us) service_pool.cc:224] Handling call
0709 12:28:42.288469 (+1038239us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800034898. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:28:42.304294 (+ 15825us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23700864}
W20260709 12:28:42.412272 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 68624.9us
I20260709 12:28:42.432093 25606 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:42.392779 26883 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.420446 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:42.437282 26419 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:42.424302 25636 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:42.414119 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.440321 25569 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:42.441814 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:42.442155 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:42.444205 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 53026.9us
I20260709 12:28:42.351882 25458 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:42.427284 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 271867us
I20260709 12:28:42.353747 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:42.293218 25566 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
W20260709 12:28:42.413445 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 256403us
I20260709 12:28:42.443367 26181 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:42.450062 25459 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:42.451211 25459 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:42.452005 25459 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:42.452755 25459 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:42.433094 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:42.446592 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 94780.2us
I20260709 12:28:42.342285 27067 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:42.328641 26420 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:42.454286 25458 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:42.444247 25569 raft_consensus.cc:2368] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4.
I20260709 12:28:42.461315 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.463251 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.464534 25569 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:42.466780 25606 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:42.470654 25606 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:42.473590 26920 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.456820 26922 raft_consensus.cc:697] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:42.475270 26922 consensus_queue.cc:237] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.393658 26404 rpcz_store.cc:276] 0709 12:28:41.380463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.382834 (+  2371us) service_pool.cc:224] Handling call
0709 12:28:42.389637 (+1006803us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b5800312098. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:28:42.389853 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:42.390063 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:42.390094 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:42.390139 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:28:42.390193 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.390260 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.390377 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15164800}
I20260709 12:28:42.430719 26936 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.482867 26936 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.459216 26887 raft_consensus.cc:2804] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:42.483616 26887 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.483945 26887 raft_consensus.cc:3060] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:42.486490 27058 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.459571 26990 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:42.488996 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:42.139200 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:42.456138 27056 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:42.461151 26976 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:42.460564 27075 raft_consensus.cc:697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:42.457151 27066 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:42.382709 25638 rpcz_store.cc:276] 0709 12:28:41.374279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.395191 (+ 20912us) service_pool.cc:224] Handling call
0709 12:28:41.395472 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:41.442837 (+ 47365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:41.442873 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:41.443417 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:28:41.654879 (+211462us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:28:41.664931 (+ 10052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:41.716028 (+ 51097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:42.302134 (+586106us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:28:42.381787 (+ 79653us) raft_consensus.cc:1685] finished
0709 12:28:42.381816 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.382072 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34251,"raft.queue_time_us":48337,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":5482880,"thread_start_us":201780,"threads_started":1,"wal-append.queue_time_us":273553}
I20260709 12:28:42.391289 27087 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.587667 25313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57458 (request call id 185) took 4462 ms. Trace:
I20260709 12:28:42.589934 26415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53780 (request call id 676) took 1210 ms. Trace:
W20260709 12:28:42.705034 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 252324us
I20260709 12:28:42.705235 26415 rpcz_store.cc:276] 0709 12:28:41.379632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.379759 (+   127us) service_pool.cc:224] Handling call
0709 12:28:42.589683 (+1209924us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b5400005854. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:42.589844 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075873664}
I20260709 12:28:42.488824 26942 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:42.597188 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.597980 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.706719 25459 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:42.584535 26923 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:42.594841 25608 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
W20260709 12:28:42.711051 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 116294us
I20260709 12:28:42.570861 25641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53066 (request call id 1033) took 1945 ms. Trace:
I20260709 12:28:42.613198 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:42.545639 27050 raft_consensus.cc:2764] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:28:42.542275 26884 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:42.588709 26402 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:42.532210 25606 leader_election.cc:400] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:42.716842 25606 leader_election.cc:403] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:42.496601 25318 catalog_manager.cc:5697] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 5, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 5 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:42.460049 27067 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:42.608884 25562 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:42.640990 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:42.643949 26181 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:42.718884 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 75061.2us
I20260709 12:28:42.574615 27051 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:42.590987 26933 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.614323 26929 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
W20260709 12:28:42.663913 25535 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.66:43799 timed out after 1.609s (SENT) [suppressed 3 similar messages]
W20260709 12:28:42.528252 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 56245.1us
I20260709 12:28:42.601843 26793 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:28:42.656208 27012 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:42.668114 26915 consensus_meta.cc:287] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.009s
I20260709 12:28:42.642417 27102 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.652639 27043 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:42.652252 27107 raft_consensus.cc:2804] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:42.681336 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:42.668273 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:42.695458 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 241266us
I20260709 12:28:42.593456 27018 consensus_queue.cc:237] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.669420 27104 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:42.739269 27104 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.739706 27104 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:42.741284 27108 log.cc:927] Time spent T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:28:42.695809 26964 consensus_meta.cc:287] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.002s
I20260709 12:28:42.714278 26971 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.702943 26408 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:42.598007 25533 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:42.703799 27115 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:42.712618 25641 rpcz_store.cc:276] 0709 12:28:40.625848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:40.626316 (+   468us) service_pool.cc:224] Handling call
0709 12:28:40.626625 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:40.866049 (+239424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:40.866081 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:40.878632 (+ 12551us) log.cc:844] Serialized 26 byte log entry
0709 12:28:41.713317 (+834685us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:41.713359 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.128616 (+415257us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:28:42.570496 (+441880us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b540003f054. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:42.570564 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:42.570613 (+    49us) raft_consensus.cc:1685] finished
0709 12:28:42.570635 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.570792 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45553,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":114,"spinlock_wait_cycles":125912576,"thread_start_us":887149,"threads_started":2,"wal-append.queue_time_us":851046}
W20260709 12:28:42.700904 26985 consensus_meta.cc:287] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.004s
W20260709 12:28:42.717672 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 185616us
I20260709 12:28:42.700146 26976 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.699805 26732 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:42.721189 27051 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
W20260709 12:28:42.715538 27089 consensus_meta.cc:287] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.004s
I20260709 12:28:42.734651 27074 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:42.736791 27043 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:42.699299 26949 consensus_meta.cc:287] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.012s
I20260709 12:28:42.699908 26937 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.804262 26918 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.804551 26937 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.720247 26961 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.716926 27101 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:42.738348 27107 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:42.805570 27107 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:42.807348 26949 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.808277 26887 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.717999 27106 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:42.809974 26949 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:42.810266 27101 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.719641 26884 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.810750 27101 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:42.799882 27123 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:28:42.819621 27109 log.cc:927] Time spent T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:28:42.819638 27123 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:42.819996 27053 consensus_meta.cc:287] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.004s
I20260709 12:28:42.820307 27123 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.820683 27053 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.794401 26985 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.733688 26929 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.828625 27053 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.830626 26929 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.738284 26915 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:42.797132 27051 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.813802 27113 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:42.831543 27113 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:42.833905 27113 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.723335 26899 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.835126 27069 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.835872 27069 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.836602 26899 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.814622 26884 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.717295 26923 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.733538 27012 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.745225 26964 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 7. Current term is 8.
W20260709 12:28:42.811060 26932 consensus_meta.cc:287] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.002s
I20260709 12:28:42.843396 27087 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.843290 26932 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.800845 27089 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:42.845709 27024 consensus_meta.cc:287] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.000s
I20260709 12:28:42.811455 27043 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:42.846189 27024 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.846210 27089 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.800736 27075 consensus_queue.cc:237] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.849315 27024 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.828344 26420 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:43.029371 26915 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.030669 26915 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.031427 26932 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.033447 26923 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:43.036489 27055 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:43.037611 27055 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:42.993610 26408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:42.737306 25458 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:43.041828 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 304576us
I20260709 12:28:43.043524 25458 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:42.708488 25459 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:42.705034 25313 rpcz_store.cc:276] 0709 12:28:38.125529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.126983 (+  1454us) service_pool.cc:224] Handling call
0709 12:28:42.587570 (+4460587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:40.337866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:40.338495 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:40.338540 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:28:40.338560 (+    20us) tablet.cc:662] Decoding operations
0709 12:28:40.339259 (+   699us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:40.339326 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:40.339357 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:28:40.339792 (+   435us) tablet.cc:701] Row locks acquired
0709 12:28:40.339814 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:28:40.339980 (+   166us) write_op.cc:270] Start()
0709 12:28:40.340104 (+   124us) write_op.cc:276] Timestamp: P: 1783600120339929 usec, L: 0
0709 12:28:40.340131 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:28:40.340882 (+   751us) log.cc:844] Serialized 1693 byte log entry
0709 12:28:41.585982 (+1245100us) op_driver.cc:464] REPLICATION: finished
0709 12:28:42.076630 (+490648us) write_op.cc:301] APPLY: starting
0709 12:28:42.076728 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:42.076894 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:42.077008 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:42.090169 (+ 13161us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:42.090428 (+   259us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:28:42.090504 (+    76us) write_op.cc:312] APPLY: finished
0709 12:28:42.090804 (+   300us) log.cc:844] Serialized 40 byte log entry
0709 12:28:42.091028 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:42.091167 (+   139us) write_op.cc:454] Released schema lock
0709 12:28:42.091226 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:42.091691 (+   465us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:42.091734 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32501,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":413383,"apply.run_cpu_time_us":2664,"apply.run_wall_time_us":15004,"num_ops":4,"prepare.queue_time_us":286419,"prepare.run_cpu_time_us":31108,"prepare.run_wall_time_us":291994,"raft.queue_time_us":464296,"raft.run_cpu_time_us":52403,"raft.run_wall_time_us":660280,"replication_time_us":1087405,"thread_start_us":1151438,"threads_started":4,"wal-append.queue_time_us":576415}]]}
I20260709 12:28:43.047873 26915 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.938723 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:42.943504 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:42.946970 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.050216 25491 raft_consensus.cc:3060] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:42.950642 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:42.951119 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:42.721279 25532 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:42.745435 25566 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
W20260709 12:28:42.953182 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 355024us
W20260709 12:28:42.954674 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 290630us
I20260709 12:28:42.955307 25562 raft_consensus.cc:1275] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:42.958338 25563 raft_consensus.cc:2393] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:42.960088 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.960467 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:42.961192 25568 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:42.724495 25569 raft_consensus.cc:2393] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:43.062929 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.064603 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:43.065218 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 343870us
I20260709 12:28:43.065749 25567 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:43.066403 26929 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:43.067163 26929 raft_consensus.cc:697] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:42.970748 25560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39676 (request call id 603) took 1635 ms. Trace:
I20260709 12:28:43.068553 26923 raft_consensus.cc:2804] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:43.069103 26923 raft_consensus.cc:493] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.068921 26929 consensus_queue.cc:237] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:42.794299 25606 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:42.972478 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:42.974643 25634 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
W20260709 12:28:43.073817 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 78720.8us
I20260709 12:28:42.816326 26887 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.796155 26976 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:28:42.867213 26983 consensus_meta.cc:287] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.001s
I20260709 12:28:42.890280 26985 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:42.889449 27012 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:42.874812 27043 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:43.089325 25634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53066 (request call id 1047) took 1365 ms (client timeout 1680 ms). Trace:
W20260709 12:28:43.089814 25634 rpcz_store.cc:269] 0709 12:28:41.723936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.725744 (+  1808us) service_pool.cc:224] Handling call
0709 12:28:43.088973 (+1363229us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400507654. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:43.089198 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2846882176}
I20260709 12:28:43.090271 27043 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.872254 27051 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:42.850507 27054 consensus_meta.cc:287] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.005s
I20260709 12:28:42.745149 27056 raft_consensus.cc:697] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:43.106997 27056 consensus_queue.cc:237] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.108523 25565 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:42.886684 27067 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.112118 27067 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:42.876576 27069 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.800786 27074 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.888031 27101 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.113670 27074 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:42.880520 27104 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.116358 27101 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:42.815726 27105 log.cc:927] Time spent T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:28:43.118125 27104 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:42.876889 27107 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.100286 27054 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.121920 27107 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:42.794263 27121 log.cc:927] Time spent T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:28:43.100350 27024 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:42.891525 27123 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:42.801599 26732 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.123585 27024 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.124197 27024 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.044931 27045 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:43.126005 27123 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.126490 26408 raft_consensus.cc:606] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:43.126962 26408 raft_consensus.cc:614] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:43.046350 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 337759us
I20260709 12:28:43.040916 27055 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:43.062777 25493 raft_consensus.cc:2393] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.069669 26923 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:42.974279 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 210919us
W20260709 12:28:43.074664 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 62237.3us
I20260709 12:28:43.067821 25560 rpcz_store.cc:276] 0709 12:28:41.335391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.337422 (+  2031us) service_pool.cc:224] Handling call
0709 12:28:41.337743 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:42.387153 (+1049410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:42.387183 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:42.387625 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:28:42.556459 (+168834us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:28:42.556499 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:42.969859 (+413360us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540064f0d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:42.969935 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:42.970012 (+    77us) raft_consensus.cc:1685] finished
0709 12:28:42.970031 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:42.970505 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"spinlock_wait_cycles":2412480256,"thread_start_us":168453,"threads_started":1,"wal-append.queue_time_us":294049}
I20260709 12:28:43.075963 25561 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:42.990320 25564 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 8.
I20260709 12:28:43.087098 26983 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.078948 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.096133 25608 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:43.096549 27051 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.085134 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.102063 25490 raft_consensus.cc:2393] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.126150 25494 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:42.934020 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.140376 25495 raft_consensus.cc:2393] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.121950 26944 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:43.136161 27054 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.158946 25488 raft_consensus.cc:3055] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:43.159534 25488 raft_consensus.cc:740] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:43.163059 26732 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.153653 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.146288 26944 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:43.168242 25493 raft_consensus.cc:2393] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 2: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.169102 27113 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:43.169286 25487 raft_consensus.cc:2393] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 6: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
W20260709 12:28:43.175787 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 80133.6us
W20260709 12:28:43.176498 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 107422us
I20260709 12:28:43.170514 25458 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.168437 26944 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:43.178869 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 371452us
I20260709 12:28:43.179337 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.182921 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.181838 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.160913 25488 consensus_queue.cc:260] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.186371 26983 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.186885 27107 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:43.187882 27051 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:43.195290 26985 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:43.196249 25488 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.196076 26985 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.190941 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.198721 26985 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.181051 25459 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:43.201465 27107 raft_consensus.cc:2804] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:43.201956 27107 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.202354 27107 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:43.193809 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 56277.5us
I20260709 12:28:43.194998 27051 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.188925 27069 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.192075 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.183630 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.181094 25487 raft_consensus.cc:2468] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:43.210103 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.207587 25564 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44842 (request call id 215) took 1067 ms. Trace:
I20260709 12:28:43.211411 27069 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.210711 25564 rpcz_store.cc:276] 0709 12:28:42.140367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:42.181109 (+ 40742us) service_pool.cc:224] Handling call
0709 12:28:42.439278 (+258169us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b58005f2b98. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289af0a0 00007f1e289ae984 00007f1e21f296d4 00007f1e21f29662
0709 12:28:43.178500 (+739222us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540031e554. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:43.207523 (+ 29023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228504576}
I20260709 12:28:43.212354 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.216305 27045 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:43.216720 25638 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:43.217285 27069 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:43.217080 27045 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.219538 27045 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.220556 27045 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:43.205531 27101 raft_consensus.cc:2804] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:43.221823 25634 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.222504 25606 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.224313 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:43.229211 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 101884us
I20260709 12:28:43.205488 26732 consensus_queue.cc:1048] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:28:43.232424 25641 raft_consensus.cc:1240] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:43.233428 25637 raft_consensus.cc:1240] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:43.233712 27113 raft_consensus.cc:493] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:43.230366 27101 raft_consensus.cc:697] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:43.234378 27113 raft_consensus.cc:515] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:43.234757 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.236083 27055 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:43.235786 27101 consensus_queue.cc:237] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.236527 27055 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:43.237004 27055 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:43.238837 27051 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:43.246248 26983 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:43.247319 26983 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:43.249401 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 68034.4us
I20260709 12:28:43.250346 26983 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:43.252290 27069 raft_consensus.cc:2804] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:43.254568 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.255034 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.255492 25637 raft_consensus.cc:2393] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 6: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:43.257333 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.258352 25486 raft_consensus.cc:2393] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 6: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.231017 25532 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:43.259654 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 45183.2us
I20260709 12:28:43.260500 25532 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.221213 27045 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:43.261648 27119 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:43.262274 27119 raft_consensus.cc:697] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:43.262761 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:43.263589 27119 consensus_queue.cc:237] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:43.264882 26932 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:43.265604 26932 raft_consensus.cc:697] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:43.266654 26932 consensus_queue.cc:237] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:43.270702 25609 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.273908 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.274892 25639 raft_consensus.cc:2410] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:28:43.274952 25643 raft_consensus.cc:1240] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:43.252300 25606 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.276003 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.276242 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.276746 25635 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:43.276902 25642 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:43.277307 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:43.279188 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.279327 27045 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:43.279588 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.279842 26415 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:43.280943 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.282027 25640 raft_consensus.cc:2368] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3.
I20260709 12:28:43.283030 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.285104 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.285387 27069 raft_consensus.cc:697] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:43.286012 25560 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:43.286612 27069 consensus_queue.cc:237] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.287253 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.288008 25562 raft_consensus.cc:2468] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:43.289001 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.289335 26415 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:43.289737 27113 leader_election.cc:290] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:43.290717 25318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57464 (request call id 163) took 4259 ms. Trace:
I20260709 12:28:43.290978 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.291908 25637 raft_consensus.cc:2368] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 4. Current term is 5.
I20260709 12:28:43.291699 25458 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.292590 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.293136 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.293883 25643 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:43.300308 26918 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:43.301014 26918 raft_consensus.cc:697] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:43.302150 26918 consensus_queue.cc:237] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.305476 27113 raft_consensus.cc:2749] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:43.306878 25641 raft_consensus.cc:2393] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
W20260709 12:28:43.317203 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 64986.2us
I20260709 12:28:43.315250 25642 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:43.336318 25491 raft_consensus.cc:2468] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:43.337605 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:43.332288 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 55871.1us
I20260709 12:28:43.328474 26985 raft_consensus.cc:2764] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:28:43.351321 25634 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:43.349426 25635 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:43.357549 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.291221 25318 rpcz_store.cc:276] 0709 12:28:39.031603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:39.031757 (+   154us) service_pool.cc:224] Handling call
0709 12:28:43.290420 (+4258663us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:42.792071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:42.821453 (+ 29382us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:42.821498 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:28:42.821519 (+    21us) tablet.cc:662] Decoding operations
0709 12:28:42.821910 (+   391us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:42.821990 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:42.822020 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:28:42.822237 (+   217us) tablet.cc:701] Row locks acquired
0709 12:28:42.822256 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:28:42.822421 (+   165us) write_op.cc:270] Start()
0709 12:28:42.822544 (+   123us) write_op.cc:276] Timestamp: P: 1783600122822370 usec, L: 0
0709 12:28:42.822568 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:28:42.823291 (+   723us) log.cc:844] Serialized 533 byte log entry
0709 12:28:43.046262 (+222971us) op_driver.cc:464] REPLICATION: finished
0709 12:28:43.097254 (+ 50992us) write_op.cc:301] APPLY: starting
0709 12:28:43.098824 (+  1570us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:43.138946 (+ 40122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:43.155461 (+ 16515us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:43.210290 (+ 54829us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:43.228087 (+ 17797us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:28:43.228170 (+    83us) write_op.cc:312] APPLY: finished
0709 12:28:43.228614 (+   444us) log.cc:844] Serialized 22 byte log entry
0709 12:28:43.270021 (+ 41407us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:43.270279 (+   258us) write_op.cc:454] Released schema lock
0709 12:28:43.270357 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:43.271468 (+  1111us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:43.271500 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127970,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":48253,"apply.run_cpu_time_us":3763,"apply.run_wall_time_us":174550,"num_ops":1,"prepare.queue_time_us":17659,"prepare.run_cpu_time_us":3056,"prepare.run_wall_time_us":85338,"replication_time_us":223376,"thread_start_us":215366,"threads_started":2}]]}
I20260709 12:28:43.347568 25314 catalog_manager.cc:5697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:43.363130 26406 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:43.371026 27107 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.375393 25560 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:28:43.371822 26923 raft_consensus.cc:515] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.372035 27055 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.377378 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:43.428694 25564 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.378232 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:43.376091 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.385141 26976 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.389411 25561 raft_consensus.cc:1275] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:43.390242 26420 raft_consensus.cc:1275] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:43.390719 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:43.436810 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.391111 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:43.437759 26401 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.438011 25566 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:43.393041 26181 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.394110 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:43.395367 25638 raft_consensus.cc:2410] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:43.395628 27075 consensus_queue.cc:1059] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:28:43.390669 27024 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.379031 27045 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:43.406828 25460 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:43.415244 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 50834.4us
I20260709 12:28:43.416616 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.404142 25643 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:43.357570 26944 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.428951 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.446983 25642 raft_consensus.cc:2393] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:43.434934 25608 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:43.435395 27107 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.436149 26976 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.441215 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.431743 27012 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:43.436949 26923 leader_election.cc:290] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.449405 25635 raft_consensus.cc:2393] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.448226 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:43.453502 26944 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:43.454211 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 61394.4us
I20260709 12:28:43.454653 26976 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:43.455005 26181 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.454684 25636 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:43.455966 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.439796 25565 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:43.469058 26415 raft_consensus.cc:2393] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 4: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:43.470006 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.470453 26732 raft_consensus.cc:2804] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:43.470754 25635 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:43.470875 25560 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 7: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:43.470934 26732 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:43.455122 26976 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.448545 26980 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.471499 26732 raft_consensus.cc:3060] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.489207 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:43.492161 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 59801.4us
I20260709 12:28:43.490130 27045 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.462229 27113 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:43.500079 25460 leader_election.cc:400] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4.
I20260709 12:28:43.500566 25460 leader_election.cc:403] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:43.501710 25560 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:28:43.493440 26976 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.504029 25532 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.511615 25643 raft_consensus.cc:1240] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:43.512480 26937 consensus_queue.cc:1059] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:28:43.487110 27012 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:43.503468 27113 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.510363 25533 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:43.516978 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.528136 25635 raft_consensus.cc:2393] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:43.524084 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
W20260709 12:28:43.535519 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 67455.2us
I20260709 12:28:43.532896 26401 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:43.508486 26985 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:28:43.542093 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 50156.8us
I20260709 12:28:43.517638 27113 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.546059 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.513098 27024 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.520311 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:43.555176 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 132686us
I20260709 12:28:43.555516 26404 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:43.556501 26964 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:43.556627 27118 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.526474 26937 raft_consensus.cc:3055] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:43.547678 26985 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.557677 26985 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.560595 25566 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:43.561254 26937 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:43.562536 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.562356 26937 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.563838 26937 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:43.565001 27018 raft_consensus.cc:3055] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:28:43.564589 26983 consensus_queue.cc:1175] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3e2fd10beaf04318be94c0a3430cef3e" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:28:43.565501 27018 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:43.566349 27074 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.567476 27018 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.568848 27074 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.517469 27012 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:43.549678 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a9d87c866a43c1aaad7aca6383189a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.554560 26981 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:43.556509 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.569545 26408 raft_consensus.cc:2393] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:43.570544 26964 raft_consensus.cc:697] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
W20260709 12:28:43.570766 27137 log.cc:927] Time spent T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.256s	user 0.001s	sys 0.003s
I20260709 12:28:43.571194 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.603624 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:43.604367 27056 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:43.604837 25566 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.605031 27056 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:43.607378 27056 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:43.608808 25643 raft_consensus.cc:1275] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:43.609056 25492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:43.609615 25492 raft_consensus.cc:606] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:43.609921 25492 raft_consensus.cc:614] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:43.611073 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.611443 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.612099 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.612388 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.612669 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.611094 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.613940 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.612696 25494 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:43.614531 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 156793us
I20260709 12:28:43.615722 25460 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:43.616999 27024 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:43.576195 26929 consensus_queue.cc:1048] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:43.617538 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.618743 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.619846 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.576750 25488 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:43.581431 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:43.585479 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 50350.8us
I20260709 12:28:43.587201 25564 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:43.571167 27055 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:43.613839 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.582782 27018 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:43.614652 25487 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:43.577716 25640 raft_consensus.cc:1240] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:43.613799 25493 raft_consensus.cc:3060] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:43.622320 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.622872 26981 raft_consensus.cc:697] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:43.526841 26980 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.618969 25566 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:43.613077 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.525655 27045 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.630664 26401 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.631812 26964 consensus_queue.cc:237] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.589316 25533 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.635608 25636 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:43.592448 25532 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.643661 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.648144 25489 raft_consensus.cc:2410] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:28:43.646620 26404 raft_consensus.cc:3060] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.650161 26981 consensus_queue.cc:237] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:43.656834 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.637856 27012 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:28:43.661132 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 71961.1us
I20260709 12:28:43.661339 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.653465 27074 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:43.662285 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 69928.8us
I20260709 12:28:43.672142 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.653483 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.678274 25640 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:43.680588 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.683485 26401 raft_consensus.cc:2468] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:43.681842 25493 raft_consensus.cc:2468] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:43.639488 26976 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.681023 25490 raft_consensus.cc:2393] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.709035 25535 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:43.679529 27055 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:43.718077 25487 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:43.708536 25460 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:43.719401 25491 raft_consensus.cc:2368] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:43.720556 25639 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:43.698000 26929 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:43.724109 25635 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:43.730427 25492 raft_consensus.cc:1275] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:28:43.731184 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:43.733682 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.734347 26415 raft_consensus.cc:2368] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:43.734783 26884 consensus_queue.cc:1059] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:28:43.735653 26884 raft_consensus.cc:3055] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:43.735975 26884 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:43.737350 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:43.742465 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.743412 25640 raft_consensus.cc:2393] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
W20260709 12:28:43.744551 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 55356.6us
I20260709 12:28:43.746018 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.738094 25489 raft_consensus.cc:606] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.768893 25494 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:43.763232 25314 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47518 (request call id 81) took 5519 ms. Trace:
I20260709 12:28:43.770922 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.710639 27119 consensus_queue.cc:1059] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:28:43.771785 25494 raft_consensus.cc:2393] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 3: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:43.707166 27074 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:43.775441 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 87961us
I20260709 12:28:43.781364 26964 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:43.770646 27056 raft_consensus.cc:2804] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:43.784806 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.764340 26929 raft_consensus.cc:697] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:43.782718 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.790679 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.795439 25489 raft_consensus.cc:2393] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 6: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.736868 26884 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.796655 25608 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:43.772172 26923 consensus_queue.cc:1048] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:28:43.815397 25640 raft_consensus.cc:2393] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:43.770537 25314 rpcz_store.cc:276] 0709 12:28:38.245063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:38.257292 (+ 12229us) service_pool.cc:224] Handling call
0709 12:28:43.763118 (+5505826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:43.595853 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:43.596729 (+   876us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:43.596786 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:28:43.596804 (+    18us) tablet.cc:662] Decoding operations
0709 12:28:43.597222 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:43.597341 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:43.597374 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:28:43.597680 (+   306us) tablet.cc:701] Row locks acquired
0709 12:28:43.597731 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:28:43.597896 (+   165us) write_op.cc:270] Start()
0709 12:28:43.598044 (+   148us) write_op.cc:276] Timestamp: P: 1783600123597830 usec, L: 0
0709 12:28:43.598066 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:28:43.598842 (+   776us) log.cc:844] Serialized 537 byte log entry
0709 12:28:43.600802 (+  1960us) op_driver.cc:464] REPLICATION: finished
0709 12:28:43.603006 (+  2204us) write_op.cc:301] APPLY: starting
0709 12:28:43.603101 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:43.603209 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:43.603309 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:43.603569 (+   260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:43.603735 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:28:43.603786 (+    51us) write_op.cc:312] APPLY: finished
0709 12:28:43.603978 (+   192us) log.cc:844] Serialized 22 byte log entry
0709 12:28:43.604145 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:43.604234 (+    89us) write_op.cc:454] Released schema lock
0709 12:28:43.604275 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:43.604620 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:43.604658 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15286,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":1990,"apply.run_cpu_time_us":1566,"apply.run_wall_time_us":1567,"num_ops":1,"prepare.queue_time_us":125337,"prepare.run_cpu_time_us":3315,"prepare.run_wall_time_us":3315,"replication_time_us":2609,"thread_start_us":77226,"threads_started":1}]]}
I20260709 12:28:43.817199 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.793157 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.818013 25489 raft_consensus.cc:2393] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:43.793545 26932 raft_consensus.cc:3055] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:43.816833 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.823796 25494 raft_consensus.cc:2368] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:43.826124 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.826836 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.796068 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.804975 27056 raft_consensus.cc:697] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:43.809605 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.836488 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.838059 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:43.837251 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 167124us
I20260709 12:28:43.831272 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.840071 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:43.840382 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.841895 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.843111 25564 raft_consensus.cc:2368] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 4. Current term is 5.
I20260709 12:28:43.843338 25636 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:43.831550 26918 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:43.830767 26932 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
W20260709 12:28:43.843611 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 142613us
I20260709 12:28:43.840092 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.849696 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.846967 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:43.852469 25635 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:43.852625 25535 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:43.851291 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.854463 26884 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.858119 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:43.858704 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.859310 25491 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:43.862648 27149 log.cc:927] Time spent T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:43.835772 26929 consensus_queue.cc:237] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.844484 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:43.865935 25566 raft_consensus.cc:2410] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:28:43.866932 25532 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:43.867888 25532 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.849548 27053 consensus_queue.cc:1048] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:28:43.902711 25639 raft_consensus.cc:1275] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:28:43.906103 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 47759.9us
I20260709 12:28:43.913553 25636 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:43.846582 26976 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:43.868153 26404 raft_consensus.cc:2468] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:43.902526 25459 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:43.919135 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:43.927299 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 59475.6us
I20260709 12:28:43.842108 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:43.904129 27147 log.cc:927] Time spent T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:28:43.930063 25635 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:43.853739 26918 raft_consensus.cc:697] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:43.844383 27024 consensus_queue.cc:1059] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:28:43.939826 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:43.976828 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.977574 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
W20260709 12:28:43.977695 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 128655us
I20260709 12:28:43.982455 25494 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
W20260709 12:28:43.939271 27140 log.cc:927] Time spent T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:28:43.859242 27012 consensus_queue.cc:1059] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:28:43.970240 27155 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:43.988101 25639 raft_consensus.cc:2393] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
W20260709 12:28:43.988395 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 52557.8us
I20260709 12:28:43.990351 27159 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:43.991796 25609 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.001149 27118 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4.
I20260709 12:28:44.020370 25609 leader_election.cc:400] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:44.020797 25609 leader_election.cc:403] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:28:44.002291 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.021510 27101 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.022164 26418 raft_consensus.cc:2393] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 5: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:44.022600 27101 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:44.005960 26918 consensus_queue.cc:237] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:43.992095 27113 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:44.006459 26923 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:44.026116 25486 raft_consensus.cc:2368] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:43.992916 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.026985 26401 raft_consensus.cc:2393] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 5: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:43.992952 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:43.852069 27158 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:44.028414 27158 raft_consensus.cc:697] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
W20260709 12:28:44.028771 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 90245.9us
I20260709 12:28:44.029445 27158 consensus_queue.cc:237] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.929497 27074 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:43.929721 26985 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:43.995507 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:43.928014 25566 raft_consensus.cc:1240] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:44.019568 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.016760 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:43.986578 27045 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:44.007295 26409 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:44.012200 25535 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.013504 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:44.014173 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:44.014561 25460 leader_election.cc:400] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 4. Current term is 5.
I20260709 12:28:44.041395 25492 raft_consensus.cc:2393] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:44.041460 25460 leader_election.cc:403] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:28:44.041553 25569 raft_consensus.cc:3060] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:44.036865 25491 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
W20260709 12:28:44.013780 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 111351us
I20260709 12:28:44.018877 25532 leader_election.cc:304] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.043027 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:43.993274 27056 consensus_queue.cc:237] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:43.995532 27150 log.cc:927] Time spent T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:28:44.047256 27113 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:44.047921 25640 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:44.045480 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:44.049597 25560 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:44.033000 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:44.019933 25458 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:43.940068 26402 raft_consensus.cc:2393] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 5: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:44.045466 25491 raft_consensus.cc:2393] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:44.049093 25532 leader_election.cc:400] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6.
I20260709 12:28:44.044426 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.053278 25642 raft_consensus.cc:2393] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 3: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:44.054854 25459 leader_election.cc:400] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Vote denied by peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365) with higher term. Message: Invalid argument: T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3.
I20260709 12:28:44.018116 27024 raft_consensus.cc:3055] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:44.010648 26406 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:44.058069 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:44.059540 25489 raft_consensus.cc:2368] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:44.014940 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.013887 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:44.005352 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e4aceeecf604044aba90b5fbaa08a0f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.011797 27155 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:44.076905 27155 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:44.060940 27113 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 4. Current term is 5.
I20260709 12:28:44.082840 26980 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:44.083828 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 71780.2us
I20260709 12:28:44.084836 25535 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.058888 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.062984 25459 leader_election.cc:403] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:28:44.086373 25535 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.087473 25459 leader_election.cc:400] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Vote denied by peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365) with higher term. Message: Invalid argument: T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 4. Current term is 5.
I20260709 12:28:44.088361 25459 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.089329 27045 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365) with higher term. Message: Invalid argument: T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3.
I20260709 12:28:44.090006 27045 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:44.089560 26932 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.090487 27045 raft_consensus.cc:697] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:44.091022 26932 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:44.091398 27045 consensus_queue.cc:237] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:44.063542 25493 raft_consensus.cc:1275] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:44.052661 26923 raft_consensus.cc:2804] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:44.066437 25639 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:44.093679 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.094946 25459 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:44.095355 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.095815 25459 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:44.096263 26402 raft_consensus.cc:2368] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:44.096668 25459 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:44.010622 26732 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:44.073909 27162 raft_consensus.cc:3055] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:44.075065 25561 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:44.064280 27024 raft_consensus.cc:740] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:44.125695 25315 catalog_manager.cc:5697] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 4 to 5, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 5 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:44.127321 27024 consensus_queue.cc:260] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:44.129952 27012 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:44.073073 25635 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:28:44.098325 25533 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:44.100915 25495 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
W20260709 12:28:44.110121 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 90284.6us
I20260709 12:28:44.063225 26929 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.118083 26937 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
W20260709 12:28:44.137323 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 51071.5us
I20260709 12:28:44.122313 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.122593 26415 raft_consensus.cc:1240] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:44.122987 27015 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:44.123044 26732 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:44.124686 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.126264 26418 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:28:44.133066 25609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:44.131793 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 117384us
I20260709 12:28:44.156669 25460 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.130692 27012 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:44.097132 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.113322 27162 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:44.131313 27118 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.110663 26923 raft_consensus.cc:697] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:44.157898 26408 raft_consensus.cc:2393] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 6: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:44.115167 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.133074 25315 catalog_manager.cc:5697] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 3 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:44.128970 27024 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:44.133731 27113 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:44.166728 25535 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.177129 26402 raft_consensus.cc:2393] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 5: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:44.109586 27159 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.175822 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.176117 27162 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:44.141254 27055 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:44.138013 26980 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.166051 26937 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:44.153229 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:44.190086 27160 log.cc:927] Time spent T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.261s	user 0.004s	sys 0.000s
I20260709 12:28:44.191620 26406 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:44.198587 27012 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:44.172716 27054 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:28:44.205637 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 178880us
I20260709 12:28:44.207484 25606 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.159582 27015 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:44.218554 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.211565 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:44.227523 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 70943.1us
I20260709 12:28:44.206599 27113 raft_consensus.cc:697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:44.208679 27055 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.212949 25560 raft_consensus.cc:2468] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
W20260709 12:28:44.230803 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 64175.4us
W20260709 12:28:44.230113 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 133497us
I20260709 12:28:44.227015 25315 catalog_manager.cc:5697] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:44.216316 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.239181 26401 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:44.226804 27154 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.240249 26409 raft_consensus.cc:2393] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 3: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:44.251489 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.252264 26409 raft_consensus.cc:2368] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:44.254022 26985 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:44.254963 25535 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.255743 26980 raft_consensus.cc:2749] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.256651 25608 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.258404 27015 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:44.259824 26415 raft_consensus.cc:1275] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:44.260079 26401 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:44.253108 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.261109 26415 raft_consensus.cc:1275] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:44.267750 26937 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:44.268687 26923 consensus_queue.cc:237] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.269785 26419 raft_consensus.cc:1240] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:44.233906 27169 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:44.273723 27169 raft_consensus.cc:697] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:44.274708 27169 consensus_queue.cc:237] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:44.236238 27055 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:44.265580 26181 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:44.242283 27101 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.265807 25315 catalog_manager.cc:5697] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 4 to 5, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:44.247884 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:44.287632 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 80264.1us
W20260709 12:28:44.277640 27168 log.cc:927] Time spent T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:28:44.264894 25569 raft_consensus.cc:2468] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:44.294034 27170 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:44.294546 25639 raft_consensus.cc:1275] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:28:44.295377 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 162208us
I20260709 12:28:44.295660 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:44.303349 25606 leader_election.cc:400] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:44.265787 26985 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:44.305845 26985 raft_consensus.cc:697] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:44.235392 27119 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:28:44.306818 25606 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.304491 27170 raft_consensus.cc:697] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:44.309511 27065 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.308745 25606 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.310164 27170 consensus_queue.cc:237] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.311244 27065 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.315608 26180 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.267004 26409 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 7.
I20260709 12:28:44.296998 27174 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:44.337641 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 109126us
I20260709 12:28:44.338881 25460 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.349225 27045 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.351805 25606 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.352736 27101 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.353813 27015 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.318354 27113 consensus_queue.cc:237] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:44.373715 25458 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.383091 25458 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.306866 26985 consensus_queue.cc:237] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:44.384496 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 80778us
I20260709 12:28:44.385334 26180 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:44.388983 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 154383us
I20260709 12:28:44.333755 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.323092 26402 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:44.418489 25459 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:44.321823 27158 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:28:44.427793 26408 raft_consensus.cc:1275] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:28:44.425809 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 135759us
I20260709 12:28:44.402928 27056 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.414072 27074 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.423676 27015 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:44.453540 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 70535.2us
I20260709 12:28:44.454653 25458 leader_election.cc:304] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:44.458250 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 119482us
I20260709 12:28:44.459590 26420 raft_consensus.cc:1275] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:44.459672 27182 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.460462 27182 raft_consensus.cc:2804] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:44.460958 27182 raft_consensus.cc:697] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:44.462042 27182 consensus_queue.cc:237] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:44.464280 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:44.464985 25566 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:44.465435 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 78048.5us
I20260709 12:28:44.465548 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:44.466445 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:44.466526 26180 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.467866 26180 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.468648 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:44.469237 25567 raft_consensus.cc:3060] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.469949 27151 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.470643 27151 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.471237 27151 consensus_queue.cc:1059] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:44.472164 27151 raft_consensus.cc:3055] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:44.472460 27151 raft_consensus.cc:740] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
W20260709 12:28:44.473449 25461 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.473580 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:44.456565 26406 raft_consensus.cc:2393] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 3: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:44.474151 25564 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 1.
I20260709 12:28:44.474444 27015 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:44.476212 27174 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:44.476600 27015 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:44.459283 25460 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.486709 25567 raft_consensus.cc:2468] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 2.
I20260709 12:28:44.497325 26180 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
W20260709 12:28:44.465023 27173 log.cc:927] Time spent T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 12:28:44.500624 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 46096.8us
I20260709 12:28:44.503326 25569 raft_consensus.cc:1240] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:28:44.506345 25606 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.476756 27174 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:44.507798 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 48616.1us
I20260709 12:28:44.520155 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.520851 25495 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:44.523052 25460 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.526628 25491 raft_consensus.cc:1275] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:44.507440 27074 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:44.532701 25460 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.514992 27045 consensus_queue.cc:1059] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:28:44.509016 27054 raft_consensus.cc:697] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:44.513051 27065 raft_consensus.cc:2749] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.513660 27056 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.537572 25606 leader_election.cc:400] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:44.539145 25606 leader_election.cc:403] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:28:44.543879 25487 raft_consensus.cc:1275] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:44.545023 25606 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:44.545862 26918 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:44.546453 26918 raft_consensus.cc:697] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:44.546672 25606 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.547392 26918 consensus_queue.cc:237] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.548811 26944 consensus_queue.cc:1059] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:44.549122 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:44.559815 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:44.535626 27169 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:44.565366 26180 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.561532 27101 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.544198 27053 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:44.559779 25490 raft_consensus.cc:1240] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:44.573704 27012 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.576614 27054 consensus_queue.cc:237] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:44.579022 27155 consensus_meta.cc:287] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.001s
I20260709 12:28:44.512760 27151 consensus_queue.cc:260] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.562809 27169 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:44.563354 27045 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:44.583036 25567 raft_consensus.cc:1240] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:44.586769 26878 consensus_queue.cc:1048] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:28:44.587074 25566 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:44.591439 26180 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.575418 27158 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:44.579478 27155 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:44.598491 27183 raft_consensus.cc:2749] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.584219 27169 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:44.600890 26180 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:44.623641 26976 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:44.624169 26976 raft_consensus.cc:697] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:44.624254 26180 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.622679 26181 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:44.606833 27012 consensus_queue.cc:1048] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:28:44.607476 27184 log.cc:927] Time spent T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:28:44.607812 27190 raft_consensus.cc:2804] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:44.599889 27158 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:44.610262 25636 raft_consensus.cc:1275] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:44.612085 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.612778 27101 consensus_queue.cc:1059] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:44.643180 26180 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.574301 27074 consensus_queue.cc:1059] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:28:44.621500 27151 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:44.605777 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:44.652501 25487 raft_consensus.cc:2368] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:44.626741 26181 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:44.632037 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 85405.1us
I20260709 12:28:44.602530 27015 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.654408 25606 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:44.648399 25560 raft_consensus.cc:1240] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:44.616710 27155 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:44.631420 26732 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.661886 25606 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:44.640599 27018 raft_consensus.cc:2804] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:44.620554 27174 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:44.668063 25535 leader_election.cc:400] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:44.668478 25535 leader_election.cc:403] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:44.590181 27045 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:44.670899 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:44.676584 25606 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:44.707247 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.663719 27190 raft_consensus.cc:697] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:44.723331 27190 consensus_queue.cc:237] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:44.724049 26981 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:44.665874 27018 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:44.725466 27018 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:44.707535 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:44.707506 27177 log.cc:927] Time spent T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:28:44.707283 26985 consensus_queue.cc:1048] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:44.717579 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 55665us
I20260709 12:28:44.667081 27015 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.730675 25535 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.731017 27101 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:44.731652 27101 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.732518 27155 raft_consensus.cc:2749] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:44.732646 25535 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.665364 27053 consensus_queue.cc:1059] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:28:44.718204 27065 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.666240 27183 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:28:44.733314 27155 consensus_queue.cc:1048] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:44.734584 25535 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.669865 26878 raft_consensus.cc:2804] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:44.736271 26878 raft_consensus.cc:697] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:44.736464 26981 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.737360 26878 consensus_queue.cc:237] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:44.739300 27101 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:44.631278 26976 consensus_queue.cc:237] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.733426 27053 consensus_queue.cc:1243] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer 05cabf76554146489f61260dbdadf659 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:28:44.735020 27155 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:44.731024 27158 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:44.720432 27055 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:44.773641 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.670146 27202 raft_consensus.cc:2764] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:28:44.779670 25495 raft_consensus.cc:1275] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:28:44.781112 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 46599us
W20260709 12:28:44.782112 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 52238us
W20260709 12:28:44.785061 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 158458us
I20260709 12:28:44.787068 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.788177 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:44.788451 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 161775us
I20260709 12:28:44.788794 25495 raft_consensus.cc:2376] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3. Re-sending same reply.
W20260709 12:28:44.790385 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 113903us
I20260709 12:28:44.791393 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:44.790426 26180 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:44.792361 25495 raft_consensus.cc:2376] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4. Re-sending same reply.
I20260709 12:28:44.792650 26181 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.793840 25609 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:44.795481 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:44.796082 25565 raft_consensus.cc:2368] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:44.793820 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:44.806195 25490 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:44.806691 26402 raft_consensus.cc:1240] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:44.804610 27053 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.808068 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.808476 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:44.808900 26409 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:44.809293 25635 raft_consensus.cc:2393] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:44.804451 27158 consensus_queue.cc:1048] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:28:44.811872 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.812208 27065 raft_consensus.cc:3055] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:44.812525 26406 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:44.812624 27065 raft_consensus.cc:740] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:44.818037 26884 raft_consensus.cc:3055] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:44.794921 27015 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:44.818557 26884 raft_consensus.cc:740] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:44.818706 27015 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:44.819257 27015 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:44.819491 26884 consensus_queue.cc:260] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.794021 27191 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:28:44.822391 26884 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:44.797420 27210 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:44.823482 27045 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:44.823720 27210 raft_consensus.cc:697] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:44.824385 27065 consensus_queue.cc:260] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.824885 27210 consensus_queue.cc:237] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:44.825803 27065 raft_consensus.cc:3060] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:44.795094 26732 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:28:44.828581 25609 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.830060 25609 leader_election.cc:400] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6.
I20260709 12:28:44.831130 27053 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:44.832088 26923 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:44.832892 25642 raft_consensus.cc:1275] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:28:44.833276 25642 pending_rounds.cc:85] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 1
I20260709 12:28:44.833585 25642 pending_rounds.cc:107] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:28:44.841678 25642 raft_consensus.cc:2889] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:44.843956 26419 raft_consensus.cc:1275] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:44.846655 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:44.851112 25563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:44.851719 25563 raft_consensus.cc:606] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:44.851531 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:44.852088 25563 raft_consensus.cc:614] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:44.854472 26408 raft_consensus.cc:1275] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:44.856117 25634 raft_consensus.cc:1275] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:44.822314 27155 consensus_queue.cc:1048] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:28:44.859081 26419 raft_consensus.cc:1275] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:44.868643 26415 raft_consensus.cc:1275] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:44.869879 26180 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:44.864925 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:44.873868 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:44.844909 27191 consensus_queue.cc:1059] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:28:44.843992 26937 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:28:44.925668 26415 raft_consensus.cc:1240] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:44.926409 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 56589.3us
I20260709 12:28:44.875793 25561 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:44.877970 26878 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:44.920617 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:44.952754 25487 raft_consensus.cc:1275] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:44.931806 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:28:44.930584 25369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 43764.2us
I20260709 12:28:44.932288 27154 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:28:44.922994 26929 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:28:45.031042 27055 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:45.026139 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 104911us
I20260709 12:28:44.924685 26981 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 12:28:44.962174 26923 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:28:45.020009 27101 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.070155 25487 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:44.953346 27169 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:45.079403 27216 log.cc:927] Time spent T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:28:45.095732 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:45.069064 27165 log.cc:927] Time spent T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:28:45.102758 26182 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:45.107884 25495 raft_consensus.cc:1240] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:45.067677 26983 consensus_queue.cc:1048] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:28:45.082484 27101 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:45.114832 27170 raft_consensus.cc:2749] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:45.108510 27155 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:28:45.128717 25609 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:45.132766 25487 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:45.133318 27225 consensus_queue.cc:1048] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:28:45.134847 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:28:45.135305 27215 log.cc:927] Time spent T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:28:45.136047 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:45.127446 26878 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:45.137683 26878 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:45.119669 27162 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:45.129071 26182 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:45.105878 27222 consensus_queue.cc:1059] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 12:28:45.143392 27218 log.cc:927] Time spent T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:28:45.159119 27221 log.cc:927] Time spent T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:28:45.160593 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:45.153148 26976 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:45.155683 27225 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:45.208544 25608 leader_election.cc:400] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:45.208997 25608 leader_election.cc:403] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:28:45.222342 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 93734.4us
I20260709 12:28:45.190024 27222 consensus_queue.cc:1243] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer 3e2fd10beaf04318be94c0a3430cef3e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:45.224174 27224 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:28:45.225390 27211 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:28:45.227807 27219 log.cc:927] Time spent T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:28:45.206041 26976 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:45.233791 25566 raft_consensus.cc:1275] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:45.238973 27101 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:45.239693 25565 raft_consensus.cc:1275] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:45.241349 27227 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:45.243144 27227 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:28:45.254494 27213 log.cc:927] Time spent T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:28:45.255777 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:45.230415 26406 raft_consensus.cc:2468] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:45.250630 25561 raft_consensus.cc:1240] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:45.257771 26408 raft_consensus.cc:1240] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:28:45.233011 26976 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:45.251971 27169 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:45.268126 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 57532.7us
I20260709 12:28:45.262075 26980 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.270344 27230 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:28:45.270862 25490 raft_consensus.cc:3055] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:45.275179 27170 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.278389 27170 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:45.278610 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:45.279942 25606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:45.280664 27170 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:45.273063 25490 raft_consensus.cc:740] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:45.282229 25490 consensus_queue.cc:260] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:45.283236 25490 raft_consensus.cc:3060] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:45.279983 26878 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:45.274171 26980 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:45.287288 27169 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.287848 27169 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:45.289188 26980 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:45.290248 27169 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:45.291889 25640 raft_consensus.cc:1275] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:28:45.292292 25640 pending_rounds.cc:85] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 1
I20260709 12:28:45.292510 25640 pending_rounds.cc:107] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:28:45.292728 25640 raft_consensus.cc:2889] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:45.294008 27018 consensus_meta.cc:287] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.002s
I20260709 12:28:45.294595 27018 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:45.296222 27015 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:45.299338 25567 raft_consensus.cc:1275] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:45.300040 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:45.299212 25560 raft_consensus.cc:3055] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:45.294606 25606 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:45.313544 25560 raft_consensus.cc:740] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:45.314793 27225 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:45.315286 27225 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.315673 27225 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:45.315104 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:45.316876 26401 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:45.319248 25493 raft_consensus.cc:1240] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:45.318828 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:45.319965 25566 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:45.320618 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:45.322710 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:45.323493 25643 raft_consensus.cc:2393] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:45.300217 25561 raft_consensus.cc:1275] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:45.326949 27015 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:45.332474 25640 raft_consensus.cc:1240] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:45.333462 25565 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:45.335152 25490 raft_consensus.cc:1275] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:45.337018 25563 raft_consensus.cc:1240] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
W20260709 12:28:45.338919 27176 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:28:45.346645 25460 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:45.348105 27179 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:45.348824 27179 consensus_queue.cc:1048] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:28:45.350778 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 45480.7us
I20260709 12:28:45.351543 26182 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:45.356525 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:45.361119 25535 leader_election.cc:400] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:45.355830 27056 consensus_queue.cc:1048] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:28:45.361900 27101 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:28:45.362437 27178 log.cc:927] Time spent T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.910s	user 0.000s	sys 0.006s
I20260709 12:28:45.362928 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:45.363832 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 58050us
W20260709 12:28:45.364373 27065 consensus_meta.cc:287] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.001s
I20260709 12:28:45.364693 27211 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5.
I20260709 12:28:45.364549 27055 consensus_queue.cc:1059] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:45.429055 25640 raft_consensus.cc:1275] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:28:45.429647 25640 pending_rounds.cc:85] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 2
I20260709 12:28:45.429929 25640 pending_rounds.cc:107] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:28:45.430200 25640 raft_consensus.cc:2889] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:45.398962 26732 raft_consensus.cc:2749] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:45.366575 27169 consensus_queue.cc:1059] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:28:45.418010 26983 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:45.443733 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 82801.5us
I20260709 12:28:45.445220 25535 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:45.396317 26878 consensus_queue.cc:1048] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:28:45.498692 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 104502us
I20260709 12:28:45.438256 27223 raft_consensus.cc:3055] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:28:45.506680 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 107025us
I20260709 12:28:45.512951 25642 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:45.453961 27055 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:45.432075 27012 consensus_queue.cc:1048] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:28:45.515833 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:45.522861 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:45.506821 27223 raft_consensus.cc:740] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:45.508173 26918 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.454644 26983 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:45.520845 27015 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.533265 26980 consensus_queue.cc:1059] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:45.536198 26983 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:45.508450 26976 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:45.558138 25459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:45.543360 27232 log.cc:927] Time spent T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:28:45.562043 27225 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:45.567333 25634 raft_consensus.cc:1240] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:45.541754 27101 consensus_queue.cc:1059] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:28:45.532611 26918 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:45.541775 27015 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:45.648597 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 268082us
W20260709 12:28:45.691241 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 294039us
I20260709 12:28:45.628780 27225 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:45.546904 27246 consensus_queue.cc:1048] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 12:28:45.697751 25458 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:45.656260 27230 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.709488 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:45.720834 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:45.722922 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:45.727347 25535 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:45.724206 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:45.729264 25495 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:45.731014 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:45.731854 25492 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
W20260709 12:28:45.732167 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 223199us
I20260709 12:28:45.733130 26181 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:45.740610 25535 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:45.753134 27252 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:45.753638 27238 log.cc:927] Time spent T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:28:45.753743 27252 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:45.749907 27233 raft_consensus.cc:2749] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:45.756201 27252 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:45.756960 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:45.770303 25493 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:45.738330 27056 raft_consensus.cc:2804] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:45.790024 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:45.782276 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:45.792307 26418 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:45.748983 27055 raft_consensus.cc:2749] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:45.813834 25637 raft_consensus.cc:1275] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:45.818456 25641 raft_consensus.cc:1275] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:45.826495 26182 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:45.774751 27250 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:45.812206 27246 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.735020 27230 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:45.876041 25495 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
W20260709 12:28:45.879406 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 53012.6us
I20260709 12:28:45.881090 27055 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.881347 27247 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:45.827673 27056 raft_consensus.cc:697] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:45.817340 27222 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:28:45.836205 27250 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:45.713279 27223 consensus_queue.cc:260] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:45.902369 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:45.903131 25495 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:45.881899 27055 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:45.888419 26976 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:45.901629 27191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.009s	sys 0.049s
I20260709 12:28:45.913106 27223 raft_consensus.cc:3060] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:45.907156 27249 consensus_queue.cc:1048] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
W20260709 12:28:45.915454 27244 log.cc:927] Time spent T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
W20260709 12:28:45.916203 27240 log.cc:927] Time spent T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 12:28:45.884193 27246 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:45.983187 25488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60406 (request call id 227) took 1206 ms. Trace:
I20260709 12:28:45.983880 27246 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:45.984179 27015 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:45.916476 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:45.916934 27230 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:45.978317 27154 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.986629 27154 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:45.918255 27055 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:45.989156 27259 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:45.989769 27259 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:45.990164 27187 raft_consensus.cc:3055] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:45.990669 27187 raft_consensus.cc:740] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:45.991668 27187 consensus_queue.cc:260] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:45.993412 26415 raft_consensus.cc:1240] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:45.988838 27154 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:45.918959 25639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48680 (request call id 253) took 1050 ms. Trace:
I20260709 12:28:45.921764 27261 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:45.923895 27018 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:45.897768 27250 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:45.896826 26878 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:45.945344 27191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.009s	sys 0.050s
I20260709 12:28:45.963152 25495 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:45.969729 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:45.972048 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:45.980829 26918 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:45.984774 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:45.987390 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:46.071549 25495 raft_consensus.cc:1240] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:45.992038 27259 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:45.923465 27056 consensus_queue.cc:237] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:46.022745 25534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.026070 25460 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:46.026963 27249 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.052937 26418 raft_consensus.cc:1240] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:46.061035 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:45.997365 25639 rpcz_store.cc:276] 0709 12:28:44.868983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.961878 (+ 92895us) service_pool.cc:224] Handling call
0709 12:28:44.962340 (+   462us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:45.348746 (+386406us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b180029c8c0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e235914bc 00007f1e208df48b 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208f9455 00007f1e239e1060 00007f1e239e1bfb 00007f1e239ec64b
0709 12:28:45.348885 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:45.348913 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:45.349633 (+   720us) log.cc:844] Serialized 52 byte log entry
0709 12:28:45.650035 (+300402us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:45.650086 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.650180 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:45.918657 (+268477us) raft_consensus.cc:1685] finished
0709 12:28:45.918676 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.918889 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537,"raft.queue_time_us":55870,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":12429,"spinlock_wait_cycles":10581376,"thread_start_us":393017,"threads_started":2,"wal-append.queue_time_us":425629}
W20260709 12:28:46.082736 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 306138us
W20260709 12:28:46.077761 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 51804.8us
I20260709 12:28:46.083165 25568 raft_consensus.cc:1275] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:46.065035 27187 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:46.086795 25533 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.003s	sys 0.024s
I20260709 12:28:46.018684 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:46.093029 25533 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.003s	sys 0.024s
I20260709 12:28:46.093761 26415 raft_consensus.cc:1275] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:28:46.095742 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 563147us
I20260709 12:28:46.096966 27055 consensus_queue.cc:1048] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:28:46.079530 27164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.018s
I20260709 12:28:46.099849 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.083491 26937 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:46.105434 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.107914 25568 raft_consensus.cc:1240] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:46.083936 27259 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:46.067466 26878 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:46.073695 27211 consensus_queue.cc:1059] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:28:46.102164 27164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.008s	sys 0.018s
I20260709 12:28:46.109181 25533 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:46.127671 27253 raft_consensus.cc:493] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:46.128528 26404 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:28:46.128998 27179 consensus_queue.cc:1048] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:46.109390 26937 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.078943 26409 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:46.095932 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.084064 27169 consensus_queue.cc:1059] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:28:46.145556 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 358558us
I20260709 12:28:46.153748 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.147811 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.149221 25636 raft_consensus.cc:1240] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:28:46.067214 27261 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:46.152704 25533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.144083 26404 pending_rounds.cc:85] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Aborting all ops after (but not including) 2
I20260709 12:28:46.169104 25606 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:46.087598 27249 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.170370 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.150672 27055 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:46.152377 27211 consensus_queue.cc:1243] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer bf67e247c9e5443ea0099083f496b361 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:28:46.181320 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.176586 25641 raft_consensus.cc:2410] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:46.171010 26404 pending_rounds.cc:107] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:28:46.191421 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.192040 25642 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:46.198114 25489 raft_consensus.cc:1240] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:46.201797 27285 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.202368 27285 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.205396 27055 raft_consensus.cc:697] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:46.206805 27055 consensus_queue.cc:237] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:45.983604 25488 rpcz_store.cc:276] 0709 12:28:44.777266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.778778 (+  1512us) service_pool.cc:224] Handling call
0709 12:28:45.271496 (+492718us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800034898. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4a22 00007f1e297dd8d9 00007f1e28937ee0 00007f1e28a010ab 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:28:45.271694 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:45.272046 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:45.272079 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:45.275948 (+  3869us) log.cc:844] Serialized 26 byte log entry
0709 12:28:45.413400 (+137452us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:45.413444 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.413525 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:45.982824 (+569299us) raft_consensus.cc:1685] finished
0709 12:28:45.982855 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:45.983103 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":620,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":1946,"spinlock_wait_cycles":2771328,"thread_start_us":127384,"threads_started":1,"wal-append.queue_time_us":229937}
W20260709 12:28:46.241407 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 50018.5us
I20260709 12:28:46.179615 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.146090 27253 raft_consensus.cc:515] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:46.189203 26404 raft_consensus.cc:2889] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:46.184762 27264 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:46.194918 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:46.178601 27018 consensus_queue.cc:1048] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:28:46.180655 27247 consensus_queue.cc:1048] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:28:46.222550 27285 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:46.294443 27249 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:46.295894 27065 consensus_queue.cc:1059] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:46.300293 26937 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:46.301918 27288 log.cc:927] Time spent T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:46.257594 27264 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:46.296177 26878 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:46.311549 27289 log.cc:927] Time spent T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:28:46.277052 26409 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:46.313601 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:46.316952 27278 log.cc:927] Time spent T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:28:46.322969 26402 raft_consensus.cc:1240] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:46.280917 27282 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:46.326231 27284 log.cc:927] Time spent T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:28:46.327135 25643 raft_consensus.cc:2393] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:46.323012 26419 raft_consensus.cc:1275] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:46.331662 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.341135 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.315025 27264 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:46.344492 26419 raft_consensus.cc:1275] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:28:46.350869 27245 log.cc:927] Time spent T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.835s	user 0.000s	sys 0.005s
I20260709 12:28:46.349822 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.356830 27253 leader_election.cc:290] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:46.348528 26404 raft_consensus.cc:1275] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:46.367039 26406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53780 (request call id 732) took 1064 ms. Trace:
I20260709 12:28:46.368420 26402 raft_consensus.cc:1240] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 1. Current term is 2. Ops: []
W20260709 12:28:46.368723 27262 log.cc:927] Time spent T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.492s	user 0.002s	sys 0.000s
I20260709 12:28:46.367646 26406 rpcz_store.cc:276] 0709 12:28:45.303059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.311455 (+  8396us) service_pool.cc:224] Handling call
0709 12:28:45.318520 (+  7065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:45.363450 (+ 44930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:45.363486 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:45.364024 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:28:45.395577 (+ 31553us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:45.395652 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:45.395764 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:46.340989 (+945225us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b24001600e8. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e207829c4 00007f1e20780acb 00007f1e2093bdc9 00007f1e2093ba55 00007f1e2093b09d 00007f1e2356d10e 00007f1e2358488c 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221
0709 12:28:46.366063 (+ 25074us) raft_consensus.cc:1685] finished
0709 12:28:46.366611 (+   548us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:46.366932 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32543,"raft.queue_time_us":44645,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":10923776,"thread_start_us":31104,"threads_started":1,"wal-append.queue_time_us":75315}
I20260709 12:28:46.378180 26408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53780 (request call id 726) took 1527 ms. Trace:
I20260709 12:28:46.378691 26408 rpcz_store.cc:276] 0709 12:28:44.851047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.863955 (+ 12908us) service_pool.cc:224] Handling call
0709 12:28:45.257539 (+393584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:45.258170 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:46.377965 (+1119795us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400003a50. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e88ad 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:46.378117 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773069568}
I20260709 12:28:46.339890 27282 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:46.387948 27282 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:46.355159 27261 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:46.351302 27202 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:46.422086 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.415938 27155 consensus_queue.cc:1059] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:28:46.410166 27223 consensus_queue.cc:1059] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:28:46.414208 27202 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.433508 27158 raft_consensus.cc:3055] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:46.438638 27158 raft_consensus.cc:740] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:46.441618 27158 consensus_queue.cc:260] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.442180 27250 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.442977 27158 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:46.445104 27250 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:46.451712 27260 log.cc:927] Time spent T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.632s	user 0.004s	sys 0.000s
I20260709 12:28:46.468080 27101 raft_consensus.cc:3055] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:46.468608 27101 raft_consensus.cc:740] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:46.456533 25560 consensus_queue.cc:260] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.476917 27101 consensus_queue.cc:260] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:46.478631 27101 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:46.481571 25560 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:46.486315 27264 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.487617 25634 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:46.488807 27264 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:46.499732 25560 raft_consensus.cc:1275] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:28:46.500433 25560 pending_rounds.cc:85] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Aborting all ops after (but not including) 3
I20260709 12:28:46.500748 25560 pending_rounds.cc:107] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:28:46.501149 25560 raft_consensus.cc:2889] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:46.502158 25560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44842 (request call id 246) took 1204 ms. Trace:
W20260709 12:28:46.502698 25534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.502799 25560 rpcz_store.cc:276] 0709 12:28:45.297627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.298784 (+  1157us) service_pool.cc:224] Handling call
0709 12:28:45.299074 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:46.456178 (+1157104us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b54001575a0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e2396706f 00007f1e239dff60 00007f1e239e17de 00007f1e239ebb49 00007f1e239ec416 00007f1e239e8d8f 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62
0709 12:28:46.501786 (+ 45608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:46.502086 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16691968}
I20260709 12:28:46.501375 27250 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:46.505952 27250 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:46.507690 27301 log.cc:927] Time spent T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.155s	user 0.002s	sys 0.001s
I20260709 12:28:46.508360 27250 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:46.503484 27119 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:28:46.515314 25532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:46.516039 25532 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.519425 26408 raft_consensus.cc:1240] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:28:46.521631 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:46.521911 26420 raft_consensus.cc:1240] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:46.522464 26419 raft_consensus.cc:2410] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:28:46.525065 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:46.525791 26409 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:46.533577 26182 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:46.545089 26985 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:46.545735 26985 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.548936 25458 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:46.550189 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:46.552700 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.553200 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:46.553390 25640 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
I20260709 12:28:46.553928 25639 raft_consensus.cc:2393] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:46.555521 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.559204 27175 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:46.559768 27259 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:46.560211 27259 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:46.557111 27190 consensus_queue.cc:1048] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:46.567816 27251 consensus_queue.cc:1048] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:46.560772 27271 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:46.575562 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.565469 27259 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:46.571584 27179 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:46.582012 25606 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.516970 25532 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:46.584903 26182 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:46.547801 26985 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:46.592343 27253 consensus_queue.cc:1059] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:28:46.593708 27300 log.cc:927] Time spent T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 12:28:46.595603 25637 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
W20260709 12:28:46.605319 25533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:46.623447 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 106557us
I20260709 12:28:46.614784 27266 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:46.632773 25532 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:46.607117 27118 consensus_queue.cc:1059] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:28:46.629904 27012 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:46.640792 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.625382 27158 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:46.625600 26985 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:46.650388 25493 raft_consensus.cc:1217] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:28:46.651093 25493 raft_consensus.cc:1240] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:28:46.631358 26878 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.649187 25532 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:46.642139 27266 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.637259 27018 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:46.662647 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.643249 27223 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:46.666579 25609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.664724 25487 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:46.649516 27250 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:46.666915 26983 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:46.648350 27158 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:46.676096 27158 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:46.676209 26983 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:46.676919 26983 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:46.641639 27154 consensus_queue.cc:1059] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:28:46.650141 27012 raft_consensus.cc:697] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:46.664463 27266 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:46.652837 26985 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.693014 26937 raft_consensus.cc:3055] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:46.693429 26937 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:46.693503 26981 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.694212 26981 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.694382 26937 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:46.695798 26937 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:46.701552 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.673393 27018 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.699450 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:46.697042 26981 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:46.667466 26878 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.697505 26985 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:46.713424 26406 raft_consensus.cc:1240] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:28:46.721031 27273 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.721683 27273 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.713464 27012 consensus_queue.cc:237] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:46.724661 26878 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:46.725330 27281 raft_consensus.cc:3055] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.725848 27281 raft_consensus.cc:740] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:46.726636 27281 consensus_queue.cc:260] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:46.728483 27202 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:46.730676 27250 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:46.731161 27250 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:46.727978 27281 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.733527 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.734936 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.735607 25643 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:46.737329 27261 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.737845 27261 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.739702 27273 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:46.740165 27261 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:46.741375 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.743234 26181 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.745374 27210 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:46.746789 27158 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.749056 27162 consensus_queue.cc:1048] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:46.750982 26985 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.751494 26985 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.753350 27101 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.753844 27101 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.755259 25642 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:46.755836 27101 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:46.757458 27294 log.cc:927] Time spent T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.412s	user 0.000s	sys 0.002s
W20260709 12:28:46.755404 27267 log.cc:927] Time spent T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.833s	user 0.004s	sys 0.000s
W20260709 12:28:46.743270 25535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:46.761871 25634 raft_consensus.cc:1275] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:46.763038 25564 raft_consensus.cc:1275] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.763054 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.764132 25642 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
W20260709 12:28:46.763108 27295 log.cc:927] Time spent T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.414s	user 0.001s	sys 0.001s
I20260709 12:28:46.765269 26923 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:46.765455 25494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60406 (request call id 237) took 1055 ms. Trace:
I20260709 12:28:46.737879 27251 consensus_queue.cc:1059] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:46.765779 26923 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.765808 25494 rpcz_store.cc:276] 0709 12:28:45.710426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.710564 (+   138us) service_pool.cc:224] Handling call
0709 12:28:45.710951 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:46.075686 (+364735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:46.075812 (+   126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:46.086111 (+ 10299us) log.cc:844] Serialized 26 byte log entry
0709 12:28:46.258201 (+172090us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:28:46.258260 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:46.258353 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:46.762464 (+504111us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:28:46.765159 (+  2695us) raft_consensus.cc:1685] finished
0709 12:28:46.765201 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:46.765399 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58106,"raft.queue_time_us":156353,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":17230,"spinlock_wait_cycles":10980608,"thread_start_us":433734,"threads_started":2,"wal-append.queue_time_us":233485}
I20260709 12:28:46.767927 26923 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:46.769568 26985 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:46.769995 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:46.772533 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.772751 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.773247 25491 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:46.774477 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:46.775134 26402 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:46.775828 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.778119 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.778741 25560 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
I20260709 12:28:46.780360 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.781911 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.782727 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:46.783476 27053 raft_consensus.cc:3055] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:46.783861 27053 raft_consensus.cc:740] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:46.784631 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.784662 27053 consensus_queue.cc:260] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:46.786741 27053 raft_consensus.cc:3060] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:46.796200 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.802147 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:46.802044 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:46.748919 27158 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:46.813299 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.816706 25564 raft_consensus.cc:2393] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 3: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:46.822185 25535 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.829315 26964 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:46.809625 26923 consensus_queue.cc:1059] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:28:46.839149 25535 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.841338 27202 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:46.825321 27222 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:46.870187 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 46619.6us
I20260709 12:28:46.809805 26983 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.844827 26964 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:46.881246 27259 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:46.882261 27055 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:46.882500 27222 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:46.882894 27055 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:46.883535 27259 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:46.883939 26981 raft_consensus.cc:3055] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:46.884362 26981 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:46.885669 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.887794 27055 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:46.889335 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.891534 27190 raft_consensus.cc:3055] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:46.891917 27190 raft_consensus.cc:740] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:46.892642 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:46.892740 27190 consensus_queue.cc:260] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.893560 25564 raft_consensus.cc:2410] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:28:46.858505 25560 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:46.896467 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.897871 26182 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.898392 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:46.883000 27222 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:46.889899 27266 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.904469 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:46.911051 26182 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:46.842973 27202 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:46.941015 26180 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.955639 25643 raft_consensus.cc:1240] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:46.955914 25459 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:46.958578 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:46.960126 25535 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.961562 25641 raft_consensus.cc:1275] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:28:46.914098 26732 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:46.965634 25535 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.940867 26976 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:46.967698 25636 raft_consensus.cc:1275] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:46.939908 26937 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:46.967123 27155 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:46.921694 26981 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:46.954739 27190 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:46.959827 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.949816 25566 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:46.982993 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:46.967831 26923 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:46.984714 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5117c622cec24a8fb3f80b35f2d10db8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:46.988687 25492 raft_consensus.cc:1240] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:28:46.988822 25608 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:46.968639 27271 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:46.985615 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:46.963459 26402 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 7.
I20260709 12:28:46.955747 27281 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:28:46.967208 26976 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:46.993577 25608 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:46.955685 27259 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:28:46.988821 27162 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:46.994825 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.007131 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:47.002799 27264 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:47.010908 25459 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:46.995426 25486 raft_consensus.cc:1240] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:46.984133 26937 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:46.997280 26981 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:46.988183 27118 consensus_queue.cc:1048] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:28:47.002833 26976 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:47.003394 27282 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:47.004815 27162 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:47.032802 25492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43702 (request call id 1060) took 1315 ms. Trace:
I20260709 12:28:47.033334 25492 rpcz_store.cc:276] 0709 12:28:45.717318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:45.829238 (+111920us) service_pool.cc:224] Handling call
0709 12:28:45.869429 (+ 40191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:46.992172 (+1122743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.032508 (+ 40336us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400611a54. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:47.032736 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568139648}
I20260709 12:28:47.039006 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:47.042780 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.036619 26181 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:47.045792 26181 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.012876 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.052614 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:47.053434 25562 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
W20260709 12:28:47.054936 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 44140us
I20260709 12:28:47.030727 27162 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:47.055912 25459 leader_election.cc:304] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:47.026678 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.022083 27271 consensus_queue.cc:1048] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:28:47.070259 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.074724 27266 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:47.047120 27056 consensus_queue.cc:1048] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:28:47.075793 26937 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:47.076607 27056 raft_consensus.cc:2749] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:47.071449 25460 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.077472 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.078207 26406 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:47.078835 27261 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:47.025060 27250 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:47.083537 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 151634us
I20260709 12:28:47.079778 27261 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.068248 27281 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:47.042768 27210 consensus_queue.cc:1048] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:28:47.147356 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:47.146231 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 205291us
I20260709 12:28:47.081068 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:47.191805 25534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.200632 26408 raft_consensus.cc:1240] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:47.200843 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 155123us
I20260709 12:28:47.207798 26181 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.209477 25567 raft_consensus.cc:1217] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:28:47.210080 25567 raft_consensus.cc:1240] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:28:47.139371 27018 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:47.145550 27261 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:28:47.216010 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 160176us
I20260709 12:28:47.200132 26732 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:47.235401 25562 raft_consensus.cc:1240] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:47.200388 26929 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:47.274045 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:47.276360 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:47.215405 27303 log.cc:927] Time spent T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:28:47.210276 27222 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:47.217406 26404 raft_consensus.cc:1240] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:28:47.307243 25534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.216095 27202 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:47.307262 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:47.314312 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 216056us
W20260709 12:28:47.310307 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 161062us
I20260709 12:28:47.310221 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:47.330185 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 122455us
I20260709 12:28:47.340466 26182 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:47.304764 26929 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.349553 27074 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:47.365772 27322 log.cc:927] Time spent T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:28:47.354619 27319 log.cc:927] Time spent T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 12:28:47.373422 27318 log.cc:927] Time spent T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:28:47.387717 25606 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:47.397059 27053 consensus_meta.cc:287] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.610s	user 0.005s	sys 0.009s
I20260709 12:28:47.398896 25635 raft_consensus.cc:1275] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:28:47.399367 25635 pending_rounds.cc:85] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 1
I20260709 12:28:47.399639 25635 pending_rounds.cc:107] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:28:47.399905 25635 raft_consensus.cc:2889] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:47.401389 27333 log.cc:927] Time spent T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
W20260709 12:28:47.404356 27320 log.cc:927] Time spent T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.331s	user 0.001s	sys 0.001s
I20260709 12:28:47.421629 27342 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:47.422194 27342 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.422564 27342 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:47.426204 26732 raft_consensus.cc:493] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:47.427001 26732 raft_consensus.cc:515] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.441342 27162 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.442315 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d902711df4cea9b3d41edac3a3a48" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.443682 27162 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:47.451740 27261 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.455153 27342 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.464304 27250 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:47.491257 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 173288us
W20260709 12:28:47.491323 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 154437us
I20260709 12:28:47.492430 26181 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:47.494654 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:47.480149 27340 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:47.497970 27340 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:47.498664 27012 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:47.499859 27012 raft_consensus.cc:697] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:47.500262 27340 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:47.497375 27253 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:47.500819 27012 consensus_queue.cc:237] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.502471 26929 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:47.502565 25606 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.506888 26180 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
W20260709 12:28:47.507323 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 124511us
I20260709 12:28:47.515656 25606 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.524473 25606 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.526755 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.529192 25608 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:47.534294 25639 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:47.534845 27337 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:47.536132 26180 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.539486 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.538667 25606 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:47.511026 27250 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:47.543838 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.547062 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.514103 27225 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:47.548816 26418 raft_consensus.cc:2393] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 6: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:47.542043 27347 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:47.552517 26404 raft_consensus.cc:1275] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:47.553421 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:47.553691 27337 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.559160 26732 leader_election.cc:290] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:47.559064 27347 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.560447 27328 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:47.587785 27328 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:47.588280 27328 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:47.562520 26981 consensus_meta.cc:287] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.003s
I20260709 12:28:47.508459 27271 consensus_queue.cc:1059] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:28:47.594220 27271 raft_consensus.cc:3055] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:47.594623 27271 raft_consensus.cc:740] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:47.594882 27264 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:47.595466 27264 raft_consensus.cc:493] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.595526 27271 consensus_queue.cc:260] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:47.563225 27190 consensus_meta.cc:287] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.001s
I20260709 12:28:47.595991 27264 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:47.581501 27053 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:47.596901 27271 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:47.549242 27250 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:47.604393 25564 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
W20260709 12:28:47.642325 25534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.644984 25492 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
W20260709 12:28:47.634554 27316 log.cc:927] Time spent T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:28:47.635110 27250 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:47.660447 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 131354us
W20260709 12:28:47.677127 25459 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.645586 27225 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:47.686208 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 150146us
I20260709 12:28:47.666178 27012 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:47.705641 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 167032us
I20260709 12:28:47.714305 25606 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.698087 26985 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:47.737514 27162 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.738241 27162 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.704980 27202 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:47.691854 27225 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:47.748901 25534 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:47.710227 25486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c409decd6b41e38642164bc29adcac"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:52346
W20260709 12:28:47.742238 27346 log.cc:927] Time spent T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:28:47.757925 25606 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:47.759847 25486 raft_consensus.cc:606] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:47.760550 27357 consensus_queue.cc:1059] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:47.761391 27358 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:47.752645 27340 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:47.701742 27012 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.744793 27342 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:47.754570 27053 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:47.755270 27341 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:47.754894 26420 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53792 (request call id 650) took 1089 ms. Trace:
I20260709 12:28:47.768898 25486 raft_consensus.cc:614] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:47.836643 27359 log.cc:927] Time spent T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:28:47.838233 27356 log.cc:927] Time spent T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:28:47.838251 27253 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:47.839383 26983 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:47.839270 27253 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.842501 27253 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:47.846455 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.853919 25560 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:47.855778 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:47.856455 25560 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:47.768603 27354 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:47.863677 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:47.867264 25634 raft_consensus.cc:2393] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:47.863471 27119 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:47.867612 27355 log.cc:927] Time spent T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:28:47.861959 25532 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:47.867957 27119 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.868528 26923 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:47.868716 27012 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:47.869184 26923 raft_consensus.cc:697] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:47.870252 27119 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:47.870136 26923 consensus_queue.cc:237] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.873548 27190 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:47.874176 27190 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:47.876312 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.876935 25639 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:47.879861 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:47.754866 27202 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:47.884305 25494 raft_consensus.cc:2393] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 6: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:47.884506 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:47.886109 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:47.887785 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.888556 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:47.895023 25495 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:47.859356 27253 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:47.898244 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.899340 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:47.785856 27340 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.906016 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:47.906168 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:47.912045 25639 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:47.907756 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:47.913416 25637 raft_consensus.cc:3060] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:47.862962 26983 consensus_queue.cc:1059] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:28:47.919552 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7749b2664d48431c84785782eb9c6580" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.885299 26929 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:47.915449 26180 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:47.886647 27251 raft_consensus.cc:493] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:47.890059 27266 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:47.886813 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:47.781317 27358 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:47.907017 27337 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:47.951702 25635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53082 (request call id 870) took 1006 ms. Trace:
I20260709 12:28:47.851907 27341 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:47.955673 25635 rpcz_store.cc:276] 0709 12:28:46.945191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.947417 (+  2226us) service_pool.cc:224] Handling call
0709 12:28:46.965139 (+ 17722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:47.400383 (+435244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.951458 (+551075us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54006068d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:47.951641 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996435328}
I20260709 12:28:47.965847 25560 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 8.
I20260709 12:28:47.971923 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:47.982033 26415 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:47.933360 27339 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:47.994519 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.033042 25495 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
W20260709 12:28:48.063045 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 215238us
I20260709 12:28:47.910876 27253 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.070779 25635 raft_consensus.cc:2393] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 5: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:48.072266 25636 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
I20260709 12:28:48.113891 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:47.970522 27190 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:47.935334 26929 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.071583 27233 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:48.135336 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 219109us
I20260709 12:28:48.139205 25532 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:47.966496 27251 raft_consensus.cc:515] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.157426 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.113740 27259 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.124356 25488 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:48.126621 27225 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.166297 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:48.129703 27190 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.118175 27354 consensus_queue.cc:1059] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:28:48.168035 25493 raft_consensus.cc:606] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:48.177947 27202 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:48.178620 27368 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.179311 27368 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:48.181715 27361 log.cc:927] Time spent T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:28:47.788278 26420 rpcz_store.cc:276] 0709 12:28:46.665138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.666981 (+  1843us) service_pool.cc:224] Handling call
0709 12:28:46.668713 (+  1732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:46.724499 (+ 55786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:46.724539 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:46.748084 (+ 23545us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b2c001b5bb8. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e222e2a11 00007f1e222f2372 00007f1e23a24a01 00007f1e239e943a 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2
0709 12:28:46.748506 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:28:46.875154 (+126648us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:46.875216 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.716771 (+841555us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b540000a854. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:47.718740 (+  1969us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:47.733443 (+ 14703us) raft_consensus.cc:1685] finished
0709 12:28:47.735679 (+  2236us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:47.752811 (+ 17132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":718,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":177421952,"thread_start_us":101209,"threads_started":1,"wal-append.queue_time_us":248158}
W20260709 12:28:48.186295 27363 log.cc:927] Time spent T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:28:48.188062 27253 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.188661 27253 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.156442 27233 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.188077 27250 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.190913 26408 raft_consensus.cc:2368] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:48.191304 27233 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.192804 27250 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.194167 26929 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.194559 27251 leader_election.cc:290] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.200934 27358 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.202592 27341 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.192967 27233 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:48.206538 27233 raft_consensus.cc:493] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.174082 27369 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.206982 27233 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.207270 27369 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.213707 27341 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:48.214470 27340 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:48.214478 27341 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:48.217677 27360 log.cc:927] Time spent T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.380s	user 0.000s	sys 0.002s
W20260709 12:28:48.224624 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 321595us
I20260709 12:28:48.238814 25637 raft_consensus.cc:2468] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:48.249387 26180 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:48.171463 27225 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.167222 27259 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.223199 27354 consensus_queue.cc:1243] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer 05cabf76554146489f61260dbdadf659 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:28:48.253506 27364 log.cc:927] Time spent T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 12:28:48.172988 27190 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.279254 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:48.280242 25493 raft_consensus.cc:606] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:48.280753 25493 raft_consensus.cc:614] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:48.258116 27012 raft_consensus.cc:2804] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:48.250290 27119 consensus_queue.cc:1059] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:28:48.189126 27253 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:48.291836 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 152725us
W20260709 12:28:48.283354 27264 consensus_meta.cc:287] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.001s
W20260709 12:28:48.282418 27328 consensus_meta.cc:287] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.694s	user 0.000s	sys 0.012s
I20260709 12:28:48.261242 27225 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.284502 27374 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.281850 27340 raft_consensus.cc:493] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.283061 27368 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:48.291024 27375 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
W20260709 12:28:48.309690 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 245784us
I20260709 12:28:48.299698 27012 raft_consensus.cc:697] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:48.300282 27369 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.306048 27341 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.319898 25493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:48.320735 25493 raft_consensus.cc:606] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Received request to transfer leadership to TS 05cabf76554146489f61260dbdadf659
I20260709 12:28:48.310004 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.303378 27264 raft_consensus.cc:515] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:48.317610 26976 consensus_meta.cc:287] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 1.287s	user 0.015s	sys 0.000s
I20260709 12:28:48.327010 25639 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 8.
W20260709 12:28:48.332054 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 142998us
I20260709 12:28:48.304129 27328 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.336103 27259 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.336921 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.337232 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:28:48.337607 25493 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:48.324493 27376 raft_consensus.cc:493] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.340161 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.308871 27374 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.312933 27340 raft_consensus.cc:515] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.349964 25493 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:48.351665 27259 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
W20260709 12:28:48.352211 27378 log.cc:927] Time spent T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:28:48.352272 27259 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.355602 27259 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:48.358675 27328 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:48.361619 27377 log.cc:927] Time spent T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:28:48.361842 27388 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.333151 26976 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.362880 27012 consensus_queue.cc:237] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.364250 26409 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:48.365247 26976 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:48.368492 27271 consensus_meta.cc:287] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.001s
I20260709 12:28:48.370957 27190 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.375250 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.376591 27225 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.379011 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.380019 26420 raft_consensus.cc:2393] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 2: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:48.313060 27375 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.383070 27391 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.383899 27375 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:48.383700 27391 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.387068 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.410791 25489 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 2.
I20260709 12:28:48.414783 25492 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43728 (request call id 647) took 1198 ms. Trace:
I20260709 12:28:48.416364 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.417309 25492 rpcz_store.cc:276] 0709 12:28:47.212567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.214725 (+  2158us) service_pool.cc:224] Handling call
0709 12:28:48.391171 (+1176446us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54004ac9d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:48.411334 (+ 20163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840452352}
I20260709 12:28:48.417752 25562 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:48.425110 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.426170 25562 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:48.430991 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.431756 25635 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 8.
I20260709 12:28:48.434758 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.437718 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.362438 27388 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.433372 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.444082 27386 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.444368 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.444700 27386 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.447021 27386 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.450613 27329 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:48.452324 27329 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.454385 27329 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.388675 27376 raft_consensus.cc:515] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.462136 27373 raft_consensus.cc:993] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:48.462452 25460 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.463050 27281 raft_consensus.cc:1081] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Signalling peer 05cabf76554146489f61260dbdadf659 to start an election
I20260709 12:28:48.463490 27259 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:48.463914 27259 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.464258 27259 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.467940 25460 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.473598 27190 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:48.477085 27190 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.477497 27190 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.477631 27374 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.455422 25561 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
W20260709 12:28:48.478447 25564 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39676 (request call id 661) took 1576 ms (client timeout 1585 ms). Trace:
W20260709 12:28:48.478850 25564 rpcz_store.cc:269] 0709 12:28:46.902207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.904181 (+  1974us) service_pool.cc:224] Handling call
0709 12:28:48.478263 (+1574082us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b540040d8d4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:48.478364 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564350336}
I20260709 12:28:48.480086 27340 leader_election.cc:290] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.481017 27264 leader_election.cc:290] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:48.474259 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:48.492267 27053 raft_consensus.cc:3055] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:48.492712 27053 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:48.493476 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.494506 25490 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:48.504719 25535 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.506440 25460 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.507915 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.510329 25535 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.512619 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.512885 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.513690 25560 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 8.
I20260709 12:28:48.507731 27379 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.511397 27392 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:48.516196 27392 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.515842 27379 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.516522 27055 raft_consensus.cc:3055] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:48.516997 27055 raft_consensus.cc:740] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:48.517333 25564 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
W20260709 12:28:48.509017 25608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.98.67:32857 timed out after 1.585s (SENT) [suppressed 14 similar messages]
I20260709 12:28:48.519340 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.505697 27253 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.520730 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.513854 25458 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:48.523056 27281 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:48.523618 27379 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.514591 27175 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:48.521490 26732 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.525390 26732 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.527680 26732 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.524856 27175 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.509613 27158 raft_consensus.cc:493] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:48.532766 27175 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:48.493577 27053 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.533201 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.533846 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.495834 27374 consensus_queue.cc:1048] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:28:48.528764 27233 raft_consensus.cc:515] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.536379 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.540143 25491 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:48.540279 27055 consensus_queue.cc:260] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.541016 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.541637 27055 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.537853 25533 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:48.516557 27392 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:48.546201 26402 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53792 (request call id 659) took 1008 ms. Trace:
I20260709 12:28:48.546650 26402 rpcz_store.cc:276] 0709 12:28:47.538017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.542420 (+  4403us) service_pool.cc:224] Handling call
0709 12:28:48.539344 (+996924us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5800312098. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e208c4b71 00007f1e208c4eee 000000000036eb39 00007f1e289381e0 00007f1e28a010c4 00007f1e28a01131 00007f1e289c2fc0 00007f1e289ad929 00007f1e289ad3d2 00007f1e21f24bd4
0709 12:28:48.545601 (+  6257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:48.545831 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:48.545863 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:48.545917 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:48.545950 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:48.546014 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.546140 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36613888}
I20260709 12:28:48.543116 27162 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.544473 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.549834 25566 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.536988 27158 raft_consensus.cc:515] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.538374 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.552115 27053 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:48.552434 25640 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:48.543941 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.545800 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.551290 25486 raft_consensus.cc:2393] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 3: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:48.558995 25495 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:48.555406 25460 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.514896 27375 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:28:48.565883 26181 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:48.542210 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:48.548986 27362 log.cc:927] Time spent T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.808s	user 0.003s	sys 0.000s
I20260709 12:28:48.536988 25490 raft_consensus.cc:1240] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:48.571442 25491 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:48.584390 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:48.586594 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 77592us
I20260709 12:28:48.582221 25533 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:48.539712 27388 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.589214 25608 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:48.590466 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.595328 27233 leader_election.cc:290] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:48.597046 26976 raft_consensus.cc:493] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.597816 26976 raft_consensus.cc:515] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.600500 26976 leader_election.cc:290] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.606544 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.607354 26415 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:48.580580 27379 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:48.581110 27329 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:48.586766 27374 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:28:48.590036 27118 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.008s	sys 0.008s
I20260709 12:28:48.577760 27337 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:28:48.620319 26401 raft_consensus.cc:1240] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:48.627794 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.632315 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:48.628530 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.611024 27354 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:48.630944 25609 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.632854 26401 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.610764 27388 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:48.634063 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:48.620641 27118 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.008s	sys 0.008s
I20260709 12:28:48.604667 27175 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.617496 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.639791 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.615945 27332 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.639248 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.642280 25609 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:48.637051 26415 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 2.
W20260709 12:28:48.644999 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 62915.5us
I20260709 12:28:48.648106 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.648591 25533 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:48.648742 25609 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.650116 25643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53082 (request call id 877) took 1132 ms. Trace:
I20260709 12:28:48.650300 25609 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.632853 27164 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.656131 27164 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.649559 27012 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.652518 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.653110 25565 pending_rounds.cc:85] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: Aborting all ops after (but not including) 2
I20260709 12:28:48.654781 27175 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.637413 27354 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.655637 25494 raft_consensus.cc:1240] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:48.656215 27259 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.591813 27394 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:28:48.635864 25563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3"
dest_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:39666
I20260709 12:28:48.633795 27329 raft_consensus.cc:697] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:48.641492 27386 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:48.641301 27266 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:48.678676 25565 pending_rounds.cc:107] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:28:48.661979 25458 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.666849 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.650480 25643 rpcz_store.cc:276] 0709 12:28:47.514196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:47.514365 (+   169us) service_pool.cc:224] Handling call
0709 12:28:47.533919 (+ 19554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:47.543179 (+  9260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:47.543211 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:47.562679 (+ 19468us) log.cc:844] Serialized 26 byte log entry
0709 12:28:47.694796 (+132117us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:28:47.694838 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:47.694910 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:48.175391 (+480481us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b4800180b58. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e28912aa1 00007f1e28909b37 00007f1e289099ca 00007f1e28a0126f 00007f1e28a00f37 00007f1e28a1555c 00007f1e28a15508 00007f1e28a15488 00007f1e28a15443 00007f1e28a146ec 00007f1e2793ea96
0709 12:28:48.548365 (+372974us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e20784db1 00007f1e20822c85 00007f1e208236a2 00007f1e235951db 00007f1e23590aaf 00007f1e2358486e 00007f1e23583bb6 00007f1e235837d8 00007f1e2358d221 00007f1e2358d1d9 00007f1e2358d169
0709 12:28:48.646032 (+ 97667us) raft_consensus.cc:1685] finished
0709 12:28:48.646051 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:48.646178 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8889,"raft.queue_time_us":10914,"raft.run_cpu_time_us":4454,"raft.run_wall_time_us":621220,"spinlock_wait_cycles":19939456,"thread_start_us":52929,"threads_started":1,"wal-append.queue_time_us":141992}
I20260709 12:28:48.669207 25561 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 1.
I20260709 12:28:48.660436 27332 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.660758 27282 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:48.658742 27055 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:48.658502 27202 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:48.663810 27264 raft_consensus.cc:2804] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:48.664474 27074 raft_consensus.cc:493] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:48.672597 27374 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.658186 27012 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.675470 27158 leader_election.cc:290] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.685182 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:48.686039 25314 catalog_manager.cc:5697] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 5 to 6, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 6 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:48.692061 25563 raft_consensus.cc:493] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:48.694499 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.709827 25563 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:48.710114 25564 raft_consensus.cc:2368] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6.
I20260709 12:28:48.694993 26401 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:48.678125 27354 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:48.699316 25458 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.700730 25565 raft_consensus.cc:2889] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:48.700666 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.705649 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.700764 27164 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.703783 27175 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:48.709836 25533 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:48.703351 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.704084 27264 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.715907 26181 leader_election.cc:400] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6.
I20260709 12:28:48.702108 27282 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.697999 27266 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:48.678319 27190 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.710995 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.718467 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.729001 25560 raft_consensus.cc:2376] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4. Re-sending same reply.
I20260709 12:28:48.702371 27202 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.720526 25568 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:48.721450 25533 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:48.715587 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.707995 27374 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:48.725401 27164 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:48.734615 27164 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.735041 27164 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:48.723815 26181 leader_election.cc:403] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:48.725121 27264 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:48.709008 25488 raft_consensus.cc:1240] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:48.727685 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.733351 27202 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:48.731720 25608 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:48.742910 27344 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:48.743319 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19b643e26e28481e80dd52e2609d357d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:48.743974 25643 raft_consensus.cc:3060] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.745299 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fd4b00fcdba43ccac1dc476ba3abbf5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.745929 25640 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:48.707351 27074 raft_consensus.cc:515] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.703480 27253 consensus_queue.cc:1059] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:28:48.748445 27074 leader_election.cc:290] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.748950 27253 raft_consensus.cc:3055] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:48.711827 27392 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.743543 27379 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:48.749369 27253 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:48.749681 27379 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.750140 27379 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:48.750236 27253 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.751005 27392 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.751538 27253 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:48.752173 27374 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.743386 27344 raft_consensus.cc:697] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:48.754347 27012 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.754109 27344 consensus_queue.cc:237] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.719543 27281 raft_consensus.cc:2804] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:48.755476 27281 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:48.748971 27074 raft_consensus.cc:2749] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6.
I20260709 12:28:48.755889 27281 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:48.759297 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.760257 25564 raft_consensus.cc:2368] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4.
I20260709 12:28:48.763219 26181 leader_election.cc:400] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4.
I20260709 12:28:48.763569 26181 leader_election.cc:403] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:28:48.765412 25563 raft_consensus.cc:515] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.720142 27175 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.771046 25568 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:48.773810 25643 raft_consensus.cc:2468] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:48.729848 27282 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.729224 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.775185 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.757527 27266 raft_consensus.cc:3060] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.777714 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.779009 26181 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:48.783501 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.781558 25492 raft_consensus.cc:2393] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 6: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:48.785444 25563 leader_election.cc:290] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.786475 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:48.787050 25493 raft_consensus.cc:3055] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:48.787333 25493 raft_consensus.cc:740] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:48.788064 25493 consensus_queue.cc:260] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.789117 25493 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:48.764678 27339 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:48.761096 27347 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.766255 27392 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:28:48.761562 27329 consensus_queue.cc:237] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.710659 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:48.797497 25493 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:48.778730 27175 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:48.886227 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.885813 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:48.850507 27376 leader_election.cc:290] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.946781 25567 raft_consensus.cc:2393] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 4: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:48.837675 27261 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.874102 27384 consensus_queue.cc:1059] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:28:48.857141 27176 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:48.948396 27176 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:48.948711 27225 raft_consensus.cc:3055] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:48.949151 27225 raft_consensus.cc:740] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:48.810686 25561 raft_consensus.cc:1240] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:48.865043 25642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.950248 27225 consensus_queue.cc:260] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.880494 27266 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.862850 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1704016a67e740008ce23d578992ecaa" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.951392 27225 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:48.863372 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.892583 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.952595 27266 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.879182 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.916498 27164 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:48.860070 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.833683 27332 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.893097 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.864051 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.834466 25535 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:48.865465 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4fcc72a03d416991a845dcfd4b9b5f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.955827 27375 raft_consensus.cc:2804] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:48.956192 27375 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:48.956470 25487 raft_consensus.cc:1275] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:28:48.956682 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 122309us
I20260709 12:28:48.849880 27391 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:48.812399 27202 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.846326 27386 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:48.931301 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:48.959503 27386 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:48.896380 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.822044 27259 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.806962 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:48.848016 27271 raft_consensus.cc:993] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:48.956555 27375 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:48.883419 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.922012 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.892226 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.907594 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.962383 25643 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:48.885293 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.879856 27273 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:48.965020 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:48.858191 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.899974 25489 raft_consensus.cc:1240] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:48.860322 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "340dfb91e8e44fdfaf0b420eefa9df9f" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:48.888756 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:48.900025 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fdf104c9b4e44bc81ed8ead9c9f0041" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.800239 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:48.828629 27379 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:48.976583 25486 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:48.978426 25638 raft_consensus.cc:2393] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 4: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:48.977289 25563 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:48.895757 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 111614us
I20260709 12:28:48.953706 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:48.832707 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:48.927460 25315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57448 (request call id 183) took 7751 ms. Trace:
I20260709 12:28:48.997069 25560 raft_consensus.cc:1240] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:49.009479 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:48.969679 26182 leader_election.cc:304] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:48.919296 25314 catalog_manager.cc:5697] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:49.009845 25535 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:49.013890 25608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.016145 25314 catalog_manager.cc:5697] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:48.929983 27281 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.030179 25314 catalog_manager.cc:5697] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
I20260709 12:28:49.031687 25314 catalog_manager.cc:5697] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:49.033455 25643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.033216 25314 catalog_manager.cc:5697] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:49.034024 25643 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:48.841720 27264 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:48.802743 27374 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:48.944586 27392 consensus_queue.cc:1243] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:28:48.912572 27339 raft_consensus.cc:2749] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857) with higher term. Message: Invalid argument: T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4.
I20260709 12:28:49.040838 27379 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:49.043951 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 44042us
I20260709 12:28:49.045390 27381 consensus_queue.cc:1048] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:48.964907 27273 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.048574 27271 raft_consensus.cc:1081] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:49.049778 27273 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.050189 27202 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.007545 25315 rpcz_store.cc:276] 0709 12:28:41.176065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:41.185129 (+  9064us) service_pool.cc:224] Handling call
0709 12:28:48.927371 (+7742242us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:44.560837 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:44.620938 (+ 60101us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:44.620988 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:28:44.621011 (+    23us) tablet.cc:662] Decoding operations
0709 12:28:44.621732 (+   721us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:44.621789 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:44.621833 (+    44us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:28:44.622201 (+   368us) tablet.cc:701] Row locks acquired
0709 12:28:44.622221 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:28:44.622362 (+   141us) write_op.cc:270] Start()
0709 12:28:44.622473 (+   111us) write_op.cc:276] Timestamp: P: 1783600124622319 usec, L: 0
0709 12:28:44.622491 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:28:44.623150 (+   659us) log.cc:844] Serialized 1693 byte log entry
0709 12:28:44.864602 (+241452us) op_driver.cc:464] REPLICATION: finished
0709 12:28:45.215613 (+351011us) write_op.cc:301] APPLY: starting
0709 12:28:45.218270 (+  2657us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:45.235073 (+ 16803us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:45.235240 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:45.236028 (+   788us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:45.236272 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:28:45.236340 (+    68us) write_op.cc:312] APPLY: finished
0709 12:28:45.236619 (+   279us) log.cc:844] Serialized 40 byte log entry
0709 12:28:45.237869 (+  1250us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:45.238148 (+   279us) write_op.cc:454] Released schema lock
0709 12:28:45.238275 (+   127us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:45.239193 (+   918us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:45.239273 (+    80us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34744,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":320131,"apply.run_cpu_time_us":3195,"apply.run_wall_time_us":27479,"num_ops":4,"prepare.queue_time_us":178328,"prepare.run_cpu_time_us":3592,"prepare.run_wall_time_us":82781,"replication_time_us":222550,"thread_start_us":338628,"threads_started":2}]]}
I20260709 12:28:49.057890 27176 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.875102 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.064657 25643 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:49.066864 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:49.067380 26418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:49.067917 26418 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:49.068259 26418 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:49.068464 25314 catalog_manager.cc:5697] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.071945 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.072860 25314 catalog_manager.cc:5697] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.077026 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:49.077903 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.079459 25491 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:49.081040 25314 catalog_manager.cc:5697] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 4, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.087590 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.087692 25493 raft_consensus.cc:2468] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:49.099466 25314 catalog_manager.cc:5697] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.978053 25566 raft_consensus.cc:2468] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:48.801399 27074 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:49.094964 25567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:49.096781 25491 raft_consensus.cc:2368] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
W20260709 12:28:49.089983 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 120398us
I20260709 12:28:49.031634 27281 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:48.832758 27190 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:49.113143 25560 raft_consensus.cc:1240] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6. Ops: []
W20260709 12:28:49.115139 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 90070.8us
I20260709 12:28:49.121959 26182 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.122581 25533 leader_election.cc:304] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:49.100951 25314 catalog_manager.cc:5697] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:49.124027 25314 catalog_manager.cc:5697] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 2 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:49.114101 25563 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:49.115352 25535 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:49.116973 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:49.130093 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 78713.8us
I20260709 12:28:49.130884 25460 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:49.093339 27391 raft_consensus.cc:2804] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:49.141811 27391 raft_consensus.cc:697] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:49.142444 25532 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.142740 27391 consensus_queue.cc:237] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.143949 25532 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.145145 25532 leader_election.cc:304] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.147818 25532 leader_election.cc:400] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:49.148100 25532 leader_election.cc:403] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:28:49.145298 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:49.092895 27347 consensus_queue.cc:1059] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:28:49.150947 27347 raft_consensus.cc:3055] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:49.151389 27347 raft_consensus.cc:740] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:49.145514 27394 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:49.153875 27354 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.156345 25535 leader_election.cc:400] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:49.156683 25535 leader_election.cc:403] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:28:48.927924 27282 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:49.159016 27282 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:49.096753 27339 raft_consensus.cc:2749] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:49.164345 27053 consensus_queue.cc:1059] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:49.136924 25460 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:49.167171 25458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.139081 27074 raft_consensus.cc:697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:49.103775 26404 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:49.141119 26937 raft_consensus.cc:2804] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:49.172871 25635 raft_consensus.cc:1240] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:28:49.165692 26408 raft_consensus.cc:2468] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:28:49.173859 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:49.174631 26419 raft_consensus.cc:3060] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:49.138562 27261 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:49.138602 26182 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:49.184495 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 45958.5us
I20260709 12:28:49.142787 25609 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:49.187213 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.187722 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.188620 25643 pending_rounds.cc:85] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 3
I20260709 12:28:49.188688 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.189092 25643 pending_rounds.cc:107] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:28:49.189502 25643 raft_consensus.cc:2889] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:49.191428 25638 raft_consensus.cc:2368] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:49.192150 25639 raft_consensus.cc:2393] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 9: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:49.121194 27384 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:49.106838 27392 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:49.193233 25533 leader_election.cc:400] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 election: Vote denied by peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365) with higher term. Message: Invalid argument: T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:49.166036 25640 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:49.156526 27354 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.121824 27332 raft_consensus.cc:493] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:49.128791 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:49.127373 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:49.207252 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:49.235721 26415 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:49.237637 27250 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:49.239851 27175 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.165763 27251 raft_consensus.cc:2749] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.165433 27053 raft_consensus.cc:3055] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:49.146143 26983 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:49.137763 26976 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:49.205277 27282 raft_consensus.cc:2804] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:49.152484 27347 consensus_queue.cc:260] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.141156 27164 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.181742 27190 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:49.176254 26418 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.203850 27012 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.202756 26937 raft_consensus.cc:697] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:49.269831 25495 raft_consensus.cc:1240] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:49.250289 27154 raft_consensus.cc:2749] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:49.203328 27210 consensus_queue.cc:1059] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:28:49.240991 27332 raft_consensus.cc:515] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:49.256177 27053 raft_consensus.cc:740] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:49.282428 26418 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:49.262458 27402 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:49.266937 27187 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.251014 27253 consensus_queue.cc:1059] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:28:49.245048 27384 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.330559 26937 consensus_queue.cc:237] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.331781 27384 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.259464 27395 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4.
I20260709 12:28:49.249480 27392 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.266513 27118 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.333567 27053 consensus_queue.cc:260] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:49.334167 27118 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.334828 27053 raft_consensus.cc:3060] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:49.336227 27118 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.337042 27253 raft_consensus.cc:3055] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:49.337496 27253 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:49.277096 27074 consensus_queue.cc:237] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.338294 27253 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.339473 27253 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:49.344060 25488 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
W20260709 12:28:49.325594 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 47256.8us
I20260709 12:28:49.346400 25458 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:49.346756 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:49.271332 27273 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:49.273274 27282 raft_consensus.cc:697] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:49.263849 27283 consensus_queue.cc:1059] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:28:49.275700 27190 raft_consensus.cc:697] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:49.264333 26976 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.321751 27347 raft_consensus.cc:3060] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:49.363078 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 319917us
I20260709 12:28:49.364065 25459 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:49.289045 27375 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.354293 27269 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.394836 26418 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:49.395701 25459 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:49.400039 25459 leader_election.cc:304] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:49.361948 27055 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:49.350605 27187 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.406673 25567 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:49.407886 25459 leader_election.cc:304] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:49.392589 27281 raft_consensus.cc:2804] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:49.357780 27273 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:49.405822 27176 raft_consensus.cc:2749] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:49.410009 25459 leader_election.cc:304] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:49.441041 25459 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:49.398077 27395 raft_consensus.cc:493] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:49.442173 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.443076 25459 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:49.443429 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.448343 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.404990 27118 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:49.448557 25608 leader_election.cc:304] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:49.409198 26409 raft_consensus.cc:1240] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:28:49.508292 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.508764 25641 raft_consensus.cc:1240] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:49.509194 25637 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:49.512020 26408 raft_consensus.cc:1240] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:49.513646 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.447016 27340 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:49.529455 27413 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:49.530272 27413 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.446619 27409 raft_consensus.cc:2749] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:49.454730 25634 raft_consensus.cc:1240] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:49.455577 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eaa197620646c59092c991e745b86d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.456538 27374 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.446095 27282 consensus_queue.cc:237] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.457849 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:49.458385 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.541651 25635 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:49.461825 27264 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.466670 27384 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:49.469098 27344 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:49.470655 27053 raft_consensus.cc:2804] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:49.472149 27329 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:49.472316 27225 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:49.473855 27012 raft_consensus.cc:3055] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:49.482977 26419 raft_consensus.cc:2468] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:49.483652 25532 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.484212 26964 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:49.486420 25458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.562103 25458 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:49.487006 27273 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:49.487746 27251 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:49.496577 27190 consensus_queue.cc:237] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:49.493968 27410 log.cc:927] Time spent T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:28:49.412030 27281 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:49.495937 27375 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.579226 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.437820 27269 raft_consensus.cc:2749] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.502414 25609 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.502544 26976 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.536475 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.587826 25634 raft_consensus.cc:2393] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 6: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:49.578768 27281 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:49.595175 27332 leader_election.cc:290] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:49.575017 27374 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:49.597890 27374 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.571405 27053 raft_consensus.cc:697] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:49.598361 27374 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:49.599294 27053 consensus_queue.cc:237] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:49.605618 27386 consensus_meta.cc:287] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.010s
I20260709 12:28:49.606216 27386 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:49.608743 27386 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:49.469110 27233 raft_consensus.cc:3055] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:49.506068 27187 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:49.548842 25567 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
W20260709 12:28:49.555965 25608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.557261 27329 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.557716 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:49.452513 27395 raft_consensus.cc:515] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:49.559840 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 76266.2us
I20260709 12:28:49.558022 27225 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.558583 27012 raft_consensus.cc:740] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:49.551607 27373 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:49.569695 27164 raft_consensus.cc:2804] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:49.554685 26402 raft_consensus.cc:3060] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:49.569482 26964 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.557860 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:49.533078 27413 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.579137 25606 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:49.694432 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 115424us
I20260709 12:28:49.582754 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:49.697800 25563 raft_consensus.cc:2393] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 9: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:49.583706 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:49.699190 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:49.699869 25560 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:49.586350 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:49.584931 25564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:49.575508 27251 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.558665 27384 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.612614 25566 raft_consensus.cc:1240] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
W20260709 12:28:49.614794 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 112455us
I20260709 12:28:49.452109 25459 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:49.628607 25635 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:49.675048 27379 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:49.632014 27416 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:49.618439 27264 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:49.685473 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 494702us
I20260709 12:28:49.629745 27233 raft_consensus.cc:740] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:49.563769 27344 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:49.727247 26182 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.702346 25608 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.696951 25606 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:49.711560 25609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:49.714790 25562 raft_consensus.cc:1275] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:49.715924 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:49.717286 25460 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:49.732697 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd7967167e543ae8d82c4880099f27e" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:49.733064 26182 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.733369 25563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:49.704025 27164 raft_consensus.cc:697] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
W20260709 12:28:49.727698 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 275698us
I20260709 12:28:49.710721 25561 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:49.734503 26182 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.735689 25567 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:28:49.711128 27332 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.686197 27373 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:49.726157 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 164136us
I20260709 12:28:49.746556 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.753844 27416 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
W20260709 12:28:49.769732 26983 consensus_meta.cc:287] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 12:28:49.732722 27253 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:49.787153 27416 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.764508 27409 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:49.788029 26983 raft_consensus.cc:2749] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.737376 27266 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:49.789808 25569 raft_consensus.cc:1240] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:49.789697 27266 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.792018 27266 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.729271 27264 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.794934 27118 consensus_queue.cc:1059] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:49.795524 27264 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.771986 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.796765 25639 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:49.795905 27118 raft_consensus.cc:3055] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:49.732676 27162 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.737097 27354 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:49.762645 27340 raft_consensus.cc:2804] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:49.759841 27251 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.875770 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:49.873787 27233 consensus_queue.cc:260] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:49.877110 27233 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:49.879817 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:49.880035 26937 consensus_queue.cc:1175] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bf67e247c9e5443ea0099083f496b361" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 4 } }
I20260709 12:28:49.875209 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:49.881403 26408 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:28:49.788384 27409 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.882906 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:49.752534 25560 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:49.874614 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.882244 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.900266 25493 raft_consensus.cc:2393] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 5: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:49.780172 27392 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.927117 26402 raft_consensus.cc:2468] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:49.927636 27281 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:49.928297 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f88068fafe9c4345a4abefceb627e5c2" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:49.779917 27225 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.772217 27273 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:49.774142 27384 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.799306 27339 raft_consensus.cc:2749] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:49.921774 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.799505 27118 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:49.804163 26732 consensus_queue.cc:1048] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 12:28:49.770509 27395 leader_election.cc:290] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:49.779369 27344 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:28:49.906919 27347 consensus_meta.cc:287] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.004s
I20260709 12:28:49.802430 27337 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:28:49.939230 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 181234us
I20260709 12:28:49.912101 27340 raft_consensus.cc:697] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:49.952082 26182 leader_election.cc:304] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:49.762408 27164 consensus_queue.cc:237] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:49.785398 27012 consensus_queue.cc:260] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:49.958266 25642 raft_consensus.cc:1240] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:28:49.958550 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.959924 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.961064 25636 raft_consensus.cc:1240] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:49.962546 26182 leader_election.cc:304] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:49.963464 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 266592us
I20260709 12:28:49.971195 26401 raft_consensus.cc:2468] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 9.
I20260709 12:28:49.972617 25637 raft_consensus.cc:2468] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:49.958280 27074 raft_consensus.cc:2749] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:49.980028 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.977365 25606 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:49.982692 27420 log.cc:927] Time spent T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 12:28:49.983187 27118 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:49.984244 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 65496.2us
I20260709 12:28:49.986119 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e182cd9691849a9b13a7c77dde34629" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:49.990801 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:49.974287 27162 raft_consensus.cc:2749] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:49.994367 25637 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:49.979619 27416 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:49.984978 27012 raft_consensus.cc:3060] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:49.975301 27347 consensus_queue.cc:1059] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:28:50.003140 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:49.992453 27053 raft_consensus.cc:2749] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.006429 25492 raft_consensus.cc:1275] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:28:50.007021 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:50.009145 25460 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:50.010309 27269 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:50.010700 27269 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.011107 27269 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:50.013655 27329 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:50.017670 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
W20260709 12:28:50.019899 25535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.017670 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:50.020681 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:50.022284 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:50.018982 27340 consensus_queue.cc:237] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:50.027917 27376 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.028532 27376 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.006517 27281 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:49.985105 27374 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.014549 27118 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:50.031174 27394 consensus_queue.cc:1048] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:50.015808 27253 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:50.036619 25535 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.039976 25637 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:50.040985 26964 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:50.045024 25491 raft_consensus.cc:2368] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 6. Current term is 7.
I20260709 12:28:50.052212 27376 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:50.054796 26983 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:50.055423 26983 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:50.059396 25532 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:50.059798 26180 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:50.061470 27409 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:50.063117 27347 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:50.063956 27394 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:50.064364 27394 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.064689 27394 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:50.065985 25488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60406 (request call id 271) took 1172 ms. Trace:
I20260709 12:28:50.079265 25488 rpcz_store.cc:276] 0709 12:28:48.893775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:48.930972 (+ 37197us) service_pool.cc:224] Handling call
0709 12:28:50.065786 (+1134814us) spinlock_profiling.cc:243] Waited 93.3 ms on lock 0x7b5400150754. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:50.065921 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214581504}
I20260709 12:28:50.069132 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:50.081013 25489 raft_consensus.cc:2393] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 6: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:50.071703 26983 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:50.073882 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:50.082265 26180 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.086627 26180 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:50.088795 26180 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:50.100986 26180 leader_election.cc:304] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:50.088191 27012 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:50.103741 27426 raft_consensus.cc:2749] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:50.102908 27329 consensus_queue.cc:1059] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:28:50.107967 27329 raft_consensus.cc:3055] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:50.108355 27329 raft_consensus.cc:740] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:50.109238 27329 consensus_queue.cc:260] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.110596 27329 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:50.100611 27175 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:50.116042 25535 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.093806 27250 raft_consensus.cc:2749] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:50.116756 27373 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:50.125665 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 131260us
I20260709 12:28:50.125811 27415 consensus_queue.cc:1059] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:50.127004 25609 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.127218 27282 raft_consensus.cc:3055] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:50.127597 27282 raft_consensus.cc:740] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:50.127662 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 122698us
I20260709 12:28:50.128425 27282 consensus_queue.cc:260] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.129892 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:50.131054 25459 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:50.131413 25643 raft_consensus.cc:1240] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:50.093950 27339 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:50.133863 27283 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:50.138188 26419 raft_consensus.cc:1275] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:50.134785 25609 leader_election.cc:304] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.139542 25636 raft_consensus.cc:1275] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:28:50.143635 25532 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:50.112573 27394 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.152956 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:50.135444 27339 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:50.158931 27055 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:50.168653 25636 raft_consensus.cc:1240] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:50.169751 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:50.169972 25533 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.170356 25640 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:50.170207 25634 raft_consensus.cc:1275] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:50.161115 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.163697 27074 raft_consensus.cc:3055] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:50.142335 27413 raft_consensus.cc:2804] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:50.160988 26182 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:50.168073 25495 raft_consensus.cc:1240] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:50.142659 27433 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:50.159051 27233 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:28:50.168735 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:50.180388 25495 raft_consensus.cc:1275] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:50.159996 27394 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:50.181823 25487 raft_consensus.cc:2393] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 7: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:50.175700 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:50.187777 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.172801 26929 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.188577 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.176218 25486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cc486747ff742b4a5b17a179125bbfd" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:50.189471 26409 raft_consensus.cc:2393] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 9: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:50.181782 27250 consensus_queue.cc:1059] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:28:50.182224 27261 consensus_queue.cc:1048] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:28:50.191515 27374 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:50.144351 27273 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:28:50.193960 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.154750 27379 raft_consensus.cc:2804] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:50.194944 27379 raft_consensus.cc:697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 9 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:50.195829 27379 consensus_queue.cc:237] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.186269 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.197719 26408 raft_consensus.cc:2393] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 6: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:50.187876 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.183794 27337 consensus_queue.cc:1059] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:28:50.172721 27055 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:50.202378 27347 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.203130 26404 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:50.155444 27384 raft_consensus.cc:2749] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:50.207726 25492 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:50.172061 27339 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:50.206350 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 45429.9us
I20260709 12:28:50.207818 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.171065 25533 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.211273 25562 raft_consensus.cc:1275] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:50.211701 25568 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:50.147333 27282 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:50.220988 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 49990.4us
I20260709 12:28:50.176318 27074 raft_consensus.cc:740] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:50.222215 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.224224 25533 leader_election.cc:304] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.196650 27269 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:50.225596 26182 leader_election.cc:400] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 6. Current term is 7.
I20260709 12:28:50.226019 26182 leader_election.cc:403] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:50.184192 27413 raft_consensus.cc:697] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:50.227275 25533 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.227731 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.225284 27386 raft_consensus.cc:2804] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:50.228611 27154 raft_consensus.cc:2749] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.235296 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.219858 26732 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:50.235589 27233 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:50.237775 27233 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:50.238131 27233 raft_consensus.cc:3060] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:50.238394 27261 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:28:50.243214 26406 raft_consensus.cc:1275] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:50.240424 27386 raft_consensus.cc:697] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:50.246735 27162 raft_consensus.cc:3055] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:50.246462 27386 consensus_queue.cc:237] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:50.247139 27162 raft_consensus.cc:740] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:50.247927 27162 consensus_queue.cc:260] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.249377 27074 consensus_queue.cc:260] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:50.240398 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:50.239233 27391 consensus_queue.cc:1048] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:28:50.270565 26182 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:50.241133 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.266031 26732 raft_consensus.cc:697] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:50.282369 27269 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:50.291183 27055 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:50.275731 27337 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:50.277779 26409 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 2.
I20260709 12:28:50.292904 26732 consensus_queue.cc:237] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.280727 27413 consensus_queue.cc:237] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.297735 27074 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:50.309876 27250 raft_consensus.cc:3055] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:50.313659 27261 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799) with higher term. Message: Invalid argument: T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e for earlier term 6. Current term is 7.
I20260709 12:28:50.300825 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:50.314355 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 134209us
I20260709 12:28:50.319597 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.321655 27053 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:50.322314 27225 consensus_queue.cc:1059] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:50.325413 25637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:50.353269 25637 raft_consensus.cc:3060] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:50.342094 27250 raft_consensus.cc:740] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:50.356917 27250 consensus_queue.cc:260] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.357441 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.358330 27250 raft_consensus.cc:3060] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:50.360786 25565 raft_consensus.cc:1275] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:50.361382 27233 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:50.361979 27416 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:50.362634 26404 raft_consensus.cc:2468] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:28:50.363541 27233 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:50.365542 26406 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:50.329420 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed5b1adb31b64ffdb249abd286df3062" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.366211 27419 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:50.366959 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.368027 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.368537 26419 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:50.369287 25458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.365047 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:50.372655 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb631167f2654873a2976c1c5e2617de" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.373736 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c373e378ec64a5aaac62d18c96517ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.374657 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.328963 26415 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:50.342870 25569 raft_consensus.cc:1240] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:50.327766 27344 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.351199 25609 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.375662 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:50.364744 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d12b36c015f4c51b7d0ef14feabe0b9" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.375856 25532 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:50.381281 25637 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 7.
I20260709 12:28:50.384909 27344 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.385277 25459 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:50.386986 25636 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:28:50.387509 27344 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:50.388182 27339 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.390594 27339 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:50.392050 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8dca7915604597b895b2257bc049ce" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.394861 27118 raft_consensus.cc:2804] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:50.395455 27118 raft_consensus.cc:697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:50.396041 26401 raft_consensus.cc:1240] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Rejecting Update request from peer 05cabf76554146489f61260dbdadf659 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:50.396607 27374 consensus_queue.cc:1048] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:50.398316 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:50.399657 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:50.400308 25568 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 8.
I20260709 12:28:50.407269 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:50.408653 27264 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:50.358011 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:50.409051 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 57911.3us
I20260709 12:28:50.340704 27337 raft_consensus.cc:697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:50.396328 27118 consensus_queue.cc:237] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.415206 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:50.418130 25640 raft_consensus.cc:1275] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:50.422591 25489 raft_consensus.cc:2393] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 6: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:50.353930 25566 raft_consensus.cc:3060] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:50.420578 26181 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.435760 25606 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.437058 25314 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57464 (request call id 164) took 5715 ms. Trace:
I20260709 12:28:50.441555 25606 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.450141 25458 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.452448 25458 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.456526 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:50.437700 25314 rpcz_store.cc:276] 0709 12:28:44.721684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:44.722026 (+   342us) service_pool.cc:224] Handling call
0709 12:28:50.436513 (+5714487us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:49.761470 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:49.762102 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:49.762144 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:28:49.762165 (+    21us) tablet.cc:662] Decoding operations
0709 12:28:49.763510 (+  1345us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:49.763609 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:49.763646 (+    37us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:28:49.777381 (+ 13735us) tablet.cc:701] Row locks acquired
0709 12:28:49.778556 (+  1175us) write_op.cc:260] PREPARE: finished
0709 12:28:49.782744 (+  4188us) write_op.cc:270] Start()
0709 12:28:49.785575 (+  2831us) write_op.cc:276] Timestamp: P: 1783600129781506 usec, L: 0
0709 12:28:49.798661 (+ 13086us) op_driver.cc:348] REPLICATION: starting
0709 12:28:49.962267 (+163606us) log.cc:844] Serialized 4773 byte log entry
0709 12:28:50.204163 (+241896us) op_driver.cc:464] REPLICATION: finished
0709 12:28:50.295142 (+ 90979us) write_op.cc:301] APPLY: starting
0709 12:28:50.295233 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:50.295489 (+   256us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:50.295627 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:50.300942 (+  5315us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:50.301226 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:28:50.301284 (+    58us) write_op.cc:312] APPLY: finished
0709 12:28:50.301607 (+   323us) log.cc:844] Serialized 88 byte log entry
0709 12:28:50.304075 (+  2468us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:50.304239 (+   164us) write_op.cc:454] Released schema lock
0709 12:28:50.304297 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:50.304677 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:50.304705 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":381408,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":90723,"apply.run_cpu_time_us":3439,"apply.run_wall_time_us":9523,"num_ops":12,"prepare.queue_time_us":402680,"prepare.run_cpu_time_us":25736,"prepare.run_wall_time_us":323042,"raft.queue_time_us":88442,"raft.run_cpu_time_us":19366,"raft.run_wall_time_us":71549,"replication_time_us":405336,"thread_start_us":493258,"threads_started":4,"wal-append.queue_time_us":139841}]]}
I20260709 12:28:50.409063 27264 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:50.465852 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.468132 25606 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.468804 25458 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.473717 25458 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.470801 26418 raft_consensus.cc:2468] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 7.
I20260709 12:28:50.474565 27175 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:50.475714 25458 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.476440 27175 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:50.429997 27374 consensus_queue.cc:1048] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:28:50.419520 26983 raft_consensus.cc:2804] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:50.419756 27202 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:50.478938 25606 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.482043 25639 raft_consensus.cc:2468] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:50.483507 25533 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.482583 25606 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.465274 27437 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:50.472026 27269 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:50.470144 27409 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:50.469689 27344 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:50.477910 27264 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:50.493063 26181 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:50.488404 25606 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.480368 25458 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.469987 27416 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:50.478062 27190 raft_consensus.cc:2749] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:50.479584 27225 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:28:50.475780 26419 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 7.
I20260709 12:28:50.471810 27426 consensus_queue.cc:1059] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:28:50.506856 25606 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.502260 27386 raft_consensus.cc:2804] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:50.487478 27431 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.546489 27053 raft_consensus.cc:2804] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:50.549212 27053 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:50.549453 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.550623 25560 raft_consensus.cc:1275] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:50.549690 27053 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:50.487498 27433 raft_consensus.cc:2749] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.553944 27409 consensus_queue.cc:1048] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:50.556423 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:50.558048 25606 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.492551 26983 raft_consensus.cc:697] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:50.559206 26402 raft_consensus.cc:1275] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:28:50.559378 25458 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:50.559443 27433 raft_consensus.cc:2749] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:50.507228 27337 consensus_queue.cc:237] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:50.559656 26402 pending_rounds.cc:85] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Aborting all ops after (but not including) 4
I20260709 12:28:50.561303 26402 pending_rounds.cc:107] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:28:50.561656 26402 raft_consensus.cc:2889] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:50.508188 27340 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.510476 27266 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:50.504377 27329 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:28:50.575235 27175 raft_consensus.cc:2804] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:50.514947 27354 consensus_queue.cc:1048] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:28:50.581138 27386 raft_consensus.cc:697] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:50.576577 27225 consensus_queue.cc:1048] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:28:50.624276 25565 raft_consensus.cc:1275] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:28:50.625059 27454 log.cc:927] Time spent T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:28:50.628468 25606 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.629276 26420 raft_consensus.cc:1240] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:50.633200 27416 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:50.633766 27416 raft_consensus.cc:697] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:50.634604 27416 consensus_queue.cc:237] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:50.635267 27456 log.cc:927] Time spent T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:28:50.642724 27273 raft_consensus.cc:3055] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:50.559823 26983 consensus_queue.cc:237] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.609990 27175 raft_consensus.cc:697] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 7 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
W20260709 12:28:50.647769 26180 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:50.654564 25640 raft_consensus.cc:1275] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:50.655949 25566 raft_consensus.cc:2468] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 7.
I20260709 12:28:50.648643 27053 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:50.659801 27453 log.cc:927] Time spent T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:50.657481 27273 raft_consensus.cc:740] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:50.661196 27225 consensus_queue.cc:1059] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:28:50.691624 25494 raft_consensus.cc:1240] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:50.674252 27250 consensus_queue.cc:1048] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 12:28:50.695971 27466 log.cc:927] Time spent T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:28:50.695776 27175 consensus_queue.cc:237] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:50.681318 27394 consensus_queue.cc:1059] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:28:50.696897 26409 raft_consensus.cc:2468] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 3.
I20260709 12:28:50.697762 27283 raft_consensus.cc:3055] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:50.698114 27283 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:50.698904 27283 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.700310 27283 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:50.690055 25565 raft_consensus.cc:1240] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:50.720105 27162 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:50.722657 25606 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.727890 27264 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.730841 27264 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:50.688239 27386 consensus_queue.cc:237] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:50.711760 27261 consensus_queue.cc:1048] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:28:50.738196 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.740162 25634 raft_consensus.cc:1240] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:50.739678 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:50.727159 27431 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:50.751380 27251 consensus_queue.cc:1059] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:28:50.769205 27463 log.cc:927] Time spent T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:28:50.769840 27251 raft_consensus.cc:3055] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:50.770430 27251 raft_consensus.cc:740] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:50.771442 27251 consensus_queue.cc:260] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:50.772809 27251 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:50.774888 27055 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:50.777606 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:50.765292 27053 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:50.787016 26415 raft_consensus.cc:1275] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:50.763649 26732 consensus_queue.cc:1059] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:28:50.778587 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
W20260709 12:28:50.792841 27469 log.cc:927] Time spent T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:28:50.794247 27394 consensus_queue.cc:1048] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:28:50.808418 26415 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:50.810425 25492 raft_consensus.cc:3060] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:50.815500 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
W20260709 12:28:50.859092 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:50.863981 27473 log.cc:927] Time spent T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:28:50.901484 25535 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:50.904433 25492 raft_consensus.cc:1275] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:50.913125 25318 catalog_manager.cc:5697] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:50.921782 25318 catalog_manager.cc:5697] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 3, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
W20260709 12:28:50.925594 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 107621us
I20260709 12:28:50.925161 25318 catalog_manager.cc:5697] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.928675 25318 catalog_manager.cc:5697] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.932570 27419 raft_consensus.cc:3055] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:50.932991 27419 raft_consensus.cc:740] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:50.933858 27419 consensus_queue.cc:260] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:50.919567 27259 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:50.934940 27164 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:28:50.935099 27259 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:28:50.946252 27462 log.cc:927] Time spent T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 12:28:50.947376 25634 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:50.950136 25637 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:28:50.957254 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 46727.9us
I20260709 12:28:50.961889 27386 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:50.964740 25606 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:50.967163 27386 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:50.968119 27273 consensus_queue.cc:260] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:50.969705 27273 raft_consensus.cc:3060] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:28:50.969666 27266 consensus_queue.cc:1175] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3e2fd10beaf04318be94c0a3430cef3e" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:28:50.968180 27225 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:50.974406 27259 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:28:50.979434 27475 log.cc:927] Time spent T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:28:50.980908 27210 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:50.987824 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:50.988533 25568 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:50.990312 26415 raft_consensus.cc:1275] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:50.995682 25460 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:50.996593 27374 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:50.996973 27374 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:50.997344 27374 raft_consensus.cc:3060] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:51.006462 25318 catalog_manager.cc:5697] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
W20260709 12:28:51.007877 25458 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.010354 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:51.015275 25636 raft_consensus.cc:2393] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 6: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:51.016789 25640 raft_consensus.cc:1240] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:28:51.008891 25318 catalog_manager.cc:5697] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.913570 27431 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:51.043848 25635 raft_consensus.cc:1275] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:51.034344 25318 catalog_manager.cc:5697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
W20260709 12:28:51.048826 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.027248 27259 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.046810 25318 catalog_manager.cc:5697] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
I20260709 12:28:51.033936 27281 consensus_queue.cc:1048] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:28:51.057713 25486 raft_consensus.cc:1275] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:28:51.026612 27393 consensus_queue.cc:1048] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:28:51.056278 27259 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:51.058755 25640 raft_consensus.cc:1275] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:28:51.060446 27259 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:51.041859 27339 consensus_queue.cc:1059] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:28:51.062800 27339 raft_consensus.cc:3055] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:51.063139 27339 raft_consensus.cc:740] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:51.071622 25486 raft_consensus.cc:1275] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:51.077306 26418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:51.054973 25318 catalog_manager.cc:5697] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 5, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 5 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:51.076618 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:51.081791 25318 catalog_manager.cc:5697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 2, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
I20260709 12:28:51.087343 25638 raft_consensus.cc:1275] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:51.088622 25318 catalog_manager.cc:5697] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 3, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
I20260709 12:28:51.097261 25318 catalog_manager.cc:5697] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 4, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:51.157856 25608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.178331 25318 catalog_manager.cc:5697] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 5, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 5 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:51.180836 25318 catalog_manager.cc:5697] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:51.188968 25318 catalog_manager.cc:5697] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
W20260709 12:28:51.191285 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 110600us
I20260709 12:28:51.084903 27419 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:51.191126 25318 catalog_manager.cc:5697] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:51.199321 26937 consensus_queue.cc:1048] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:28:51.090248 27251 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.082265 27337 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 12:28:51.082495 27376 consensus_queue.cc:1048] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.112s
W20260709 12:28:51.199843 27483 log.cc:927] Time spent T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:28:51.238749 26419 raft_consensus.cc:1275] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:28:51.251583 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 150429us
I20260709 12:28:51.253067 25459 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:51.235307 27251 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:51.238456 27162 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:28:51.258069 27266 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:51.261456 27259 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:51.266175 27187 consensus_queue.cc:1048] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:28:51.278679 25490 raft_consensus.cc:1275] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:51.290400 25492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:51.298659 25492 raft_consensus.cc:606] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:51.279932 27374 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:51.281901 27266 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:51.304174 27251 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:51.304848 27266 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:51.305105 27481 log.cc:927] Time spent T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:28:51.307459 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:51.309513 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:51.309392 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:51.309244 27339 consensus_queue.cc:260] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:51.310307 26406 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:51.310889 27374 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:51.313107 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:51.311012 27339 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:51.329643 25639 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:28:51.337987 26179 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:51.338542 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 51984.3us
I20260709 12:28:51.338755 27283 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:28:51.350630 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:51.351714 25490 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:51.337487 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:51.356293 26406 raft_consensus.cc:2393] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 6: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:51.363982 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:51.364797 25641 raft_consensus.cc:2393] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 6: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:51.368803 25494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60406 (request call id 282) took 1202 ms. Trace:
I20260709 12:28:51.370575 26420 raft_consensus.cc:1275] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:28:51.379427 25494 rpcz_store.cc:276] 0709 12:28:50.166737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.167154 (+   417us) service_pool.cc:224] Handling call
0709 12:28:50.167415 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:50.692039 (+524624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:51.368597 (+676558us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b540029efd4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239e9e01 00007f1e239e883e 00007f1e289ad419 00007f1e21f24bd4 00007f1e21f24b62 00007f1e21f24a91 00007f1e21f24a0c 00007f1e21f23cc2 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:51.368749 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204989824}
I20260709 12:28:51.387065 27164 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.415982 25562 raft_consensus.cc:1240] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:28:51.419728 26409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53792 (request call id 697) took 1122 ms. Trace:
I20260709 12:28:51.420251 26409 rpcz_store.cc:276] 0709 12:28:50.297627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.343848 (+ 46221us) service_pool.cc:224] Handling call
0709 12:28:51.419530 (+1075682us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400007154. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23952571 00007f1e239ed2fa 00007f1e289aeb17 00007f1e21f296d4 00007f1e21f29662 00007f1e21f29591 00007f1e21f2950c 00007f1e21f287c2 00007f1e21d2448c 00007f1e21d238c6 00007f1e21d2326f
0709 12:28:51.419642 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445331328}
I20260709 12:28:51.420660 27118 raft_consensus.cc:493] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.421403 27118 raft_consensus.cc:515] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:51.422783 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:51.424285 27118 leader_election.cc:290] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:51.435925 25488 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:51.438069 25489 raft_consensus.cc:2468] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 3.
I20260709 12:28:51.403025 26406 raft_consensus.cc:1275] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:51.433074 26404 raft_consensus.cc:1275] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:51.442622 27118 raft_consensus.cc:493] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.405117 27164 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:51.451387 27164 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:51.455616 27118 raft_consensus.cc:515] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:51.458604 27118 leader_election.cc:290] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:51.472128 27488 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.483902 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:51.561851 27261 raft_consensus.cc:493] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:51.562800 27261 raft_consensus.cc:515] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:51.566255 27261 leader_election.cc:290] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:51.566701 26406 raft_consensus.cc:1275] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:51.493829 27488 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:51.617103 25489 raft_consensus.cc:1275] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:51.617774 27488 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:51.580874 27454 log.cc:927] Time spent T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:28:51.664369 25562 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:51.675604 27506 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:51.685640 27506 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:51.688923 27339 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.689613 27506 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:51.689534 27339 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:51.691671 27339 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:51.692732 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:51.692659 26404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
W20260709 12:28:51.696518 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 70534.2us
I20260709 12:28:51.698303 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:51.679397 26732 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:28:51.682175 27154 consensus_queue.cc:1048] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:28:51.701283 25491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:51.701907 25491 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 6.
I20260709 12:28:51.699361 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:51.717689 25535 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:51.720882 27468 consensus_queue.cc:1048] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:28:51.727581 27393 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.728096 27393 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:51.729455 27395 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:51.723238 25458 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:51.730023 27395 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:51.737360 27118 raft_consensus.cc:993] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:51.737843 27118 raft_consensus.cc:1081] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:51.738895 27395 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:51.730553 27393 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:51.740414 27259 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:51.740844 27259 raft_consensus.cc:493] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:51.741205 27259 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:51.745643 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:51.746539 25568 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:51.747884 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
W20260709 12:28:51.748769 27498 log.cc:927] Time spent T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:28:51.749815 27259 raft_consensus.cc:515] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:51.753415 27175 consensus_queue.cc:1048] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:28:51.754372 27496 log.cc:927] Time spent T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.196s	user 0.001s	sys 0.001s
I20260709 12:28:51.755646 27486 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:51.758615 27187 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:51.760473 27187 consensus_queue.cc:1048] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:51.763592 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:51.763804 25608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:51.765043 25609 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:51.766685 25609 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:51.766870 27273 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:51.767508 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a46b4dd44940dc911e876c097f12fe" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:51.767408 27273 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:51.768126 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:51.768467 27415 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.768963 27415 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:51.735209 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b434fa71554dca9e4ef0b94f3967fb" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:51.771399 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:51.773465 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:51.774675 26404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:51.789677 26404 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:51.779707 25560 raft_consensus.cc:2468] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:51.790163 26404 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:51.791414 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:51.787355 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d956db2a3482f97d01e0e1e82ebdd" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:51.795055 25566 raft_consensus.cc:1275] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:51.795589 25494 raft_consensus.cc:2393] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 7: Already voted for candidate bf67e247c9e5443ea0099083f496b361 in this term.
I20260709 12:28:51.752242 27259 leader_election.cc:290] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:51.801397 25459 leader_election.cc:304] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
W20260709 12:28:51.821229 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 118456us
I20260709 12:28:51.807526 26404 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:51.823868 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:51.824455 25562 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:28:51.838423 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 43726.5us
I20260709 12:28:51.842499 26404 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:51.844851 25460 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:51.851429 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b0ab9ea8a441e5af5bf911f5c0a649" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:51.803596 27225 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.822949 27344 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:51.860401 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:51.870105 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:51.870867 26409 raft_consensus.cc:3060] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:51.829216 27415 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:51.839251 27431 raft_consensus.cc:2804] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:51.879703 25460 leader_election.cc:304] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:51.884853 25635 raft_consensus.cc:1275] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:28:51.886543 25635 pending_rounds.cc:85] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 2
I20260709 12:28:51.886806 25635 pending_rounds.cc:107] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:28:51.887040 25635 raft_consensus.cc:2889] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:51.847507 27374 raft_consensus.cc:2749] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:51.819833 27264 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:28:51.856483 27074 raft_consensus.cc:493] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:51.862270 27344 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:51.898628 27340 raft_consensus.cc:2804] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:51.941025 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:51.940918 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:51.961879 25487 raft_consensus.cc:3055] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:28:51.962268 25487 raft_consensus.cc:740] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:51.899788 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1212a262e8424670b13c83406b35dae8" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:51.899061 27339 raft_consensus.cc:493] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:28:51.977246 27339 raft_consensus.cc:515] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:51.961418 27344 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:51.928521 27118 consensus_queue.cc:1048] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:28:51.875366 27225 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:51.985498 27340 raft_consensus.cc:697] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 6 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:51.985587 27489 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:51.986521 27340 consensus_queue.cc:237] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:51.938648 27074 raft_consensus.cc:515] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:51.974558 25533 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:51.975281 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:51.994009 25560 raft_consensus.cc:2410] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:28:51.976883 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 101114us
I20260709 12:28:52.000408 25532 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:51.937928 27431 raft_consensus.cc:697] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:52.004585 26976 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:51.991994 27484 log.cc:927] Time spent T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:28:52.040042 25533 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:51.998514 27225 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.039157 27283 raft_consensus.cc:2749] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:52.059417 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:52.060180 25560 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:52.038820 27251 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.037695 27413 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
W20260709 12:28:52.065198 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 63008.1us
I20260709 12:28:52.044323 27501 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:52.045492 27485 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.114171 25493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.115136 25493 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:52.045615 26976 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:52.071493 26937 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:52.145622 25562 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 7.
W20260709 12:28:52.153083 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 100671us
I20260709 12:28:52.109114 27273 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.068770 27251 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.120829 26402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.158298 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3271013e0434415b390de1bd1aab244" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.161657 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.162288 25641 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:52.163221 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a03988797840b79a9c026cc8b293a7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:52.163733 25641 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:52.164467 25636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.164489 26408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.167538 26408 raft_consensus.cc:2393] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
W20260709 12:28:52.168057 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 100659us
I20260709 12:28:52.169333 25532 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:52.169659 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 100337us
I20260709 12:28:52.080951 27413 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.147001 27354 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:28:52.214759 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 49887.3us
I20260709 12:28:52.220516 26408 raft_consensus.cc:1275] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:28:52.220816 27511 log.cc:927] Time spent T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:28:51.986145 27489 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:52.109833 27431 consensus_queue.cc:237] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:52.220582 27516 log.cc:927] Time spent T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:28:52.225513 27337 raft_consensus.cc:493] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:52.226184 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.226075 27337 raft_consensus.cc:515] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.229964 25460 leader_election.cc:304] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:52.172803 27491 raft_consensus.cc:2749] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:52.232844 27512 log.cc:927] Time spent T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:28:52.210114 27386 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:28:52.234690 25608 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
W20260709 12:28:52.230055 25533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 59885.7us
I20260709 12:28:52.179692 26402 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:52.216787 27344 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.269989 27202 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:52.270442 27202 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:52.270805 27202 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:28:52.293711 25608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 59100.5us
W20260709 12:28:52.301327 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 47968.2us
I20260709 12:28:52.215577 27501 raft_consensus.cc:2749] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:52.295053 25487 consensus_queue.cc:260] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.307559 25487 raft_consensus.cc:3060] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:52.156499 27485 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:52.314627 27519 log.cc:927] Time spent T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:28:52.314857 26976 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:52.319877 27074 leader_election.cc:290] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:52.320695 27527 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.321676 27337 leader_election.cc:290] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.321389 27527 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.323568 27251 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.302412 26180 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:52.334421 26180 leader_election.cc:304] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.311522 27505 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:52.339097 25641 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:52.337631 27261 raft_consensus.cc:2804] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:28:52.343582 27261 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.343952 27261 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:52.342768 27393 consensus_queue.cc:1048] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:28:52.331400 27344 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.347721 27413 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.348433 27202 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:52.355223 25487 raft_consensus.cc:2468] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:52.343091 27505 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:52.357415 26409 raft_consensus.cc:2468] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 7.
I20260709 12:28:52.359087 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:52.359241 27489 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:52.341100 27526 raft_consensus.cc:2749] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:52.357199 27202 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.375456 27162 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.385490 26415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53792 (request call id 711) took 1305 ms. Trace:
I20260709 12:28:52.390606 26415 rpcz_store.cc:276] 0709 12:28:51.079723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.079925 (+   202us) service_pool.cc:224] Handling call
0709 12:28:51.084032 (+  4107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:51.085579 (+  1547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:51.085605 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:51.102559 (+ 16954us) log.cc:844] Serialized 26 byte log entry
0709 12:28:51.828067 (+725508us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b18002fb420. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208dee07 00007f1e297399a9 00007f1e208fb69b 00007f1e208f993f 00007f1e208fbc02 00007f1e2358320b 00007f1e23588d23 00007f1e235890d1 00007f1e239a4a0f
0709 12:28:52.064787 (+236720us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:28:52.096640 (+ 31853us) log.cc:844] Serialized 14 byte log entry
0709 12:28:52.153716 (+ 57076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:52.153793 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:52.374624 (+220831us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b18002fb420. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208fc3f3 00007f1e208fe7c1 00007f1e208fe779 00007f1e208fe709 00007f1e208fe6d1 00007f1e208fd9cd 0000000000388634 0000000000388479 00007f1e208df83a
0709 12:28:52.385287 (+ 10663us) raft_consensus.cc:1685] finished
0709 12:28:52.385307 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:52.385430 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1224,"prepare.queue_time_us":87992,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":81,"raft.queue_time_us":7976,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":98591,"spinlock_wait_cycles":90586240,"thread_start_us":236563,"threads_started":1,"wal-append.queue_time_us":1026392}
I20260709 12:28:52.395942 25569 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:52.397231 25608 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:52.391782 27162 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.399611 27431 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:52.400107 27431 raft_consensus.cc:697] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:52.400760 27162 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.401026 27431 consensus_queue.cc:237] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:52.405145 27527 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.408052 27505 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:52.408509 27524 log.cc:927] Time spent T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:28:52.410801 27261 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.413482 27527 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:52.413954 27261 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.414039 27527 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:52.419152 27527 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:52.421126 27339 leader_election.cc:290] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:52.428047 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 198166us
I20260709 12:28:52.428205 27118 raft_consensus.cc:2804] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:52.428972 27118 raft_consensus.cc:697] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 7 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:52.430161 27118 consensus_queue.cc:237] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:52.438599 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.439523 25635 raft_consensus.cc:2393] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 3: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:52.443635 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.444023 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224263ffd6b64b1c8cba6c27db4d5c4f" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.444793 25489 raft_consensus.cc:2393] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e2fd10beaf04318be94c0a3430cef3e in current term 3: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:52.444988 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.445840 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:52.448148 25492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.448791 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:52.449394 25494 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:28:52.463145 27438 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:52.464701 27438 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:52.465124 27438 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:52.472287 25609 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:52.475157 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
W20260709 12:28:52.476256 27522 log.cc:927] Time spent T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.243s	user 0.002s	sys 0.000s
I20260709 12:28:52.477326 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.477919 25609 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:52.478343 27521 log.cc:927] Time spent T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:28:52.479229 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:52.479830 25562 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:52.483534 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:52.484577 27415 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:52.477098 27384 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:52.485980 27384 raft_consensus.cc:493] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.486311 27384 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:52.486464 27485 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.488992 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.489809 26409 raft_consensus.cc:2368] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4.
I20260709 12:28:52.490182 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.491119 26182 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:52.491288 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.491833 26415 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
W20260709 12:28:52.492702 27525 log.cc:927] Time spent T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.261s	user 0.002s	sys 0.000s
I20260709 12:28:52.494784 26419 raft_consensus.cc:1240] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 5. Current term is 6. Ops: []
I20260709 12:28:52.495687 27074 raft_consensus.cc:2804] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:52.495863 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:52.496181 27074 raft_consensus.cc:697] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:52.497081 27074 consensus_queue.cc:237] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.503484 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64358b60fab548429df4d7dc1d83a406" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.505437 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919fd4e8dca6404ea25c7dcee45b6a97" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.508404 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.509039 26420 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 9.
I20260709 12:28:52.512439 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9893e663e5c94468ac06743c6cbcec9d" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
W20260709 12:28:52.516855 27520 log.cc:927] Time spent T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361: Append to log took a long time: real 0.289s	user 0.002s	sys 0.000s
I20260709 12:28:52.519610 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.519908 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.520270 25634 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:52.522329 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c409decd6b41e38642164bc29adcac" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:52.522912 25641 raft_consensus.cc:3060] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:52.525457 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.526161 25634 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 9: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
I20260709 12:28:52.529104 25562 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:52.530544 25487 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:52.539029 25494 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:52.547432 27438 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:52.520182 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0af0dee12bd4a1c9b0b4cdca091a4ea" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.392968 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:52.535068 26182 leader_election.cc:304] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:52.530628 25641 raft_consensus.cc:2468] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:52.555682 25318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57458 (request call id 186) took 5812 ms. Trace:
I20260709 12:28:52.560130 27485 raft_consensus.cc:3060] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:52.561914 25318 rpcz_store.cc:276] 0709 12:28:46.743625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:46.747287 (+  3662us) service_pool.cc:224] Handling call
0709 12:28:52.555611 (+5808324us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:51.339033 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:51.417393 (+ 78360us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:51.417432 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:28:51.417448 (+    16us) tablet.cc:662] Decoding operations
0709 12:28:51.418783 (+  1335us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:51.418863 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:51.418902 (+    39us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:28:51.420094 (+  1192us) tablet.cc:701] Row locks acquired
0709 12:28:51.420114 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:28:51.420482 (+   368us) write_op.cc:270] Start()
0709 12:28:51.420613 (+   131us) write_op.cc:276] Timestamp: P: 1783600131420432 usec, L: 0
0709 12:28:51.420636 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:28:51.454838 (+ 34202us) log.cc:844] Serialized 6313 byte log entry
0709 12:28:51.711456 (+256618us) op_driver.cc:464] REPLICATION: finished
0709 12:28:51.874849 (+163393us) write_op.cc:301] APPLY: starting
0709 12:28:51.874967 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:51.926518 (+ 51551us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:51.979141 (+ 52623us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:51.980968 (+  1827us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:51.981253 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:28:51.981322 (+    69us) write_op.cc:312] APPLY: finished
0709 12:28:51.981807 (+   485us) log.cc:844] Serialized 112 byte log entry
0709 12:28:51.982010 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:51.982230 (+   220us) write_op.cc:454] Released schema lock
0709 12:28:51.982298 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:52.053030 (+ 70732us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:52.055342 (+  2312us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":402964,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":161325,"apply.run_cpu_time_us":4559,"apply.run_wall_time_us":124561,"num_ops":16,"prepare.queue_time_us":45198,"prepare.run_cpu_time_us":7875,"prepare.run_wall_time_us":151909,"raft.queue_time_us":196182,"raft.run_cpu_time_us":46703,"raft.run_wall_time_us":118423,"replication_time_us":280831,"thread_start_us":296129,"threads_started":4,"wal-append.queue_time_us":32518}]]}
I20260709 12:28:52.572983 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.614421 25494 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:52.577026 26182 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:52.611882 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:52.580013 25458 leader_election.cc:400] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4.
I20260709 12:28:52.581681 25532 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.597479 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:52.625036 26415 raft_consensus.cc:2393] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 6: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
I20260709 12:28:52.586243 25609 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:52.625804 26419 raft_consensus.cc:2393] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in current term 4: Already voted for candidate 3e2fd10beaf04318be94c0a3430cef3e in this term.
W20260709 12:28:52.631479 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 49911.9us
I20260709 12:28:52.591054 25315 catalog_manager.cc:5697] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 1 to 2, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:52.586243 26180 leader_election.cc:304] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:52.624307 25458 leader_election.cc:403] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:52.634903 25315 catalog_manager.cc:5697] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 5, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 5 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:52.637562 25315 catalog_manager.cc:5697] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:52.640365 25315 catalog_manager.cc:5697] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 5 to 8, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 8 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:52.648417 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 71469.9us
W20260709 12:28:52.650848 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 64670.1us
I20260709 12:28:52.652511 26180 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:52.654021 26180 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:52.610188 27415 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:52.657029 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 77215.2us
I20260709 12:28:52.588505 27339 raft_consensus.cc:493] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:28:52.660059 25458 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.650075 25315 catalog_manager.cc:5697] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 3 to 6, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 6 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:52.663669 25315 catalog_manager.cc:5697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:52.623612 27438 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.647655 27354 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:52.650012 27386 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:52.655390 27162 raft_consensus.cc:2804] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:52.667184 25315 catalog_manager.cc:5697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:52.683043 26180 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:52.591065 27384 raft_consensus.cc:515] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.609839 27491 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:28:52.676608 27386 raft_consensus.cc:493] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:52.688316 27386 raft_consensus.cc:3060] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:52.691411 27261 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:52.685637 27354 raft_consensus.cc:697] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
W20260709 12:28:52.693460 27542 log.cc:927] Time spent T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:28:52.693213 27354 consensus_queue.cc:237] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.665266 27415 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:52.664924 27347 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:28:52.676719 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 87165.1us
I20260709 12:28:52.700165 27347 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.700574 27347 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:52.700621 25459 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.658362 27486 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:52.661412 27190 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4.
I20260709 12:28:52.669935 27339 raft_consensus.cc:515] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:52.686445 27281 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:52.703104 27281 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:52.703531 27281 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:52.707584 27384 leader_election.cc:290] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.708398 27485 raft_consensus.cc:2749] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:52.698680 27162 raft_consensus.cc:697] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:52.709659 27415 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.709808 27162 consensus_queue.cc:237] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.684031 25315 catalog_manager.cc:5697] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:52.711898 25315 catalog_manager.cc:5697] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 6, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 6 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:52.713507 25315 catalog_manager.cc:5697] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:52.714979 25315 catalog_manager.cc:5697] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 5, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 5 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:52.717384 25494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:52.717969 25494 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:52.720561 27074 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:52.721738 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 105754us
I20260709 12:28:52.730023 26181 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.731207 25494 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:52.732402 25609 leader_election.cc:304] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:52.733094 26181 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:28:52.734571 26181 leader_election.cc:304] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.738030 26732 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:52.738608 26732 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:52.721118 27074 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:52.721611 26976 raft_consensus.cc:2749] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:52.739054 26732 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:52.735647 27486 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:52.741289 27210 raft_consensus.cc:2749] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:52.759768 27074 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:52.744189 27266 raft_consensus.cc:2804] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:52.772516 27347 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:28:52.783005 25458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 97112.4us
W20260709 12:28:52.784183 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 83661.3us
I20260709 12:28:52.785516 27340 raft_consensus.cc:2749] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:52.787832 27190 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:52.788401 27190 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:52.792141 25641 raft_consensus.cc:1275] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:52.793943 27190 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:52.804726 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:52.805810 25566 raft_consensus.cc:2393] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 6: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:52.794970 25487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d18d987a38d42a0bfa897026a77afc3"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "05cabf76554146489f61260dbdadf659"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:52.808048 25487 raft_consensus.cc:606] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Received request to transfer leadership to TS 05cabf76554146489f61260dbdadf659
I20260709 12:28:52.808545 25487 raft_consensus.cc:614] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:52.800935 27118 consensus_queue.cc:1048] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:28:52.824898 25606 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 53999.8us
W20260709 12:28:52.830989 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 148021us
I20260709 12:28:52.832626 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:52.833598 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:52.834236 25488 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:52.770372 27266 raft_consensus.cc:697] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:52.826879 27347 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:52.844372 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:52.767319 27281 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.847997 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c21509d83b4939a1a492dbd10b3acb" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:52.851609 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:52.855118 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:52.855219 26732 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:52.864226 25566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:52.864880 25566 raft_consensus.cc:606] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:52.864298 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.866317 26415 raft_consensus.cc:2410] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:28:52.866225 26419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.871587 27339 leader_election.cc:290] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:52.873075 25487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:52.878823 25566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:52.879511 25566 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:52.881078 26415 raft_consensus.cc:1275] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:52.884716 26415 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:52.886380 26409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e0430567d64e6887cc879e2e9b3d61" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:52.886734 27281 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.887141 26409 raft_consensus.cc:3060] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:52.889424 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:52.889325 27416 consensus_queue.cc:1048] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:52.890964 27416 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:52.891829 25458 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:52.892549 27266 consensus_queue.cc:237] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.894371 27281 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:28:52.895627 26419 raft_consensus.cc:2368] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 6. Current term is 7.
I20260709 12:28:52.896746 25566 raft_consensus.cc:1240] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Rejecting Update request from peer 3e2fd10beaf04318be94c0a3430cef3e for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:52.897545 25535 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:52.900256 26418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3837703213a42109c702302ad5f6c0d"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:52.900909 26418 raft_consensus.cc:606] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.901269 26418 raft_consensus.cc:614] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:52.901983 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "743a94d34f3642f6b4bb966f8e08c795" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:52.904778 25488 raft_consensus.cc:2468] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
I20260709 12:28:52.910018 26182 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:52.911976 27485 raft_consensus.cc:2804] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:52.912458 27485 raft_consensus.cc:697] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:52.915194 27485 consensus_queue.cc:237] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.922168 25489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
mode: GRACEFUL
new_leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:52346
I20260709 12:28:52.922996 25489 raft_consensus.cc:606] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Received request to transfer leadership to TS 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:52.929268 25458 leader_election.cc:400] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 6. Current term is 7.
I20260709 12:28:52.931357 25458 leader_election.cc:403] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:52.939739 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:28:52.939985 27468 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:52.942378 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:52.943456 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:52.900491 27386 raft_consensus.cc:515] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:52.946199 27386 leader_election.cc:290] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.954273 27536 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:52.955067 27536 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:52.959635 25488 raft_consensus.cc:1275] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:52.961961 26409 raft_consensus.cc:2468] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:28:52.965526 25490 raft_consensus.cc:1275] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:52.967000 26732 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:52.969072 27415 consensus_queue.cc:1048] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:52.970258 27536 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:52.972291 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:52.972414 25638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:52.974400 25638 raft_consensus.cc:2393] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 05cabf76554146489f61260dbdadf659 in current term 9: Already voted for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in this term.
W20260709 12:28:52.974807 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 47939.8us
I20260709 12:28:52.976087 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:52.982517 25634 raft_consensus.cc:1275] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:52.984448 27339 consensus_queue.cc:1048] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:52.987102 26401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:52.937979 27118 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:28:53.006625 25567 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:53.011557 26732 consensus_queue.cc:1048] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:53.012132 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60b6b992c02f4199bed5792eda84bf4d" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:53.014001 25460 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf67e247c9e5443ea0099083f496b361; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:53.017074 27536 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:28:53.019223 25561 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:53.019646 26181 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:53.023205 27347 consensus_queue.cc:1059] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:53.024674 27554 raft_consensus.cc:3055] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:53.025133 27554 raft_consensus.cc:740] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:53.026185 27354 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:53.026367 27554 consensus_queue.cc:260] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:53.028712 27554 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:53.029999 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a5d533e66e74b518a0074545fd8e96a" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:53.030988 25560 raft_consensus.cc:2410] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:28:53.025099 26181 leader_election.cc:304] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:53.038269 27347 raft_consensus.cc:2749] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:28:53.039312 27118 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 6. Current term is 7.
I20260709 12:28:53.041370 26418 raft_consensus.cc:1275] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:53.043802 27536 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:53.049453 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd84795939b41f6989d135d7bf7bdd5" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:53.050081 25569 raft_consensus.cc:3060] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:53.049841 25490 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
I20260709 12:28:53.057651 26401 raft_consensus.cc:2468] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 9.
I20260709 12:28:53.080783 25532 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:53.059267 25569 raft_consensus.cc:2468] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
I20260709 12:28:53.066360 25608 leader_election.cc:304] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:53.069766 26182 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:53.093778 27505 raft_consensus.cc:2804] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:53.094385 27505 raft_consensus.cc:697] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 9 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:53.095259 27505 consensus_queue.cc:237] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:53.065824 27251 consensus_queue.cc:1048] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:28:53.084086 27273 raft_consensus.cc:2749] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:53.104766 27347 raft_consensus.cc:2804] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:53.129942 27347 raft_consensus.cc:697] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:53.135408 27551 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:28:53.177590 27347 consensus_queue.cc:237] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:53.195375 27551 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ecdd4cc5fb44b71b4e16e1dc06d61b6)
I20260709 12:28:53.195950 27551 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:53.349116 26420 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:53.374596 27187 raft_consensus.cc:993] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:53.375300 25487 raft_consensus.cc:1240] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:53.375602 27374 raft_consensus.cc:1081] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:53.378569 26415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53792
I20260709 12:28:53.379298 26415 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:53.379706 26415 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:53.354698 25490 raft_consensus.cc:1275] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:28:53.385987 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 50450.6us
I20260709 12:28:53.406879 26983 raft_consensus.cc:993] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659: : Instructing follower 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:53.407433 26983 raft_consensus.cc:1081] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Signalling peer 3e2fd10beaf04318be94c0a3430cef3e to start an election
I20260709 12:28:53.420130 25641 raft_consensus.cc:1275] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:53.442826 27551 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:53.445387 27202 consensus_queue.cc:1059] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:53.445842 27551 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:28:53.446363 27202 consensus_queue.cc:1243] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer 3e2fd10beaf04318be94c0a3430cef3e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:28:53.447064 27202 raft_consensus.cc:3055] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:53.447394 27202 raft_consensus.cc:740] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:53.422900 26415 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:53.452841 26415 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:53.458230 26415 raft_consensus.cc:1240] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:53.449002 27202 consensus_queue.cc:260] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:53.464758 27202 raft_consensus.cc:3060] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:53.466332 26406 raft_consensus.cc:1275] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:53.468837 25490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:53.469828 25490 raft_consensus.cc:3055] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:53.470188 25490 raft_consensus.cc:740] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:53.470348 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:53.470752 25569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2cd2d2b04c741948386a7e2706f99b7" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:53.471493 25569 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:53.472688 25491 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:28:53.489225 26976 consensus_queue.cc:1048] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:53.491283 27344 consensus_queue.cc:1059] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:28:53.492194 27344 raft_consensus.cc:3055] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:53.492604 27344 raft_consensus.cc:740] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:53.494210 27225 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:28:53.493666 27344 consensus_queue.cc:260] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:53.499082 27344 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:53.497985 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:53.502504 25569 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:53.509188 26415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
 from {username='slave'} at 127.0.0.1:53780
I20260709 12:28:53.509019 25568 raft_consensus.cc:1240] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Rejecting Update request from peer bf67e247c9e5443ea0099083f496b361 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:53.471549 25490 consensus_queue.cc:260] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:53.510001 26415 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:53.510433 26415 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.508327 27551 consensus_queue.cc:1048] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:28:53.514418 26406 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:53.522663 26983 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:28:53.525372 25490 raft_consensus.cc:3060] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:53.532305 27261 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:53.534381 25491 raft_consensus.cc:1275] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:28:53.580845 26181 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:53.587356 25635 raft_consensus.cc:1275] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Refusing update from remote peer 05cabf76554146489f61260dbdadf659: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:53.595283 25488 raft_consensus.cc:1240] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Rejecting Update request from peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:28:53.602180 27504 consensus_queue.cc:1048] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:53.602478 27431 consensus_queue.cc:1059] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:53.603349 27431 raft_consensus.cc:3055] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:53.603686 27431 raft_consensus.cc:740] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:53.611577 27202 consensus_queue.cc:1048] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:53.621392 26415 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:53.622537 25634 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 5.
I20260709 12:28:53.624121 25490 raft_consensus.cc:2468] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 4.
I20260709 12:28:53.632905 26976 raft_consensus.cc:2804] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:28:53.627328 26181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 99022.5us
I20260709 12:28:53.646302 26415 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:53.650841 26976 raft_consensus.cc:697] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:53.604792 27431 consensus_queue.cc:260] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:53.661454 25639 raft_consensus.cc:1275] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:28:53.662626 25639 pending_rounds.cc:85] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting all ops after (but not including) 3
I20260709 12:28:53.666190 26976 consensus_queue.cc:237] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:53.665334 25639 pending_rounds.cc:107] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:28:53.677688 25639 raft_consensus.cc:2889] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:53.678490 25568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:53.679265 25568 raft_consensus.cc:3055] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:53.679761 25568 raft_consensus.cc:740] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:53.680790 25568 consensus_queue.cc:260] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:53.721669 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:53.722467 25495 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.730749 25565 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:28:53.736465 25533 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:53.737349 26732 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:53.741742 25568 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:53.770074 25495 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:53.792548 26182 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:53.804652 27554 raft_consensus.cc:2804] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:53.811602 27431 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:53.811940 27554 raft_consensus.cc:697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:53.819159 25568 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 3.
I20260709 12:28:53.842896 27554 consensus_queue.cc:237] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:53.856993 25607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:53.918141 26180 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 05cabf76554146489f61260dbdadf659
I20260709 12:28:53.921885 27551 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:53.922660 27551 raft_consensus.cc:697] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:53.923924 27551 consensus_queue.cc:237] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:53.971846 27339 consensus_queue.cc:1048] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:53.980959 25495 raft_consensus.cc:1275] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:53.992760 25318 catalog_manager.cc:5697] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.000105 25318 catalog_manager.cc:5697] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 6, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 6 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.006021 25318 catalog_manager.cc:5697] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 8 to 9, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 9 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.015717 27588 consensus_queue.cc:1048] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:54.036398 25315 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47518 (request call id 82) took 3807 ms. Trace:
I20260709 12:28:54.037734 25318 catalog_manager.cc:5697] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 5 to 6, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 6 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
I20260709 12:28:54.044822 25318 catalog_manager.cc:5697] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 4 to 7, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 7 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.047166 25318 catalog_manager.cc:5697] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:54.048727 25318 catalog_manager.cc:5697] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:54.054205 25318 catalog_manager.cc:5697] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 5 to 7, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 7 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:54.056275 25315 rpcz_store.cc:276] 0709 12:28:50.228787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:50.229023 (+   236us) service_pool.cc:224] Handling call
0709 12:28:50.333936 (+104913us) spinlock_profiling.cc:243] Waited 916 us on lock 0x7b5400712928. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e29bdb331 00007f1e29bd63fc 00007f1e297a7e84 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:54.036137 (+3702201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:53.098865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:53.099669 (+   804us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:53.099716 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:28:53.099743 (+    27us) tablet.cc:662] Decoding operations
0709 12:28:53.101162 (+  1419us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:53.101259 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:53.101301 (+    42us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:28:53.102582 (+  1281us) tablet.cc:701] Row locks acquired
0709 12:28:53.102604 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:28:53.106731 (+  4127us) write_op.cc:270] Start()
0709 12:28:53.113749 (+  7018us) write_op.cc:276] Timestamp: P: 1783600133102731 usec, L: 0
0709 12:28:53.113770 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:28:53.168382 (+ 54612us) log.cc:844] Serialized 4384 byte log entry
0709 12:28:53.329569 (+161187us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b18001ad4c0. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e297c4ab1 00007f1e297d1281 00007f1e208fc3f3 00007f1e208fe7c1 00007f1e208fe779 00007f1e208fe709 00007f1e208fe6d1 00007f1e208fd9cd 0000000000388634 0000000000388479 00007f1e208df83a
0709 12:28:53.533813 (+204244us) op_driver.cc:464] REPLICATION: finished
0709 12:28:53.565743 (+ 31930us) write_op.cc:301] APPLY: starting
0709 12:28:53.565948 (+   205us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:53.566525 (+   577us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:53.566594 (+    69us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:53.568886 (+  2292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:53.569549 (+   663us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:28:53.569652 (+   103us) write_op.cc:312] APPLY: finished
0709 12:28:53.570358 (+   706us) log.cc:844] Serialized 82 byte log entry
0709 12:28:53.570631 (+   273us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:53.574686 (+  4055us) write_op.cc:454] Released schema lock
0709 12:28:53.584360 (+  9674us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:53.729458 (+145098us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:53.729490 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":131639,"reported_tablets":34,"spinlock_wait_cycles":2106112,"child_traces":[["op",{"apply.queue_time_us":31468,"apply.run_cpu_time_us":8682,"apply.run_wall_time_us":145863,"num_ops":11,"prepare.queue_time_us":359622,"prepare.run_cpu_time_us":11452,"prepare.run_wall_time_us":98765,"raft.queue_time_us":143912,"raft.run_cpu_time_us":6701,"raft.run_wall_time_us":40140,"replication_time_us":415913,"spinlock_wait_cycles":7682432,"thread_start_us":410990,"threads_started":4,"wal-append.queue_time_us":24088}]]}
I20260709 12:28:54.063126 25318 catalog_manager.cc:5697] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 5, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 5 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.079944 25318 catalog_manager.cc:5697] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:54.081293 25318 catalog_manager.cc:5697] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 5 to 6, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 6 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.082816 25318 catalog_manager.cc:5697] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 2 to 4, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.116310 25490 raft_consensus.cc:1275] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:54.118543 27554 consensus_queue.cc:1048] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:54.136896 25560 raft_consensus.cc:1275] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:54.140491 26732 consensus_queue.cc:1048] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:54.147135 25318 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57458 (request call id 187) took 1075 ms. Trace:
I20260709 12:28:54.155393 25313 catalog_manager.cc:5697] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:54.157449 25313 catalog_manager.cc:5697] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 6, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 6 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.147637 25318 rpcz_store.cc:276] 0709 12:28:53.071485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:53.071637 (+   152us) service_pool.cc:224] Handling call
0709 12:28:54.147048 (+1075411us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:54.094483 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:54.095196 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:54.095255 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:28:54.095276 (+    21us) tablet.cc:662] Decoding operations
0709 12:28:54.096530 (+  1254us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:54.096651 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:54.096683 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:28:54.098024 (+  1341us) tablet.cc:701] Row locks acquired
0709 12:28:54.098076 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:28:54.098251 (+   175us) write_op.cc:270] Start()
0709 12:28:54.098411 (+   160us) write_op.cc:276] Timestamp: P: 1783600134098192 usec, L: 0
0709 12:28:54.098433 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:28:54.099185 (+   752us) log.cc:844] Serialized 4773 byte log entry
0709 12:28:54.106319 (+  7134us) op_driver.cc:464] REPLICATION: finished
0709 12:28:54.106662 (+   343us) write_op.cc:301] APPLY: starting
0709 12:28:54.106747 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:54.107007 (+   260us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:54.107096 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:54.108265 (+  1169us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:54.108521 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:28:54.108570 (+    49us) write_op.cc:312] APPLY: finished
0709 12:28:54.108892 (+   322us) log.cc:844] Serialized 88 byte log entry
0709 12:28:54.109056 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:54.109225 (+   169us) write_op.cc:454] Released schema lock
0709 12:28:54.109274 (+    49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":74947,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":2912,"apply.run_wall_time_us":2913,"num_ops":12,"prepare.queue_time_us":3454,"prepare.run_cpu_time_us":5082,"prepare.run_wall_time_us":11662,"replication_time_us":7727,"thread_start_us":3070,"threads_started":1}]]}
I20260709 12:28:54.160669 25313 catalog_manager.cc:5697] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:54.168289 25313 catalog_manager.cc:5697] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.174182 25313 catalog_manager.cc:5697] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 2 to 3, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 3 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:54.240782 25313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57464 (request call id 165) took 2475 ms. Trace:
I20260709 12:28:54.241225 25313 rpcz_store.cc:276] 0709 12:28:51.764949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.766213 (+  1264us) service_pool.cc:224] Handling call
0709 12:28:51.887272 (+121059us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b5400712ad4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23953090 00007f1e239f1f3a 00007f1e297a7e9c 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:54.240701 (+2353429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:54.179688 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:54.180251 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:54.180285 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:28:54.180305 (+    20us) tablet.cc:662] Decoding operations
0709 12:28:54.180961 (+   656us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:54.181026 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:54.181052 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:28:54.181660 (+   608us) tablet.cc:701] Row locks acquired
0709 12:28:54.181681 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:28:54.181828 (+   147us) write_op.cc:270] Start()
0709 12:28:54.181950 (+   122us) write_op.cc:276] Timestamp: P: 1783600134181780 usec, L: 0
0709 12:28:54.181973 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:28:54.182680 (+   707us) log.cc:844] Serialized 2078 byte log entry
0709 12:28:54.185029 (+  2349us) op_driver.cc:464] REPLICATION: finished
0709 12:28:54.185483 (+   454us) write_op.cc:301] APPLY: starting
0709 12:28:54.185575 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:54.185741 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:54.185843 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:54.186444 (+   601us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:54.186653 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:28:54.186699 (+    46us) write_op.cc:312] APPLY: finished
0709 12:28:54.186918 (+   219us) log.cc:844] Serialized 46 byte log entry
0709 12:28:54.187069 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:54.187169 (+   100us) write_op.cc:454] Released schema lock
0709 12:28:54.187217 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:54.187564 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:54.187589 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24180,"reported_tablets":30,"spinlock_wait_cycles":106758528,"child_traces":[["op",{"apply.queue_time_us":248,"apply.run_cpu_time_us":2034,"apply.run_wall_time_us":2035,"num_ops":5,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":3262,"prepare.run_wall_time_us":3261,"replication_time_us":2915}]]}
I20260709 12:28:54.251642 25318 catalog_manager.cc:5697] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } }
I20260709 12:28:54.253341 25318 catalog_manager.cc:5697] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 5 to 7, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 7 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:54.261732 25318 catalog_manager.cc:5697] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 5 to 6, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } }
I20260709 12:28:54.263255 25318 catalog_manager.cc:5697] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 8 to 9, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 9 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.265159 25318 catalog_manager.cc:5697] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:54.266443 25318 catalog_manager.cc:5697] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 4, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:54.297304 25314 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57448 (request call id 184) took 2854 ms. Trace:
W20260709 12:28:54.301011 25609 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.98.126:39987, user_credentials={real_user=slave}} blocked reactor thread for 54055.7us
I20260709 12:28:54.313104 25315 catalog_manager.cc:5697] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 5 to 7, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 7 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.320078 25315 catalog_manager.cc:5697] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 5, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 5 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.322175 25314 rpcz_store.cc:276] 0709 12:28:51.443240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:51.443607 (+   367us) service_pool.cc:224] Handling call
0709 12:28:51.649492 (+205885us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5400712ad4. stack: 00007f1e208ca343 00007f1e208ca240 00007f1e202591d4 00007f1e29f97304 00007f1e29f97299 00007f1e23953090 00007f1e239f1f3a 00007f1e297a7e9c 00007f1e298a604e 00007f1e27d672a4 00007f1e27d67232 00007f1e27d67161 00007f1e27d670dc 00007f1e27d66392 00007f1e21d2448c 00007f1e21d238c6
0709 12:28:54.297096 (+2647604us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15483,"reported_tablets":31,"spinlock_wait_cycles":56853888}
I20260709 12:28:54.323745 25315 catalog_manager.cc:5697] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:54.325906 25315 catalog_manager.cc:5697] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 3, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 3 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } }
I20260709 12:28:54.328347 25315 catalog_manager.cc:5697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 3, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 3 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.332263 25315 catalog_manager.cc:5697] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 5 to 6, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 6 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.337029 25315 catalog_manager.cc:5697] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.339222 25560 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:54.463536 25315 catalog_manager.cc:5697] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.516762 27187 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:54.517695 27187 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:54.546130 25560 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:28:54.549521 27162 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.550165 27162 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:54.552321 27162 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:54.618292 27187 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:54.635033 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:54.636044 25560 raft_consensus.cc:2393] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 in current term 7: Already voted for candidate 05cabf76554146489f61260dbdadf659 in this term.
I20260709 12:28:54.675346 25488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:54.676805 25495 raft_consensus.cc:1275] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.678121 25488 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 6.
I20260709 12:28:54.717128 25561 raft_consensus.cc:1275] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.719888 26182 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:54.746405 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:28:54.761036 25562 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 7.
I20260709 12:28:54.755668 27606 consensus_queue.cc:1048] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:28:54.787799 26983 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.789242 27616 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:54.798431 26983 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:54.797212 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 77390.3us
I20260709 12:28:54.804886 27616 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:54.805194 26180 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 64316.8us
I20260709 12:28:54.811656 27616 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:54.830937 26983 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:54.859407 27616 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:54.862169 27616 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:54.862277 27612 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:54.862861 27612 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:54.865636 27612 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:54.897128 25639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:54.901088 25639 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 5.
I20260709 12:28:54.925487 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:54.926260 26406 raft_consensus.cc:2368] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 7. Current term is 8.
I20260709 12:28:54.933120 25459 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
W20260709 12:28:54.939284 26182 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 120419us
I20260709 12:28:54.949097 27630 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:28:54.949667 27630 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:54.950084 27630 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:54.949533 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:54.953320 25640 raft_consensus.cc:1275] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:28:54.953481 25489 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:28:54.962312 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 114369us
I20260709 12:28:54.969352 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "3e2fd10beaf04318be94c0a3430cef3e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:54.970211 25562 raft_consensus.cc:3060] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:54.966573 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:54.972355 25495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bf67e247c9e5443ea0099083f496b361" is_pre_election: true
I20260709 12:28:54.982769 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:54.983441 26415 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:54.986116 27261 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:28:54.993022 27604 consensus_queue.cc:1048] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:54.977034 25314 catalog_manager.cc:5697] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 5 to 6, leader changed from bf67e247c9e5443ea0099083f496b361 (127.20.98.66) to 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65). New cstate: current_term: 6 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } }
I20260709 12:28:55.001399 27347 consensus_queue.cc:1048] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:28:55.005780 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 112137us
I20260709 12:28:55.006763 25489 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 8.
I20260709 12:28:55.016335 25562 raft_consensus.cc:2468] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e2fd10beaf04318be94c0a3430cef3e in term 8.
I20260709 12:28:55.019153 25458 leader_election.cc:400] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 7. Current term is 8.
I20260709 12:28:55.019507 25458 leader_election.cc:403] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:55.020757 27624 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707) with higher term. Message: Invalid argument: T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf67e247c9e5443ea0099083f496b361 for earlier term 7. Current term is 8.
I20260709 12:28:55.019977 26182 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:55.029217 27634 raft_consensus.cc:2804] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:55.033497 27634 raft_consensus.cc:697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Becoming Leader. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:55.038678 27634 consensus_queue.cc:237] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:55.041745 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d6fff0aa59444fbdd7d28b71f0c28e" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:55.046444 27630 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:55.065905 27630 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:55.068457 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:55.069301 25635 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:28:55.087605 27504 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.088200 27504 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.093448 25635 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:55.107215 27504 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:55.107635 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c33d5ee86514aeda0b963d59db594a2" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:55.108285 26415 raft_consensus.cc:3060] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:28:55.109567 25459 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:55.119689 26415 raft_consensus.cc:2468] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 6.
I20260709 12:28:55.124416 26409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21d58e43edb84946ae592af63b28862c"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:55.125185 26409 raft_consensus.cc:606] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:55.114930 27612 raft_consensus.cc:2804] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:28:55.136909 27612 raft_consensus.cc:697] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 6 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:55.137697 25565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:55.138353 25565 raft_consensus.cc:606] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:55.140165 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:55.137916 27612 consensus_queue.cc:237] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:55.133131 25532 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:55.149699 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e" is_pre_election: true
I20260709 12:28:55.171392 27627 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:55.180527 25565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:55.181399 25565 raft_consensus.cc:606] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:55.174314 25314 catalog_manager.cc:5697] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3e2fd10beaf04318be94c0a3430cef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:55.209792 25532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.65:34707, user_credentials={real_user=slave}} blocked reactor thread for 57481.9us
I20260709 12:28:55.210937 25532 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:55.235188 25565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9"
dest_uuid: "05cabf76554146489f61260dbdadf659"
mode: GRACEFUL
new_leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:59036
I20260709 12:28:55.253973 25565 raft_consensus.cc:606] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 LEADER]: Received request to transfer leadership to TS 0ecdd4cc5fb44b71b4e16e1dc06d61b6
I20260709 12:28:55.273869 27602 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:55.278796 26406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
mode: GRACEFUL
new_leader_uuid: "bf67e247c9e5443ea0099083f496b361"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:55.279604 26406 raft_consensus.cc:606] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Received request to transfer leadership to TS bf67e247c9e5443ea0099083f496b361
I20260709 12:28:55.286126 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:55.288108 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:55.289294 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:55.313742 25313 catalog_manager.cc:5697] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 4 to 6, leader changed from 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 6 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:55.418464 27554 raft_consensus.cc:993] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e: : Instructing follower bf67e247c9e5443ea0099083f496b361 to start an election
I20260709 12:28:55.419100 27261 raft_consensus.cc:1081] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Signalling peer bf67e247c9e5443ea0099083f496b361 to start an election
I20260709 12:28:55.421319 25489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
 from {username='slave'} at 127.0.0.1:60406
I20260709 12:28:55.422006 25489 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:55.422456 25489 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:55.430784 25489 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:55.433274 25489 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 8 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:55.434041 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:55.434777 26420 raft_consensus.cc:3055] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:55.435144 26420 raft_consensus.cc:740] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:55.436035 26420 consensus_queue.cc:260] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:55.437281 26420 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:55.441059 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf093f8ce6c4c699a8c0589bc191c66" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:28:55.441779 25634 raft_consensus.cc:3060] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:55.451498 25560 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:55.454964 27604 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:55.456342 26420 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 8.
I20260709 12:28:55.458822 25458 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:55.459893 27187 raft_consensus.cc:2804] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:55.460969 27187 raft_consensus.cc:697] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 8 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:55.462117 27187 consensus_queue.cc:237] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:55.501950 25634 raft_consensus.cc:2468] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 8.
I20260709 12:28:55.523814 25489 raft_consensus.cc:1275] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Refusing update from remote peer 3e2fd10beaf04318be94c0a3430cef3e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:55.525743 27162 consensus_queue.cc:1048] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:55.541268 25315 catalog_manager.cc:5697] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 7 to 8, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 8 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:55.569461 25635 raft_consensus.cc:1275] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:55.572938 27624 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:55.615236 26420 raft_consensus.cc:1275] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:28:55.617337 27624 consensus_queue.cc:1048] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:55.628409 27554 raft_consensus.cc:993] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.628923 27554 raft_consensus.cc:1081] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.632601 25640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21d58e43edb84946ae592af63b28862c"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:48680
I20260709 12:28:55.633997 25640 raft_consensus.cc:493] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:55.634497 25640 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:55.647115 25640 raft_consensus.cc:515] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.649961 25640 leader_election.cc:290] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:55.652904 26406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:55.653635 26406 raft_consensus.cc:3055] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:55.653940 26406 raft_consensus.cc:740] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:55.654680 26406 consensus_queue.cc:260] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.655953 25560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d58e43edb84946ae592af63b28862c" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:55.656591 25560 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:55.659919 26406 raft_consensus.cc:3060] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:55.667383 27615 raft_consensus.cc:993] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.667961 27615 raft_consensus.cc:1081] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.669742 25635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53066
I20260709 12:28:55.670277 25635 raft_consensus.cc:493] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:55.670590 25635 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:55.677961 25635 raft_consensus.cc:515] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.678622 26406 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:55.680052 25606 leader_election.cc:304] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:55.680979 27596 raft_consensus.cc:2804] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:55.681571 27596 raft_consensus.cc:697] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:55.682458 27596 consensus_queue.cc:237] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.687428 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:55.688146 25561 raft_consensus.cc:3055] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:55.688453 25561 raft_consensus.cc:740] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:55.688536 25635 leader_election.cc:290] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:55.689343 25561 consensus_queue.cc:260] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.690320 27615 raft_consensus.cc:993] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.690732 25561 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:55.690888 27633 raft_consensus.cc:1081] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.678622 25560 raft_consensus.cc:2468] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:55.688319 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c468ba201aea46e79fb35a4ec3df27d9" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:55.694355 26420 raft_consensus.cc:3060] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:55.705143 27633 raft_consensus.cc:993] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659: : Instructing follower 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.707038 27633 raft_consensus.cc:1081] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Signalling peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6 to start an election
I20260709 12:28:55.710065 25561 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 8.
I20260709 12:28:55.716228 26420 raft_consensus.cc:2468] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 8.
I20260709 12:28:55.722307 25608 leader_election.cc:304] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:28:55.723444 27596 raft_consensus.cc:2804] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:55.723191 25313 catalog_manager.cc:5697] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:55.724035 27596 raft_consensus.cc:697] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:55.725132 25640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53066
I20260709 12:28:55.725765 25640 raft_consensus.cc:493] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:55.726126 25640 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:55.728295 27596 consensus_queue.cc:237] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.733978 25640 raft_consensus.cc:515] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:55.736488 25635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34"
dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
 from {username='slave'} at 127.0.0.1:53066
I20260709 12:28:55.736959 25489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bf67e247c9e5443ea0099083f496b361"
I20260709 12:28:55.737608 25489 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:55.737092 25635 raft_consensus.cc:493] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:55.739480 25640 leader_election.cc:290] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:55.739694 25635 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:55.744056 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c6db57a7db04a8a8d0736539285c239" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:55.744681 25561 raft_consensus.cc:3055] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:55.744992 25561 raft_consensus.cc:740] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:55.745808 25561 consensus_queue.cc:260] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:55.746946 25561 raft_consensus.cc:3060] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:55.746961 25635 raft_consensus.cc:515] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.759246 25635 leader_election.cc:290] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:55.760098 26420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:55.760697 26420 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:55.761116 25489 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:28:55.761309 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91cdf689f66f41ffaf423525144f0f34" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:55.762099 25562 raft_consensus.cc:3055] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:55.762470 25562 raft_consensus.cc:740] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:28:55.765098 25562 consensus_queue.cc:260] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:55.767724 25562 raft_consensus.cc:3060] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:55.769320 26420 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:55.774130 25606 leader_election.cc:304] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e; no voters: 
I20260709 12:28:55.774950 27354 raft_consensus.cc:2804] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:55.778076 25313 catalog_manager.cc:5697] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 7 to 8, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 8 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:55.781060 25562 raft_consensus.cc:2468] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:28:55.783303 25609 leader_election.cc:304] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:55.776507 27354 raft_consensus.cc:697] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:55.800375 27354 consensus_queue.cc:237] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:28:55.802220 27654 log.cc:927] Time spent T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:28:55.806195 27596 raft_consensus.cc:2804] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:55.806834 27596 raft_consensus.cc:697] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:28:55.807753 27596 consensus_queue.cc:237] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:28:55.830816 25561 raft_consensus.cc:2468] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
W20260709 12:28:55.829581 25609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 53061us
I20260709 12:28:55.902398 25313 catalog_manager.cc:5697] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 4 to 5, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:55.904011 25313 catalog_manager.cc:5697] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 3 to 4, leader changed from 05cabf76554146489f61260dbdadf659 (127.20.98.67) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 4 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:55.978571 25640 raft_consensus.cc:1275] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:55.980136 27624 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:56.000731 26415 raft_consensus.cc:1275] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:56.002492 27612 consensus_queue.cc:1048] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:56.152187 25561 raft_consensus.cc:1275] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:56.155886 27660 consensus_queue.cc:1048] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:56.222393 25562 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:56.232168 27596 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:56.238415 26420 raft_consensus.cc:1275] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:56.240373 27596 consensus_queue.cc:1048] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:56.248245 25490 raft_consensus.cc:1275] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:56.260262 26406 raft_consensus.cc:1275] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:28:56.261657 27596 consensus_queue.cc:1048] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:56.263371 27656 consensus_queue.cc:1048] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:56.306836 25560 raft_consensus.cc:1275] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:56.325592 26415 raft_consensus.cc:1275] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:28:56.328207 27660 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:28:56.352744 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 46381us
I20260709 12:28:56.382158 25562 raft_consensus.cc:1275] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:56.390491 27596 consensus_queue.cc:1048] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:56.402069 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:56.501652 25535 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:43799, user_credentials={real_user=slave}} blocked reactor thread for 77741.8us
I20260709 12:28:56.506613 27655 consensus_queue.cc:1048] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:56.745777 26415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86"
dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
mode: GRACEFUL
new_leader_uuid: "bf67e247c9e5443ea0099083f496b361"
 from {username='slave'} at 127.0.0.1:57496
I20260709 12:28:56.746444 26415 raft_consensus.cc:606] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Received request to transfer leadership to TS bf67e247c9e5443ea0099083f496b361
I20260709 12:28:56.753351 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:56.755637 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:56.756397 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:57.346911 27676 raft_consensus.cc:993] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e: : Instructing follower bf67e247c9e5443ea0099083f496b361 to start an election
I20260709 12:28:57.347421 27676 raft_consensus.cc:1081] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Signalling peer bf67e247c9e5443ea0099083f496b361 to start an election
I20260709 12:28:57.353479 25489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86"
dest_uuid: "bf67e247c9e5443ea0099083f496b361"
 from {username='slave'} at 127.0.0.1:60406
I20260709 12:28:57.354292 25489 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:57.354779 25489 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:57.369614 25489 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:57.409960 26415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3e2fd10beaf04318be94c0a3430cef3e"
I20260709 12:28:57.410570 26415 raft_consensus.cc:3055] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:57.410883 26415 raft_consensus.cc:740] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3e2fd10beaf04318be94c0a3430cef3e, State: Running, Role: LEADER
I20260709 12:28:57.411713 26415 consensus_queue.cc:260] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:57.412883 26415 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:57.410597 25489 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Requested vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:28:57.428931 26415 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:57.430335 25458 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361; no voters: 
I20260709 12:28:57.432802 27674 raft_consensus.cc:2804] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:57.436080 27674 raft_consensus.cc:697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Becoming Leader. State: Replica: bf67e247c9e5443ea0099083f496b361, State: Running, Role: LEADER
I20260709 12:28:57.436897 27674 consensus_queue.cc:237] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:57.438012 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe7e65f43db4cfeb9a77fb1a77c5b86" candidate_uuid: "bf67e247c9e5443ea0099083f496b361" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:28:57.438629 25562 raft_consensus.cc:3060] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:57.454876 25562 raft_consensus.cc:2468] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf67e247c9e5443ea0099083f496b361 in term 4.
I20260709 12:28:57.495049 25314 catalog_manager.cc:5697] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 reported cstate change: term changed from 3 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to bf67e247c9e5443ea0099083f496b361 (127.20.98.66). New cstate: current_term: 4 leader_uuid: "bf67e247c9e5443ea0099083f496b361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.836499 25565 raft_consensus.cc:1275] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:57.840600 27681 consensus_queue.cc:1048] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:57.857496 26406 raft_consensus.cc:1275] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Refusing update from remote peer bf67e247c9e5443ea0099083f496b361: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:57.859127 27681 consensus_queue.cc:1048] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:57.890872 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:58.136788 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:58.147962 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:58.148792 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:58.241302 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:58.315944 20873 tablet_server.cc:179] TabletServer@127.20.98.65:34707 shutting down...
W20260709 12:28:58.326084 25458 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:28:58.357308 25458 consensus_peers.cc:597] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.414729 25606 consensus_peers.cc:597] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.415126 25458 consensus_peers.cc:597] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.415467 25606 consensus_peers.cc:597] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.425416 25606 consensus_peers.cc:597] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.429158 25458 consensus_peers.cc:597] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.441359 25458 consensus_peers.cc:597] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.465056 25532 consensus_peers.cc:597] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.465853 25532 consensus_peers.cc:597] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.466554 25532 consensus_peers.cc:597] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.471520 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:58.472846 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.480048 20873 raft_consensus.cc:2243] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.480734 20873 raft_consensus.cc:2272] T fbf093f8ce6c4c699a8c0589bc191c66 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.485678 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.489648 20873 raft_consensus.cc:2243] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.490386 20873 raft_consensus.cc:2272] T c3271013e0434415b390de1bd1aab244 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.493448 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.495375 20873 raft_consensus.cc:2243] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.499444 20873 raft_consensus.cc:2272] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.513082 25458 consensus_peers.cc:597] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.513871 25458 consensus_peers.cc:597] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.523365 25458 consensus_peers.cc:597] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.526809 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.528030 20873 raft_consensus.cc:2243] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.529227 20873 raft_consensus.cc:2272] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.532608 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.539624 20873 raft_consensus.cc:2243] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:58.564522 25532 consensus_peers.cc:597] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.567662 20873 raft_consensus.cc:2272] T ae8dca7915604597b895b2257bc049ce P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.575587 25606 consensus_peers.cc:597] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.588667 20873 tablet_replica.cc:333] stopping tablet replica
W20260709 12:28:58.589311 25532 consensus_peers.cc:597] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.591022 25606 consensus_peers.cc:597] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.598188 20873 raft_consensus.cc:2243] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.598832 20873 raft_consensus.cc:2272] T 6e4aceeecf604044aba90b5fbaa08a0f P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.601487 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.602530 20873 raft_consensus.cc:2243] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.603376 20873 raft_consensus.cc:2272] T 224263ffd6b64b1c8cba6c27db4d5c4f P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.606887 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.607995 20873 raft_consensus.cc:2243] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.608824 20873 raft_consensus.cc:2272] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.612042 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.612885 20873 raft_consensus.cc:2243] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.613484 20873 raft_consensus.cc:2272] T 03a9d87c866a43c1aaad7aca6383189a P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.619648 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.620638 20873 raft_consensus.cc:2243] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.621299 20873 raft_consensus.cc:2272] T 919fd4e8dca6404ea25c7dcee45b6a97 P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.624380 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.625300 20873 raft_consensus.cc:2243] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.626394 20873 raft_consensus.cc:2272] T 7c836d04de714eb8bdc97e6f4246f014 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.632156 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.633081 20873 raft_consensus.cc:2243] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Raft consensus shutting down.
W20260709 12:28:58.642468 25458 consensus_peers.cc:597] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.634146 20873 raft_consensus.cc:2272] T 4c373e378ec64a5aaac62d18c96517ce P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.648864 25532 consensus_peers.cc:597] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.651124 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.652122 20873 raft_consensus.cc:2243] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.653271 20873 raft_consensus.cc:2272] T ed5b1adb31b64ffdb249abd286df3062 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.660924 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.661945 20873 raft_consensus.cc:2243] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.662575 20873 raft_consensus.cc:2272] T 19b643e26e28481e80dd52e2609d357d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.666539 25458 consensus_peers.cc:597] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.667073 25606 consensus_peers.cc:597] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.670487 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.671432 20873 raft_consensus.cc:2243] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.672652 20873 raft_consensus.cc:2272] T 3cd86abda6394bcfa1249aef297ea152 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.678740 20873 tablet_replica.cc:333] stopping tablet replica
W20260709 12:28:58.682561 25532 consensus_peers.cc:597] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.684031 20873 raft_consensus.cc:2243] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.684712 20873 raft_consensus.cc:2272] T 4f2d902711df4cea9b3d41edac3a3a48 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.686733 25606 consensus_peers.cc:597] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.689909 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.692353 20873 raft_consensus.cc:2243] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.692973 20873 raft_consensus.cc:2272] T 1212a262e8424670b13c83406b35dae8 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.706198 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.707098 20873 raft_consensus.cc:2243] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.707768 20873 raft_consensus.cc:2272] T 2a5d533e66e74b518a0074545fd8e96a P 3e2fd10beaf04318be94c0a3430cef3e [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.711668 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.712512 20873 raft_consensus.cc:2243] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.713932 20873 raft_consensus.cc:2272] T e612523c0021486da0ab8d3a964ad76c P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.715930 25532 consensus_peers.cc:597] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.717116 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.718007 20873 raft_consensus.cc:2243] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.727047 20873 raft_consensus.cc:2272] T c468ba201aea46e79fb35a4ec3df27d9 P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.727154 25606 consensus_peers.cc:597] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.729993 25532 consensus_peers.cc:597] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.730252 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.731225 20873 raft_consensus.cc:2243] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.731920 20873 raft_consensus.cc:2272] T d3837703213a42109c702302ad5f6c0d P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.735833 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.737612 20873 raft_consensus.cc:2243] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.738730 20873 raft_consensus.cc:2272] T 64358b60fab548429df4d7dc1d83a406 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.741086 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.741923 20873 raft_consensus.cc:2243] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.742867 20873 raft_consensus.cc:2272] T 5fd84795939b41f6989d135d7bf7bdd5 P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.745533 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.746188 20873 raft_consensus.cc:2243] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.746963 20873 raft_consensus.cc:2272] T 01a03988797840b79a9c026cc8b293a7 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.748947 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.749686 20873 raft_consensus.cc:2243] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.750228 20873 raft_consensus.cc:2272] T 3c33d5ee86514aeda0b963d59db594a2 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.752804 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.753613 20873 raft_consensus.cc:2243] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.754205 20873 raft_consensus.cc:2272] T 7d18d987a38d42a0bfa897026a77afc3 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.756875 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.757640 20873 raft_consensus.cc:2243] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.758587 20873 raft_consensus.cc:2272] T f2cd2d2b04c741948386a7e2706f99b7 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.762426 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.763214 20873 raft_consensus.cc:2243] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:28:58.763573 25532 consensus_peers.cc:597] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.764181 20873 raft_consensus.cc:2272] T 62d6fff0aa59444fbdd7d28b71f0c28e P 3e2fd10beaf04318be94c0a3430cef3e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.767174 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.768059 20873 raft_consensus.cc:2243] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.768577 20873 raft_consensus.cc:2272] T 7749b2664d48431c84785782eb9c6580 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.771570 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.772414 20873 raft_consensus.cc:2243] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.773486 20873 raft_consensus.cc:2272] T 67c21509d83b4939a1a492dbd10b3acb P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.776407 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.777230 20873 raft_consensus.cc:2243] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.778290 20873 raft_consensus.cc:2272] T cb631167f2654873a2976c1c5e2617de P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.781299 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.782691 20873 raft_consensus.cc:2243] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.783747 20873 raft_consensus.cc:2272] T 60b6b992c02f4199bed5792eda84bf4d P 3e2fd10beaf04318be94c0a3430cef3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.786631 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.787417 20873 raft_consensus.cc:2243] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.787957 20873 raft_consensus.cc:2272] T 21d58e43edb84946ae592af63b28862c P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.790607 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.791356 20873 raft_consensus.cc:2243] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.791874 20873 raft_consensus.cc:2272] T 13eaa197620646c59092c991e745b86d P 3e2fd10beaf04318be94c0a3430cef3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.794776 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.795537 20873 raft_consensus.cc:2243] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.796090 20873 raft_consensus.cc:2272] T f88068fafe9c4345a4abefceb627e5c2 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.799100 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.799922 20873 raft_consensus.cc:2243] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.800545 20873 raft_consensus.cc:2272] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 3e2fd10beaf04318be94c0a3430cef3e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.803380 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.804221 20873 raft_consensus.cc:2243] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.804745 20873 raft_consensus.cc:2272] T 66e0430567d64e6887cc879e2e9b3d61 P 3e2fd10beaf04318be94c0a3430cef3e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.807331 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.808036 20873 raft_consensus.cc:2243] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.808562 20873 raft_consensus.cc:2272] T f1b434fa71554dca9e4ef0b94f3967fb P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.812402 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.813124 20873 raft_consensus.cc:2243] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.813712 20873 raft_consensus.cc:2272] T 9893e663e5c94468ac06743c6cbcec9d P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.816461 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.817230 20873 raft_consensus.cc:2243] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.817799 20873 raft_consensus.cc:2272] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.821691 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.822395 20873 raft_consensus.cc:2243] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.823385 20873 raft_consensus.cc:2272] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 3e2fd10beaf04318be94c0a3430cef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.826170 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.826924 20873 raft_consensus.cc:2243] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.827498 20873 raft_consensus.cc:2272] T 91cdf689f66f41ffaf423525144f0f34 P 3e2fd10beaf04318be94c0a3430cef3e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.830304 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.831075 20873 raft_consensus.cc:2243] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.831676 20873 raft_consensus.cc:2272] T 743a94d34f3642f6b4bb966f8e08c795 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.834386 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.835095 20873 raft_consensus.cc:2243] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.836117 20873 raft_consensus.cc:2272] T 43c409decd6b41e38642164bc29adcac P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.838866 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:58.839532 20873 raft_consensus.cc:2243] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.840047 20873 raft_consensus.cc:2272] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 3e2fd10beaf04318be94c0a3430cef3e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.843405 25458 consensus_peers.cc:597] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.892127 25458 consensus_peers.cc:597] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:58.903283 25606 consensus_peers.cc:597] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:58.977646 20873 tablet_server.cc:196] TabletServer@127.20.98.65:34707 shutdown complete.
W20260709 12:28:59.043599 25459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.68:42365, user_credentials={real_user=slave}} blocked reactor thread for 130312us
W20260709 12:28:59.115322 25460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:32857, user_credentials={real_user=slave}} blocked reactor thread for 46888.1us
I20260709 12:28:59.353432 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
W20260709 12:28:59.371647 25609 consensus_peers.cc:597] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.408404 25609 consensus_peers.cc:597] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.413151 25535 consensus_peers.cc:597] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.420043 25609 consensus_peers.cc:597] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.457422 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:59.460551 20873 tablet_replica.cc:333] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.461480 20873 raft_consensus.cc:2243] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.462131 20873 raft_consensus.cc:2272] T 4c373e378ec64a5aaac62d18c96517ce P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.465256 20873 tablet_replica.cc:333] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.466118 20873 raft_consensus.cc:2243] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.466718 20873 raft_consensus.cc:2272] T 64358b60fab548429df4d7dc1d83a406 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.469712 20873 tablet_replica.cc:333] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.471227 20873 raft_consensus.cc:2243] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.472275 20873 raft_consensus.cc:2272] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:59.473601 25535 consensus_peers.cc:597] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.474496 25609 consensus_peers.cc:597] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.474946 20873 tablet_replica.cc:333] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.475818 20873 raft_consensus.cc:2243] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.476327 20873 raft_consensus.cc:2272] T f2cd2d2b04c741948386a7e2706f99b7 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.481161 20873 tablet_replica.cc:333] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.481945 20873 raft_consensus.cc:2243] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.482467 20873 raft_consensus.cc:2272] T fb4fcc72a03d416991a845dcfd4b9b5f P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.485248 20873 tablet_replica.cc:333] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.486147 20873 raft_consensus.cc:2243] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.487131 20873 raft_consensus.cc:2272] T 56b2d6e550e94756880164ae94318541 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.489549 20873 tablet_replica.cc:333] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.490476 20873 raft_consensus.cc:2243] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.491065 20873 raft_consensus.cc:2272] T 8cc486747ff742b4a5b17a179125bbfd P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.495357 20873 tablet_replica.cc:333] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.496171 20873 raft_consensus.cc:2243] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.496712 20873 raft_consensus.cc:2272] T 5fd84795939b41f6989d135d7bf7bdd5 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.499261 20873 tablet_replica.cc:333] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.500011 20873 raft_consensus.cc:2243] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.500572 20873 raft_consensus.cc:2272] T 01a03988797840b79a9c026cc8b293a7 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.503114 20873 tablet_replica.cc:333] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.503871 20873 raft_consensus.cc:2243] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.504448 20873 raft_consensus.cc:2272] T 62d6fff0aa59444fbdd7d28b71f0c28e P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.507185 20873 tablet_replica.cc:333] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.508018 20873 raft_consensus.cc:2243] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.509086 20873 raft_consensus.cc:2272] T 1212a262e8424670b13c83406b35dae8 P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.511827 20873 tablet_replica.cc:333] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.512696 20873 raft_consensus.cc:2243] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.513270 20873 raft_consensus.cc:2272] T 5117c622cec24a8fb3f80b35f2d10db8 P bf67e247c9e5443ea0099083f496b361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.515978 20873 tablet_replica.cc:333] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.516789 20873 raft_consensus.cc:2243] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.517817 20873 raft_consensus.cc:2272] T fbf093f8ce6c4c699a8c0589bc191c66 P bf67e247c9e5443ea0099083f496b361 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.520457 20873 tablet_replica.cc:333] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.521287 20873 raft_consensus.cc:2243] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.521867 20873 raft_consensus.cc:2272] T ed5b1adb31b64ffdb249abd286df3062 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.524757 20873 tablet_replica.cc:333] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.525719 20873 raft_consensus.cc:2243] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.526755 20873 raft_consensus.cc:2272] T 18fe232132fe484c84a12165ab35ea2a P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.529546 20873 tablet_replica.cc:333] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.530357 20873 raft_consensus.cc:2243] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.531100 20873 raft_consensus.cc:2272] T e04d956db2a3482f97d01e0e1e82ebdd P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.533825 20873 tablet_replica.cc:333] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.534699 20873 raft_consensus.cc:2243] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.535277 20873 raft_consensus.cc:2272] T 743a94d34f3642f6b4bb966f8e08c795 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.537963 20873 tablet_replica.cc:333] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.538807 20873 raft_consensus.cc:2243] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.539431 20873 raft_consensus.cc:2272] T 43c409decd6b41e38642164bc29adcac P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.542188 20873 tablet_replica.cc:333] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.543052 20873 raft_consensus.cc:2243] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.544106 20873 raft_consensus.cc:2272] T 8d58760f1c094ef78273fe3f2ce60924 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.546799 20873 tablet_replica.cc:333] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.547622 20873 raft_consensus.cc:2243] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.548676 20873 raft_consensus.cc:2272] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.551349 20873 tablet_replica.cc:333] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.552170 20873 raft_consensus.cc:2243] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.552727 20873 raft_consensus.cc:2272] T 4c6db57a7db04a8a8d0736539285c239 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.555434 20873 tablet_replica.cc:333] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.556314 20873 raft_consensus.cc:2243] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.556946 20873 raft_consensus.cc:2272] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.559974 20873 tablet_replica.cc:333] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.560766 20873 raft_consensus.cc:2243] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.561359 20873 raft_consensus.cc:2272] T 6d12b36c015f4c51b7d0ef14feabe0b9 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.564199 20873 tablet_replica.cc:333] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.565091 20873 raft_consensus.cc:2243] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.565773 20873 raft_consensus.cc:2272] T 7d18d987a38d42a0bfa897026a77afc3 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.568836 20873 tablet_replica.cc:333] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.569706 20873 raft_consensus.cc:2243] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.570608 20873 raft_consensus.cc:2272] T 3c33d5ee86514aeda0b963d59db594a2 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.573388 20873 tablet_replica.cc:333] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.574256 20873 raft_consensus.cc:2243] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.574860 20873 raft_consensus.cc:2272] T 80a46b4dd44940dc911e876c097f12fe P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.577610 20873 tablet_replica.cc:333] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.578434 20873 raft_consensus.cc:2243] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.579649 20873 raft_consensus.cc:2272] T 4f2d902711df4cea9b3d41edac3a3a48 P bf67e247c9e5443ea0099083f496b361 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.582490 20873 tablet_replica.cc:333] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.583297 20873 raft_consensus.cc:2243] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.583849 20873 raft_consensus.cc:2272] T 1704016a67e740008ce23d578992ecaa P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.586082 27711 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.586611 20873 tablet_replica.cc:333] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.586750 27711 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:59.587570 20873 raft_consensus.cc:2243] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.588619 20873 raft_consensus.cc:2272] T f88068fafe9c4345a4abefceb627e5c2 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.590346 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:59.591519 20873 tablet_replica.cc:333] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.592442 20873 raft_consensus.cc:2243] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.593109 20873 raft_consensus.cc:2272] T 6e4aceeecf604044aba90b5fbaa08a0f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.596051 20873 tablet_replica.cc:333] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.596865 20873 raft_consensus.cc:2243] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.597951 20873 raft_consensus.cc:2272] T ae8dca7915604597b895b2257bc049ce P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.600953 20873 tablet_replica.cc:333] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.601804 20873 raft_consensus.cc:2243] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.602413 20873 raft_consensus.cc:2272] T 8e182cd9691849a9b13a7c77dde34629 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:59.603540 25609 consensus_peers.cc:597] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.605378 20873 tablet_replica.cc:333] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.606312 20873 raft_consensus.cc:2243] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.607378 20873 raft_consensus.cc:2272] T d0af0dee12bd4a1c9b0b4cdca091a4ea P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.608053 27722 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.608669 27722 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:59.610154 20873 tablet_replica.cc:333] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.610998 27722 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:59.611099 20873 raft_consensus.cc:2243] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.611937 20873 raft_consensus.cc:2272] T 66e0430567d64e6887cc879e2e9b3d61 P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.614305 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:59.614751 20873 tablet_replica.cc:333] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.615689 20873 raft_consensus.cc:2243] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.616328 20873 raft_consensus.cc:2272] T cb631167f2654873a2976c1c5e2617de P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.619462 20873 tablet_replica.cc:333] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.620261 20873 raft_consensus.cc:2243] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.621351 20873 raft_consensus.cc:2272] T b412956a26e641d181700046c55c1456 P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.624413 20873 tablet_replica.cc:333] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.625276 20873 raft_consensus.cc:2243] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.625996 20873 raft_consensus.cc:2272] T 60b6b992c02f4199bed5792eda84bf4d P bf67e247c9e5443ea0099083f496b361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.629580 20873 tablet_replica.cc:333] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.630599 20873 raft_consensus.cc:2243] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.631458 20873 raft_consensus.cc:2272] T 4cd7967167e543ae8d82c4880099f27e P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.634259 20873 tablet_replica.cc:333] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.635062 20873 raft_consensus.cc:2243] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.636142 20873 raft_consensus.cc:2272] T f1b434fa71554dca9e4ef0b94f3967fb P bf67e247c9e5443ea0099083f496b361 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.638986 20873 tablet_replica.cc:333] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.639835 20873 raft_consensus.cc:2243] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.593129 27711 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:28:59.640430 20873 raft_consensus.cc:2272] T 7749b2664d48431c84785782eb9c6580 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.643339 20873 tablet_replica.cc:333] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.644129 20873 raft_consensus.cc:2243] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.644730 20873 raft_consensus.cc:2272] T 67c21509d83b4939a1a492dbd10b3acb P bf67e247c9e5443ea0099083f496b361 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:59.645612 25532 leader_election.cc:336] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.646171 25532 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:59.647411 20873 tablet_replica.cc:333] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.648310 20873 raft_consensus.cc:2243] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:59.648679 25535 consensus_peers.cc:597] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.648912 20873 raft_consensus.cc:2272] T 224263ffd6b64b1c8cba6c27db4d5c4f P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:59.649982 27722 raft_consensus.cc:2749] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:28:59.651149 25609 consensus_peers.cc:597] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.651948 20873 tablet_replica.cc:333] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.652761 20873 raft_consensus.cc:2243] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:59.653861 20873 raft_consensus.cc:2272] T f2b0ab9ea8a441e5af5bf911f5c0a649 P bf67e247c9e5443ea0099083f496b361 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:59.654479 25535 consensus_peers.cc:597] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.656622 20873 tablet_replica.cc:333] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361: stopping tablet replica
I20260709 12:28:59.657413 20873 raft_consensus.cc:2243] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:59.657984 20873 raft_consensus.cc:2272] T 340dfb91e8e44fdfaf0b420eefa9df9f P bf67e247c9e5443ea0099083f496b361 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:59.664271 25532 leader_election.cc:336] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.664983 25532 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:59.666364 27722 raft_consensus.cc:2749] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:59.679805 25535 consensus_peers.cc:597] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.679816 25609 consensus_peers.cc:597] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.695331 25535 consensus_peers.cc:597] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.695966 27354 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.696612 27354 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:59.698833 27354 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:59.704788 25609 leader_election.cc:336] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:28:59.709818 25606 leader_election.cc:336] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.710258 25606 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:59.711319 27656 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:28:59.735795 27711 raft_consensus.cc:493] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.736492 27711 raft_consensus.cc:515] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:28:59.739316 27722 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.740023 27722 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:28:59.742354 27722 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:28:59.751075 25532 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.752599 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:28:59.754257 27711 leader_election.cc:290] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:59.757432 25533 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:28:59.759063 27717 raft_consensus.cc:2749] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:59.759168 25535 leader_election.cc:336] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
W20260709 12:28:59.768175 25532 leader_election.cc:336] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.768658 25532 leader_election.cc:304] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:59.771147 27717 raft_consensus.cc:2749] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:59.779837 25535 consensus_peers.cc:597] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.812166 25535 consensus_peers.cc:597] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.824862 25609 consensus_peers.cc:597] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.843782 25535 consensus_peers.cc:597] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.844532 25609 consensus_peers.cc:597] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Couldn't send request to peer bf67e247c9e5443ea0099083f496b361. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.852885 27656 raft_consensus.cc:493] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.853497 27656 raft_consensus.cc:515] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:59.855680 27656 leader_election.cc:290] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:59.867904 27722 raft_consensus.cc:493] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.868536 27722 raft_consensus.cc:515] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
W20260709 12:28:59.874868 25532 leader_election.cc:336] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.879824 27722 leader_election.cc:290] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:28:59.885298 25535 leader_election.cc:336] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:28:59.886142 27656 raft_consensus.cc:493] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.889158 27656 raft_consensus.cc:515] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:59.891383 27656 leader_election.cc:290] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:59.893076 25535 leader_election.cc:304] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:28:59.887900 25609 leader_election.cc:336] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:28:59.895780 27722 raft_consensus.cc:2749] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:59.909194 25609 leader_election.cc:336] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
W20260709 12:28:59.911113 25606 leader_election.cc:336] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.912030 25606 leader_election.cc:304] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:59.912798 27656 raft_consensus.cc:2749] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:28:59.945582 25606 leader_election.cc:336] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:28:59.947563 27656 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:28:59.948194 27656 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:28:59.950517 27656 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:28:59.947027 25606 leader_election.cc:304] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:59.957767 27656 raft_consensus.cc:2749] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:28:59.978546 25606 leader_election.cc:336] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:28:59.979642 25609 leader_election.cc:336] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:28:59.980123 25609 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:28:59.980882 27656 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:29:00.028915 27354 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.029536 27354 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.031860 27354 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:29:00.034257 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:29:00.034979 25565 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 4.
I20260709 12:29:00.036350 25608 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:29:00.037846 27702 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:00.038262 27702 raft_consensus.cc:493] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.038623 27702 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:29:00.050774 25606 leader_election.cc:336] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.053396 27354 raft_consensus.cc:493] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.054133 27354 raft_consensus.cc:515] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:00.058495 27354 leader_election.cc:290] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.070043 27354 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.071046 27354 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.079427 27656 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.084188 27656 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.086511 27656 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:29:00.089437 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:29:00.090123 25565 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:29:00.096251 27717 raft_consensus.cc:493] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.096802 27717 raft_consensus.cc:515] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:29:00.099159 27717 leader_election.cc:290] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:29:00.108875 25535 leader_election.cc:336] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
W20260709 12:29:00.112300 25532 leader_election.cc:336] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.112841 25532 leader_election.cc:304] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.113878 27717 raft_consensus.cc:2749] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:29:00.109892 25608 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:29:00.116499 27656 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:29:00.117002 27717 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.117719 27717 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.120590 27717 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:29:00.127420 25532 leader_election.cc:336] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.128312 27717 raft_consensus.cc:493] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.128999 27717 raft_consensus.cc:515] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:00.131618 27717 leader_election.cc:290] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.133805 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
I20260709 12:29:00.132082 27656 raft_consensus.cc:493] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.135339 27656 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:29:00.141914 25532 leader_election.cc:336] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.142854 27354 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:29:00.081614 27702 raft_consensus.cc:515] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.153368 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:29:00.156471 25565 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
W20260709 12:29:00.154582 25535 leader_election.cc:336] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.157387 25535 leader_election.cc:304] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.158150 27717 raft_consensus.cc:2749] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:00.160492 25608 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:29:00.165073 27354 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:29:00.166882 25606 leader_election.cc:336] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.166913 27354 raft_consensus.cc:493] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.167910 27354 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:29:00.174037 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:29:00.174721 25635 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 3.
I20260709 12:29:00.175545 25565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c3076f64046458ab4e3df3dfdd2a8c1" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:29:00.176110 25565 raft_consensus.cc:3060] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:00.185824 25565 raft_consensus.cc:2468] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 5.
I20260709 12:29:00.190649 27722 raft_consensus.cc:493] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.191239 27722 raft_consensus.cc:515] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:29:00.195298 27722 leader_election.cc:290] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.196308 25533 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:29:00.197743 27722 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:29:00.198165 27722 raft_consensus.cc:493] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.198611 27722 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:00.203254 25532 leader_election.cc:336] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.206003 25608 leader_election.cc:304] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:29:00.206871 27725 raft_consensus.cc:2804] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:00.164934 27702 leader_election.cc:290] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:29:00.207396 27725 raft_consensus.cc:697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:29:00.208315 27725 consensus_queue.cc:237] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.214465 27354 raft_consensus.cc:515] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.217517 27722 raft_consensus.cc:515] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:29:00.222946 25535 leader_election.cc:336] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.232801 25535 leader_election.cc:304] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.224788 27354 leader_election.cc:290] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:29:00.223501 25609 leader_election.cc:336] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.234752 27711 raft_consensus.cc:2749] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:00.239352 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c836d04de714eb8bdc97e6f4246f014" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:29:00.240145 25561 raft_consensus.cc:3060] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:29:00.234936 25609 leader_election.cc:304] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.241446 27354 raft_consensus.cc:2749] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:29:00.248754 27722 leader_election.cc:290] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Requested vote from peers 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:29:00.219183 25606 leader_election.cc:336] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.258117 25532 leader_election.cc:336] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.262393 25606 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.263865 27726 raft_consensus.cc:493] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:00.264398 27726 raft_consensus.cc:515] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:00.266484 27726 leader_election.cc:290] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.272462 25561 raft_consensus.cc:2468] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 7.
I20260709 12:29:00.274067 25608 leader_election.cc:304] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 
I20260709 12:29:00.280562 27702 raft_consensus.cc:2804] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:29:00.281108 27702 raft_consensus.cc:697] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:29:00.282056 27702 consensus_queue.cc:237] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.226579 27656 raft_consensus.cc:515] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.308544 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e612523c0021486da0ab8d3a964ad76c" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:29:00.309278 25635 raft_consensus.cc:3060] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:29:00.326049 25606 leader_election.cc:336] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.327052 25635 raft_consensus.cc:2468] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:29:00.335476 25561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd86abda6394bcfa1249aef297ea152" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659"
I20260709 12:29:00.336158 25561 raft_consensus.cc:3060] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:29:00.336486 27656 leader_election.cc:290] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Requested vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
W20260709 12:29:00.339980 25606 leader_election.cc:336] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.340947 25606 leader_election.cc:336] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.344833 25606 leader_election.cc:336] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.365773 25313 catalog_manager.cc:5697] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 4 to 5, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 5 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.374164 25533 leader_election.cc:304] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:29:00.374274 25561 raft_consensus.cc:2468] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecdd4cc5fb44b71b4e16e1dc06d61b6 in term 6.
I20260709 12:29:00.377009 27717 raft_consensus.cc:2804] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:00.381316 27725 raft_consensus.cc:493] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.381935 27725 raft_consensus.cc:515] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:00.384032 27725 leader_election.cc:290] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:29:00.387094 25609 leader_election.cc:336] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.387539 25609 leader_election.cc:304] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.388622 25562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b2d6e550e94756880164ae94318541" candidate_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "05cabf76554146489f61260dbdadf659" is_pre_election: true
I20260709 12:29:00.390619 25608 leader_election.cc:304] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:29:00.390920 27725 raft_consensus.cc:2749] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:00.391630 27725 raft_consensus.cc:2804] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:29:00.392182 27725 raft_consensus.cc:697] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Becoming Leader. State: Replica: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, State: Running, Role: LEADER
I20260709 12:29:00.393069 27725 consensus_queue.cc:237] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
W20260709 12:29:00.400805 25609 leader_election.cc:336] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.401403 25609 leader_election.cc:304] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.402272 27726 raft_consensus.cc:2749] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:29:00.422683 27717 raft_consensus.cc:697] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Becoming Leader. State: Replica: 05cabf76554146489f61260dbdadf659, State: Running, Role: LEADER
I20260709 12:29:00.427712 27717 consensus_queue.cc:237] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:00.468524 25315 catalog_manager.cc:5697] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 reported cstate change: term changed from 3 to 4, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 05cabf76554146489f61260dbdadf659 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "05cabf76554146489f61260dbdadf659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.521199 25313 catalog_manager.cc:5697] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 6 to 7, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 7 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.523466 25313 catalog_manager.cc:5697] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 reported cstate change: term changed from 5 to 6, leader changed from 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65) to 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68). New cstate: current_term: 6 leader_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.536506 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
W20260709 12:29:00.549549 25608 consensus_peers.cc:597] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.553568 25608 consensus_peers.cc:597] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.563040 27717 raft_consensus.cc:493] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.563795 27717 raft_consensus.cc:515] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:29:00.566468 27717 leader_election.cc:290] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:29:00.573436 25532 leader_election.cc:336] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.579475 25535 leader_election.cc:336] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.580075 25535 leader_election.cc:304] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.580807 27717 raft_consensus.cc:2749] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:29:00.636781 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:00.638032 20873 tablet_replica.cc:333] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.639134 20873 raft_consensus.cc:2243] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.640434 20873 raft_consensus.cc:2272] T 7d18d987a38d42a0bfa897026a77afc3 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.643615 20873 tablet_replica.cc:333] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.644591 20873 raft_consensus.cc:2243] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.645241 20873 raft_consensus.cc:2272] T 7c836d04de714eb8bdc97e6f4246f014 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.648342 20873 tablet_replica.cc:333] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.650408 20873 raft_consensus.cc:2243] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.651124 20873 raft_consensus.cc:2272] T d3837703213a42109c702302ad5f6c0d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.654042 20873 tablet_replica.cc:333] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.654942 20873 raft_consensus.cc:2243] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.657194 20873 raft_consensus.cc:2272] T f2cd2d2b04c741948386a7e2706f99b7 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.661636 20873 tablet_replica.cc:333] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.662931 20873 raft_consensus.cc:2243] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.663617 20873 raft_consensus.cc:2272] T fb4fcc72a03d416991a845dcfd4b9b5f P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.666710 20873 tablet_replica.cc:333] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
W20260709 12:29:00.667277 25608 consensus_peers.cc:597] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.667896 20873 raft_consensus.cc:2243] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.668671 20873 raft_consensus.cc:2272] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:00.672969 25606 consensus_peers.cc:597] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.674330 20873 tablet_replica.cc:333] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.675410 20873 raft_consensus.cc:2243] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.676133 20873 raft_consensus.cc:2272] T 6fd4b00fcdba43ccac1dc476ba3abbf5 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.679579 20873 tablet_replica.cc:333] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.680598 20873 raft_consensus.cc:2243] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.681571 20873 raft_consensus.cc:2272] T 56b2d6e550e94756880164ae94318541 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:00.682297 25606 consensus_peers.cc:597] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:00.684863 20873 tablet_replica.cc:333] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.686043 20873 raft_consensus.cc:2243] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.687424 20873 raft_consensus.cc:2272] T 8cc486747ff742b4a5b17a179125bbfd P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.690892 20873 tablet_replica.cc:333] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.692759 20873 raft_consensus.cc:2243] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.693631 20873 raft_consensus.cc:2272] T 5fd84795939b41f6989d135d7bf7bdd5 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.694875 27656 raft_consensus.cc:493] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.695518 27656 raft_consensus.cc:515] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:00.696969 27725 raft_consensus.cc:493] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.697397 20873 tablet_replica.cc:333] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.697643 27725 raft_consensus.cc:515] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:00.698732 20873 raft_consensus.cc:2243] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.700165 27725 leader_election.cc:290] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.700510 20873 raft_consensus.cc:2272] T 9893e663e5c94468ac06743c6cbcec9d P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.705000 27726 raft_consensus.cc:493] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.705924 20873 tablet_replica.cc:333] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.705705 27726 raft_consensus.cc:515] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:00.707082 20873 raft_consensus.cc:2243] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.707845 20873 raft_consensus.cc:2272] T 62d6fff0aa59444fbdd7d28b71f0c28e P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.708093 27726 leader_election.cc:290] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.711092 20873 tablet_replica.cc:333] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.712954 20873 raft_consensus.cc:2243] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.713654 20873 raft_consensus.cc:2272] T 91cdf689f66f41ffaf423525144f0f34 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.717778 20873 tablet_replica.cc:333] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.718779 20873 raft_consensus.cc:2243] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.720048 20873 raft_consensus.cc:2272] T 5117c622cec24a8fb3f80b35f2d10db8 P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.721532 27732 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.722147 27732 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:00.723486 20873 tablet_replica.cc:333] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.724550 20873 raft_consensus.cc:2243] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.725780 20873 raft_consensus.cc:2272] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.726500 27734 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.727088 27734 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:00.724579 27732 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:29:00.734261 27734 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:29:00.732880 20873 tablet_replica.cc:333] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.736591 20873 raft_consensus.cc:2243] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.737399 20873 raft_consensus.cc:2272] T 340dfb91e8e44fdfaf0b420eefa9df9f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.737648 27732 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.738276 27732 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:29:00.740221 25535 leader_election.cc:336] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
W20260709 12:29:00.740828 25535 leader_election.cc:336] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.740921 27732 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
I20260709 12:29:00.740756 20873 tablet_replica.cc:333] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.743862 20873 raft_consensus.cc:2243] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.747293 27656 leader_election.cc:290] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.754251 27726 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.755091 27728 raft_consensus.cc:493] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.755003 27726 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:00.755790 27728 raft_consensus.cc:515] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:29:00.758369 27728 leader_election.cc:290] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.758477 27726 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:29:00.760428 20873 raft_consensus.cc:2272] T 19b643e26e28481e80dd52e2609d357d P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.761341 27733 raft_consensus.cc:493] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.762040 27733 raft_consensus.cc:515] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:29:00.764613 27733 leader_election.cc:290] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:29:00.767030 25532 consensus_peers.cc:597] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:00.771459 20873 tablet_replica.cc:333] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.772696 20873 raft_consensus.cc:2243] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.773466 20873 raft_consensus.cc:2272] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.776626 20873 tablet_replica.cc:333] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.777632 20873 raft_consensus.cc:2243] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.778657 20873 raft_consensus.cc:2272] T 2a5d533e66e74b518a0074545fd8e96a P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.780202 27726 raft_consensus.cc:493] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.780864 27726 raft_consensus.cc:515] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:00.781430 25641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:29:00.782150 25641 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 4.
I20260709 12:29:00.783288 27726 leader_election.cc:290] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.784435 25635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d58760f1c094ef78273fe3f2ce60924" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:29:00.789958 20873 tablet_replica.cc:333] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.791181 20873 raft_consensus.cc:2243] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:00.772876 25535 leader_election.cc:336] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.797106 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18fe232132fe484c84a12165ab35ea2a" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" is_pre_election: true
I20260709 12:29:00.797654 20873 raft_consensus.cc:2272] T 1212a262e8424670b13c83406b35dae8 P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:00.798050 25532 leader_election.cc:336] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.802254 25532 leader_election.cc:336] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.799871 25606 leader_election.cc:336] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.804971 25606 leader_election.cc:336] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.805686 25609 leader_election.cc:336] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
W20260709 12:29:00.805749 25606 leader_election.cc:336] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:00.807971 25609 leader_election.cc:304] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.809903 20873 tablet_replica.cc:333] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.812017 20873 raft_consensus.cc:2243] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.812070 27726 raft_consensus.cc:2749] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:29:00.810763 25606 leader_election.cc:336] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:00.813391 25609 leader_election.cc:336] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.813913 25609 leader_election.cc:304] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.814476 20873 pending_rounds.cc:70] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: Trying to abort 1 pending ops.
I20260709 12:29:00.814919 20873 pending_rounds.cc:77] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305626175201935360 op_type: NO_OP noop_request { }
I20260709 12:29:00.815444 20873 raft_consensus.cc:2889] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:00.815928 20873 raft_consensus.cc:2272] T e612523c0021486da0ab8d3a964ad76c P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.820034 27725 raft_consensus.cc:2749] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:00.820899 27725 raft_consensus.cc:493] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.821447 27725 raft_consensus.cc:515] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:00.822244 25533 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.823670 27733 raft_consensus.cc:2804] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:29:00.824134 27733 raft_consensus.cc:493] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.824553 27733 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:00.826960 27725 leader_election.cc:290] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:29:00.837203 20873 tablet_replica.cc:333] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
W20260709 12:29:00.840528 25608 consensus_peers.cc:597] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.843037 25606 consensus_peers.cc:597] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.842694 25533 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
W20260709 12:29:00.844949 25533 raft_consensus.cc:2686] T 8d58760f1c094ef78273fe3f2ce60924 P 05cabf76554146489f61260dbdadf659: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:29:00.842070 25535 leader_election.cc:336] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.846208 25535 leader_election.cc:304] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.847075 27734 raft_consensus.cc:2749] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:29:00.848256 25535 leader_election.cc:336] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.839076 20873 raft_consensus.cc:2243] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.849519 25533 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.849906 20873 raft_consensus.cc:2272] T c468ba201aea46e79fb35a4ec3df27d9 P 05cabf76554146489f61260dbdadf659 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:00.850358 25533 raft_consensus.cc:2686] T 18fe232132fe484c84a12165ab35ea2a P 05cabf76554146489f61260dbdadf659: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:29:00.852998 20873 tablet_replica.cc:333] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.854072 20873 raft_consensus.cc:2243] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.855324 20873 raft_consensus.cc:2272] T e04d956db2a3482f97d01e0e1e82ebdd P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.848779 25535 leader_election.cc:304] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.834950 27733 raft_consensus.cc:515] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:00.856735 27734 raft_consensus.cc:2749] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:29:00.865690 25608 leader_election.cc:336] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:29:00.866329 27733 leader_election.cc:290] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Requested vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 0ecdd4cc5fb44b71b4e16e1dc06d61b6 (127.20.98.68:42365)
W20260709 12:29:00.866592 25608 consensus_peers.cc:597] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.867527 25608 consensus_peers.cc:597] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.868248 25608 consensus_peers.cc:597] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.868898 25608 consensus_peers.cc:597] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.869071 20873 tablet_replica.cc:333] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.871706 20873 raft_consensus.cc:2243] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.873072 20873 raft_consensus.cc:2272] T 743a94d34f3642f6b4bb966f8e08c795 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:00.870011 25609 leader_election.cc:336] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.876384 25609 leader_election.cc:304] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
W20260709 12:29:00.876722 25606 consensus_peers.cc:597] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:00.877468 27725 raft_consensus.cc:2749] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:29:00.879140 25609 leader_election.cc:336] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.880659 25609 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
W20260709 12:29:00.880872 25535 leader_election.cc:336] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.881687 27725 raft_consensus.cc:2749] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:00.880227 20873 tablet_replica.cc:333] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
W20260709 12:29:00.881598 25608 leader_election.cc:336] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:29:00.883018 25608 consensus_peers.cc:597] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.883628 25608 consensus_peers.cc:597] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.884711 20873 raft_consensus.cc:2243] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.886932 20873 raft_consensus.cc:2272] T 1fdf104c9b4e44bc81ed8ead9c9f0041 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.890508 20873 tablet_replica.cc:333] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.891448 20873 raft_consensus.cc:2243] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.892117 20873 raft_consensus.cc:2272] T 6d12b36c015f4c51b7d0ef14feabe0b9 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.895138 20873 tablet_replica.cc:333] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.895958 20873 raft_consensus.cc:2243] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.896579 20873 raft_consensus.cc:2272] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.897768 25640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b412956a26e641d181700046c55c1456" candidate_uuid: "05cabf76554146489f61260dbdadf659" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6"
I20260709 12:29:00.898418 25640 raft_consensus.cc:3060] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:29:00.900056 25609 leader_election.cc:336] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.900614 25609 leader_election.cc:304] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.901558 27725 raft_consensus.cc:2749] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:29:00.904593 25609 leader_election.cc:336] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:00.905159 25609 leader_election.cc:304] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.906101 27725 raft_consensus.cc:2749] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:00.907380 25640 raft_consensus.cc:2468] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05cabf76554146489f61260dbdadf659 in term 5.
I20260709 12:29:00.910435 20873 tablet_replica.cc:333] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.911507 20873 raft_consensus.cc:2243] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.912249 20873 raft_consensus.cc:2272] T 60b6b992c02f4199bed5792eda84bf4d P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.915287 20873 tablet_replica.cc:333] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.916278 20873 raft_consensus.cc:2243] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.916956 20873 raft_consensus.cc:2272] T 21d58e43edb84946ae592af63b28862c P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:00.917588 25606 consensus_peers.cc:597] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.919585 20873 tablet_replica.cc:333] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.920524 20873 raft_consensus.cc:2243] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.921626 20873 raft_consensus.cc:2272] T 03a9d87c866a43c1aaad7aca6383189a P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.921455 25533 leader_election.cc:304] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05cabf76554146489f61260dbdadf659, 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: bf67e247c9e5443ea0099083f496b361
W20260709 12:29:00.922916 25533 raft_consensus.cc:2686] T b412956a26e641d181700046c55c1456 P 05cabf76554146489f61260dbdadf659: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:29:00.923182 27725 raft_consensus.cc:493] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.923799 27725 raft_consensus.cc:515] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:00.927806 27725 leader_election.cc:290] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
W20260709 12:29:00.936044 25609 leader_election.cc:336] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
W20260709 12:29:00.940128 25608 leader_election.cc:336] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:29:00.940855 25608 leader_election.cc:304] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:00.942471 27725 raft_consensus.cc:2749] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:00.926388 20873 tablet_replica.cc:333] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.948508 20873 raft_consensus.cc:2243] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.949291 20873 raft_consensus.cc:2272] T f88068fafe9c4345a4abefceb627e5c2 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.952070 20873 tablet_replica.cc:333] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.952883 20873 raft_consensus.cc:2243] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.953562 20873 raft_consensus.cc:2272] T 13eaa197620646c59092c991e745b86d P 05cabf76554146489f61260dbdadf659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.958129 20873 tablet_replica.cc:333] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.959049 20873 raft_consensus.cc:2243] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.960225 20873 raft_consensus.cc:2272] T 6e4aceeecf604044aba90b5fbaa08a0f P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.964609 20873 tablet_replica.cc:333] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.965363 20873 raft_consensus.cc:2243] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.965910 20873 raft_consensus.cc:2272] T ae8dca7915604597b895b2257bc049ce P 05cabf76554146489f61260dbdadf659 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.968458 20873 tablet_replica.cc:333] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.969309 20873 raft_consensus.cc:2243] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.969951 20873 raft_consensus.cc:2272] T 8e182cd9691849a9b13a7c77dde34629 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.972797 20873 tablet_replica.cc:333] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.973553 20873 raft_consensus.cc:2243] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.974366 20873 raft_consensus.cc:2272] T 80a46b4dd44940dc911e876c097f12fe P 05cabf76554146489f61260dbdadf659 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.976361 20873 tablet_replica.cc:333] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.977151 20873 raft_consensus.cc:2243] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:00.981177 25608 consensus_peers.cc:597] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.981946 20873 raft_consensus.cc:2272] T 3cd86abda6394bcfa1249aef297ea152 P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.984719 20873 tablet_replica.cc:333] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.985538 20873 raft_consensus.cc:2243] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.986295 27733 raft_consensus.cc:493] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:00.986835 27733 raft_consensus.cc:515] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } }
I20260709 12:29:00.987396 20873 raft_consensus.cc:2272] T 1704016a67e740008ce23d578992ecaa P 05cabf76554146489f61260dbdadf659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.989236 27733 leader_election.cc:290] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
I20260709 12:29:00.990367 20873 tablet_replica.cc:333] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.991195 20873 raft_consensus.cc:2243] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:00.992211 20873 raft_consensus.cc:2272] T c3271013e0434415b390de1bd1aab244 P 05cabf76554146489f61260dbdadf659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:00.995585 20873 tablet_replica.cc:333] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:00.996348 20873 raft_consensus.cc:2243] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:00.996942 20873 raft_consensus.cc:2272] T cbe7e65f43db4cfeb9a77fb1a77c5b86 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.000001 20873 tablet_replica.cc:333] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:01.000723 20873 raft_consensus.cc:2243] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.001348 20873 raft_consensus.cc:2272] T 4c6db57a7db04a8a8d0736539285c239 P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.001547 25532 leader_election.cc:336] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:01.002388 25535 leader_election.cc:336] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:01.002808 25535 leader_election.cc:304] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05cabf76554146489f61260dbdadf659; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:01.003942 20873 tablet_replica.cc:333] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:01.004278 27733 raft_consensus.cc:2749] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:29:01.004806 20873 raft_consensus.cc:2243] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.005838 20873 raft_consensus.cc:2272] T 919fd4e8dca6404ea25c7dcee45b6a97 P 05cabf76554146489f61260dbdadf659 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.008098 20873 tablet_replica.cc:333] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:01.008682 20873 raft_consensus.cc:2243] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.009224 20873 raft_consensus.cc:2272] T f1b434fa71554dca9e4ef0b94f3967fb P 05cabf76554146489f61260dbdadf659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.012823 20873 tablet_replica.cc:333] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659: stopping tablet replica
I20260709 12:29:01.013509 20873 raft_consensus.cc:2243] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.014638 20873 raft_consensus.cc:2272] T 4cd7967167e543ae8d82c4880099f27e P 05cabf76554146489f61260dbdadf659 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.014657 25608 consensus_peers.cc:597] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.038347 25608 consensus_peers.cc:597] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Couldn't send request to peer 05cabf76554146489f61260dbdadf659. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.041534 27702 raft_consensus.cc:493] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bf67e247c9e5443ea0099083f496b361)
I20260709 12:29:01.042207 27702 raft_consensus.cc:515] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
W20260709 12:29:01.051059 25606 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:01.058876 25606 consensus_peers.cc:597] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:01.059381 27702 leader_election.cc:290] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:29:01.060401 25609 leader_election.cc:336] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:01.061609 25609 leader_election.cc:304] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:01.062804 27702 raft_consensus.cc:2749] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:29:01.115856 25606 consensus_peers.cc:597] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:01.135221 25606 consensus_peers.cc:597] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:01.166628 25606 consensus_peers.cc:597] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:01.267689 25606 consensus_peers.cc:597] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:01.315068 25606 consensus_peers.cc:597] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:01.411577 25606 consensus_peers.cc:597] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 -> Peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Couldn't send request to peer 3e2fd10beaf04318be94c0a3430cef3e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:01.642282 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
I20260709 12:29:01.697157 27656 raft_consensus.cc:493] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:01.698067 27656 raft_consensus.cc:515] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
I20260709 12:29:01.726195 27656 leader_election.cc:290] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:29:01.734323 25606 leader_election.cc:336] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
W20260709 12:29:01.752511 25609 leader_election.cc:336] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:01.752885 20873 tablet_server.cc:179] TabletServer@127.20.98.68:0 shutting down...
I20260709 12:29:01.756106 25609 leader_election.cc:304] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:01.757824 27656 raft_consensus.cc:2749] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:29:01.804557 27656 raft_consensus.cc:493] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:29:01.805064 27656 raft_consensus.cc:515] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } } peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } }
I20260709 12:29:01.807035 27656 leader_election.cc:290] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799), 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857)
I20260709 12:29:01.811093 27656 raft_consensus.cc:493] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3e2fd10beaf04318be94c0a3430cef3e)
I20260709 12:29:01.811618 27656 raft_consensus.cc:515] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } } peers { permanent_uuid: "bf67e247c9e5443ea0099083f496b361" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43799 } }
W20260709 12:29:01.812404 25608 leader_election.cc:336] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Network error: Client connection negotiation failed: client connection to 127.20.98.67:32857: connect: Connection refused (error 111)
W20260709 12:29:01.813213 25609 leader_election.cc:336] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:01.813603 25609 leader_election.cc:304] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:01.813733 27656 leader_election.cc:290] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707), bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799)
W20260709 12:29:01.820217 25606 leader_election.cc:336] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:01.821781 27656 raft_consensus.cc:2749] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:01.822774 25609 leader_election.cc:336] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bf67e247c9e5443ea0099083f496b361 (127.20.98.66:43799): Network error: Client connection negotiation failed: client connection to 127.20.98.66:43799: connect: Connection refused (error 111)
I20260709 12:29:01.823289 25609 leader_election.cc:304] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 3e2fd10beaf04318be94c0a3430cef3e, bf67e247c9e5443ea0099083f496b361
I20260709 12:29:01.824036 27656 raft_consensus.cc:2749] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:29:01.832466 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:01.836649 20873 tablet_replica.cc:333] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.837690 20873 raft_consensus.cc:2243] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.838936 20873 pending_rounds.cc:70] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Trying to abort 1 pending ops.
I20260709 12:29:01.839227 20873 pending_rounds.cc:77] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting op as it isn't in flight: id { term: 7 index: 5 } timestamp: 7305626174604943360 op_type: NO_OP noop_request { }
I20260709 12:29:01.839668 20873 raft_consensus.cc:2889] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:01.841256 20873 raft_consensus.cc:2272] T 7c836d04de714eb8bdc97e6f4246f014 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.845206 20873 tablet_replica.cc:333] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.846495 20873 raft_consensus.cc:2243] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.847100 20873 raft_consensus.cc:2272] T e04d956db2a3482f97d01e0e1e82ebdd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.850185 20873 tablet_replica.cc:333] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.851081 20873 raft_consensus.cc:2243] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.852236 20873 raft_consensus.cc:2272] T fb4fcc72a03d416991a845dcfd4b9b5f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.852833 27702 raft_consensus.cc:493] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05cabf76554146489f61260dbdadf659)
I20260709 12:29:01.853410 27702 raft_consensus.cc:515] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05cabf76554146489f61260dbdadf659" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 32857 } } peers { permanent_uuid: "0ecdd4cc5fb44b71b4e16e1dc06d61b6" member_type: VOTER last_known_addr { host: "127.20.98.68" port: 42365 } } peers { permanent_uuid: "3e2fd10beaf04318be94c0a3430cef3e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34707 } }
I20260709 12:29:01.855873 20873 tablet_replica.cc:333] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.856947 20873 raft_consensus.cc:2243] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.855933 27702 leader_election.cc:290] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857), 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707)
I20260709 12:29:01.857650 20873 raft_consensus.cc:2272] T 4c373e378ec64a5aaac62d18c96517ce P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.860684 20873 tablet_replica.cc:333] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.861660 20873 raft_consensus.cc:2243] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.862350 20873 raft_consensus.cc:2272] T 56b2d6e550e94756880164ae94318541 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.863281 25608 leader_election.cc:336] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 05cabf76554146489f61260dbdadf659 (127.20.98.67:32857): Network error: Client connection negotiation failed: client connection to 127.20.98.67:32857: connect: Connection refused (error 111)
I20260709 12:29:01.865128 20873 tablet_replica.cc:333] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.866125 20873 raft_consensus.cc:2243] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.867226 20873 pending_rounds.cc:70] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Trying to abort 1 pending ops.
I20260709 12:29:01.867501 20873 pending_rounds.cc:77] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7305626174302576640 op_type: NO_OP noop_request { }
I20260709 12:29:01.867893 20873 raft_consensus.cc:2889] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:01.868283 20873 raft_consensus.cc:2272] T 7c3076f64046458ab4e3df3dfdd2a8c1 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.870054 25606 leader_election.cc:336] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3e2fd10beaf04318be94c0a3430cef3e (127.20.98.65:34707): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34707: connect: Connection refused (error 111)
I20260709 12:29:01.870628 25606 leader_election.cc:304] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ecdd4cc5fb44b71b4e16e1dc06d61b6; no voters: 05cabf76554146489f61260dbdadf659, 3e2fd10beaf04318be94c0a3430cef3e
I20260709 12:29:01.871333 20873 tablet_replica.cc:333] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.871484 27702 raft_consensus.cc:2749] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:29:01.872318 20873 raft_consensus.cc:2243] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.873502 20873 raft_consensus.cc:2272] T d3837703213a42109c702302ad5f6c0d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.876338 20873 tablet_replica.cc:333] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.877157 20873 raft_consensus.cc:2243] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.878192 20873 raft_consensus.cc:2272] T 64358b60fab548429df4d7dc1d83a406 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.880919 20873 tablet_replica.cc:333] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.881760 20873 raft_consensus.cc:2243] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.882457 20873 raft_consensus.cc:2272] T 9893e663e5c94468ac06743c6cbcec9d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.885272 20873 tablet_replica.cc:333] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.886132 20873 raft_consensus.cc:2243] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.886715 20873 raft_consensus.cc:2272] T 8cc486747ff742b4a5b17a179125bbfd P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.890097 20873 tablet_replica.cc:333] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.890921 20873 raft_consensus.cc:2243] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.891553 20873 raft_consensus.cc:2272] T 01a03988797840b79a9c026cc8b293a7 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.894197 20873 tablet_replica.cc:333] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.895049 20873 raft_consensus.cc:2243] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.895635 20873 raft_consensus.cc:2272] T cb631167f2654873a2976c1c5e2617de P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.898368 20873 tablet_replica.cc:333] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.899650 20873 raft_consensus.cc:2243] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.900667 20873 raft_consensus.cc:2272] T 21d58e43edb84946ae592af63b28862c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.903365 20873 tablet_replica.cc:333] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.904196 20873 raft_consensus.cc:2243] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.904804 20873 raft_consensus.cc:2272] T b412956a26e641d181700046c55c1456 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.907531 20873 tablet_replica.cc:333] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.908362 20873 raft_consensus.cc:2243] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.908938 20873 raft_consensus.cc:2272] T 5117c622cec24a8fb3f80b35f2d10db8 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.911723 20873 tablet_replica.cc:333] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.912539 20873 raft_consensus.cc:2243] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.913599 20873 raft_consensus.cc:2272] T 91cdf689f66f41ffaf423525144f0f34 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.916227 20873 tablet_replica.cc:333] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.917099 20873 raft_consensus.cc:2243] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.917693 20873 raft_consensus.cc:2272] T 19b643e26e28481e80dd52e2609d357d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.920236 20873 tablet_replica.cc:333] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.921022 20873 raft_consensus.cc:2243] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.921675 20873 raft_consensus.cc:2272] T ed5b1adb31b64ffdb249abd286df3062 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.924449 20873 tablet_replica.cc:333] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.925328 20873 raft_consensus.cc:2243] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.925916 20873 raft_consensus.cc:2272] T 18fe232132fe484c84a12165ab35ea2a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.928841 20873 tablet_replica.cc:333] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.929708 20873 raft_consensus.cc:2243] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.930441 20873 raft_consensus.cc:2272] T fbf093f8ce6c4c699a8c0589bc191c66 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.933149 20873 tablet_replica.cc:333] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.934018 20873 raft_consensus.cc:2243] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.934597 20873 raft_consensus.cc:2272] T 43c409decd6b41e38642164bc29adcac P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.937242 20873 tablet_replica.cc:333] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.938159 20873 raft_consensus.cc:2243] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.938776 20873 raft_consensus.cc:2272] T 8d58760f1c094ef78273fe3f2ce60924 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.941977 20873 tablet_replica.cc:333] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.942829 20873 raft_consensus.cc:2243] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.943470 20873 raft_consensus.cc:2272] T 2a5d533e66e74b518a0074545fd8e96a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.946390 20873 tablet_replica.cc:333] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.947268 20873 raft_consensus.cc:2243] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.947835 20873 raft_consensus.cc:2272] T e612523c0021486da0ab8d3a964ad76c P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.950843 20873 tablet_replica.cc:333] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.951759 20873 raft_consensus.cc:2243] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.952904 20873 raft_consensus.cc:2272] T c468ba201aea46e79fb35a4ec3df27d9 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.955931 20873 tablet_replica.cc:333] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.956807 20873 raft_consensus.cc:2243] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.957976 20873 raft_consensus.cc:2272] T 66e0430567d64e6887cc879e2e9b3d61 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.960889 20873 tablet_replica.cc:333] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.961741 20873 raft_consensus.cc:2243] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.962373 20873 raft_consensus.cc:2272] T d0af0dee12bd4a1c9b0b4cdca091a4ea P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.965430 20873 tablet_replica.cc:333] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.966311 20873 raft_consensus.cc:2243] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.966929 20873 raft_consensus.cc:2272] T 4cd7967167e543ae8d82c4880099f27e P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.969774 20873 tablet_replica.cc:333] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.970561 20873 raft_consensus.cc:2243] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.971633 20873 raft_consensus.cc:2272] T 4c6db57a7db04a8a8d0736539285c239 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.974454 20873 tablet_replica.cc:333] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.975322 20873 raft_consensus.cc:2243] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.975950 20873 raft_consensus.cc:2272] T 919fd4e8dca6404ea25c7dcee45b6a97 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.979169 20873 tablet_replica.cc:333] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.980298 20873 raft_consensus.cc:2243] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.981017 20873 raft_consensus.cc:2272] T 03a9d87c866a43c1aaad7aca6383189a P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.984004 20873 tablet_replica.cc:333] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.984807 20873 raft_consensus.cc:2243] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.985968 20873 raft_consensus.cc:2272] T 8e182cd9691849a9b13a7c77dde34629 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.988775 20873 tablet_replica.cc:333] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.989609 20873 raft_consensus.cc:2243] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.990731 20873 raft_consensus.cc:2272] T 13eaa197620646c59092c991e745b86d P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.993875 20873 tablet_replica.cc:333] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.994740 20873 raft_consensus.cc:2243] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.995319 20873 raft_consensus.cc:2272] T 67c21509d83b4939a1a492dbd10b3acb P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.998049 20873 tablet_replica.cc:333] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:01.998832 20873 raft_consensus.cc:2243] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.000371 20873 raft_consensus.cc:2272] T 7749b2664d48431c84785782eb9c6580 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.003512 20873 tablet_replica.cc:333] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.004319 20873 raft_consensus.cc:2243] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.004909 20873 raft_consensus.cc:2272] T c3271013e0434415b390de1bd1aab244 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.008069 20873 tablet_replica.cc:333] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.008903 20873 raft_consensus.cc:2243] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.010092 20873 raft_consensus.cc:2272] T 224263ffd6b64b1c8cba6c27db4d5c4f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.012966 20873 tablet_replica.cc:333] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.013932 20873 raft_consensus.cc:2243] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.014701 20873 raft_consensus.cc:2272] T f2b0ab9ea8a441e5af5bf911f5c0a649 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.017542 20873 tablet_replica.cc:333] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.018309 20873 raft_consensus.cc:2243] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.019472 20873 raft_consensus.cc:2272] T 340dfb91e8e44fdfaf0b420eefa9df9f P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.022296 20873 tablet_replica.cc:333] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.023062 20873 raft_consensus.cc:2243] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.023650 20873 raft_consensus.cc:2272] T 80a46b4dd44940dc911e876c097f12fe P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.026486 20873 tablet_replica.cc:333] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.027232 20873 raft_consensus.cc:2243] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.028290 20873 pending_rounds.cc:70] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Trying to abort 1 pending ops.
I20260709 12:29:02.028537 20873 pending_rounds.cc:77] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: Aborting op as it isn't in flight: id { term: 6 index: 6 } timestamp: 7305626175058984960 op_type: NO_OP noop_request { }
I20260709 12:29:02.028879 20873 raft_consensus.cc:2889] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:02.029243 20873 raft_consensus.cc:2272] T 3cd86abda6394bcfa1249aef297ea152 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.032015 20873 tablet_replica.cc:333] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.032817 20873 raft_consensus.cc:2243] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.033455 20873 raft_consensus.cc:2272] T 4f2d902711df4cea9b3d41edac3a3a48 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.036494 20873 tablet_replica.cc:333] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.037246 20873 raft_consensus.cc:2243] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.038347 20873 raft_consensus.cc:2272] T 1704016a67e740008ce23d578992ecaa P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.041417 20873 tablet_replica.cc:333] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6: stopping tablet replica
I20260709 12:29:02.042150 20873 raft_consensus.cc:2243] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.042725 20873 raft_consensus.cc:2272] T 3c33d5ee86514aeda0b963d59db594a2 P 0ecdd4cc5fb44b71b4e16e1dc06d61b6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.979640 20873 tablet_server.cc:196] TabletServer@127.20.98.68:0 shutdown complete.
I20260709 12:29:03.081810 20873 master.cc:562] Master@127.20.98.126:39987 shutting down...
I20260709 12:29:03.131080 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:03.131824 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.132244 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1a88150b214a4290a4d5e533b9c0457e: stopping tablet replica
I20260709 12:29:03.196306 20873 master.cc:584] Master@127.20.98.126:39987 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (68232 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:29:03.290539 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:33791
I20260709 12:29:03.291692 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:03.297793 27744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:03.298120 27743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:03.298197 27746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:03.300518 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:03.302121 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:03.302306 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:03.302431 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600143302415 us; error 0 us; skew 500 ppm
I20260709 12:29:03.302902 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:03.305584 20873 webserver.cc:533] Webserver started at http://127.20.98.126:37655/ using document root <none> and password file <none>
I20260709 12:29:03.306082 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:03.306245 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:03.306499 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:03.307590 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "e75e04895670425c81113d1aa6aced7b"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.312126 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:03.315734 27751 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.316675 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:03.317021 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "e75e04895670425c81113d1aa6aced7b"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.317402 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:03.333519 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:03.334831 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:03.416535 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:33791
I20260709 12:29:03.416749 27803 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:33791 every 8 connection(s)
I20260709 12:29:03.421953 27804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:03.435441 27804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b: Bootstrap starting.
I20260709 12:29:03.440925 27804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.445796 27804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b: No bootstrap required, opened a new log
I20260709 12:29:03.448342 27804 raft_consensus.cc:359] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75e04895670425c81113d1aa6aced7b" member_type: VOTER }
I20260709 12:29:03.448908 27804 raft_consensus.cc:385] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.449262 27804 raft_consensus.cc:740] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e75e04895670425c81113d1aa6aced7b, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.449937 27804 consensus_queue.cc:260] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75e04895670425c81113d1aa6aced7b" member_type: VOTER }
I20260709 12:29:03.450456 27804 raft_consensus.cc:399] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:03.450736 27804 raft_consensus.cc:493] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:03.451056 27804 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.456207 27804 raft_consensus.cc:515] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75e04895670425c81113d1aa6aced7b" member_type: VOTER }
I20260709 12:29:03.456753 27804 leader_election.cc:304] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e75e04895670425c81113d1aa6aced7b; no voters: 
I20260709 12:29:03.462750 27804 leader_election.cc:290] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:03.463217 27807 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.465741 27807 raft_consensus.cc:697] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 1 LEADER]: Becoming Leader. State: Replica: e75e04895670425c81113d1aa6aced7b, State: Running, Role: LEADER
I20260709 12:29:03.466598 27807 consensus_queue.cc:237] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75e04895670425c81113d1aa6aced7b" member_type: VOTER }
I20260709 12:29:03.466960 27804 sys_catalog.cc:565] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:03.474598 27809 sys_catalog.cc:455] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e75e04895670425c81113d1aa6aced7b. Latest consensus state: current_term: 1 leader_uuid: "e75e04895670425c81113d1aa6aced7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75e04895670425c81113d1aa6aced7b" member_type: VOTER } }
I20260709 12:29:03.475564 27809 sys_catalog.cc:458] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:03.477588 27808 sys_catalog.cc:455] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e75e04895670425c81113d1aa6aced7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e75e04895670425c81113d1aa6aced7b" member_type: VOTER } }
I20260709 12:29:03.478456 27808 sys_catalog.cc:458] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:03.483361 27817 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:03.484599 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:03.488895 27817 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:03.498757 27817 catalog_manager.cc:1383] Generated new cluster ID: 6cd3fad8eafb4858925761ba144eb1ad
I20260709 12:29:03.499132 27817 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:03.516062 27817 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:03.517758 27817 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:03.539004 27817 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b: Generated new TSK 0
I20260709 12:29:03.539677 27817 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:03.551618 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:03.559755 27825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:03.560647 27826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:03.564350 27828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:03.564591 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:03.567176 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:03.567380 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:03.567525 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600143567509 us; error 0 us; skew 500 ppm
I20260709 12:29:03.568063 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:03.570892 20873 webserver.cc:533] Webserver started at http://127.20.98.65:38305/ using document root <none> and password file <none>
I20260709 12:29:03.571362 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:03.571533 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:03.571802 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:03.573130 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "9a03b376242c46cd820eacff320721b6"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.579869 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:03.584124 27833 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.584978 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:29:03.585363 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "9a03b376242c46cd820eacff320721b6"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.585639 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:03.601519 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:03.602962 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:03.604696 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:03.607417 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:03.607676 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.607955 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:03.608153 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.653812 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:34227
I20260709 12:29:03.653935 27895 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:34227 every 8 connection(s)
I20260709 12:29:03.659713 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:03.666839 27900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:03.668390 27901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:03.672043 20873 server_base.cc:1061] running on GCE node
W20260709 12:29:03.672370 27903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:03.674028 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:03.674304 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:03.674511 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600143674467 us; error 0 us; skew 500 ppm
I20260709 12:29:03.675308 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:03.678612 20873 webserver.cc:533] Webserver started at http://127.20.98.66:40859/ using document root <none> and password file <none>
I20260709 12:29:03.679075 27896 heartbeater.cc:344] Connected to a master server at 127.20.98.126:33791
I20260709 12:29:03.679374 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:03.679611 27896 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:03.679694 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:03.680130 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:03.680703 27896 heartbeater.cc:507] Master 127.20.98.126:33791 requested a full tablet report, sending...
I20260709 12:29:03.681939 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "c07d60134b7141c6aec9994aafdffb6d"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.683411 27768 ts_manager.cc:194] Registered new tserver with Master: 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227)
I20260709 12:29:03.685504 27768 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42408
I20260709 12:29:03.687377 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:29:03.691526 27908 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.692301 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:29:03.692700 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "c07d60134b7141c6aec9994aafdffb6d"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.692979 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:03.715487 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:03.716835 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:03.718459 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:03.720885 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:03.721122 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.721408 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:03.721592 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.763661 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:40443
I20260709 12:29:03.763787 27970 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:40443 every 8 connection(s)
I20260709 12:29:03.769140 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:03.777441 27974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:03.781286 27975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:03.785251 27977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:03.787213 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:03.788676 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:03.788959 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:03.789250 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600143789230 us; error 0 us; skew 500 ppm
I20260709 12:29:03.789531 27971 heartbeater.cc:344] Connected to a master server at 127.20.98.126:33791
I20260709 12:29:03.790055 27971 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:03.790226 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:03.791242 27971 heartbeater.cc:507] Master 127.20.98.126:33791 requested a full tablet report, sending...
I20260709 12:29:03.793411 20873 webserver.cc:533] Webserver started at http://127.20.98.67:35269/ using document root <none> and password file <none>
I20260709 12:29:03.794098 27768 ts_manager.cc:194] Registered new tserver with Master: c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:03.794234 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:03.794814 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:03.795356 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:03.796049 27768 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42414
I20260709 12:29:03.796723 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "f6f5b2279782499486c004421b2f4dc5"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.803277 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:29:03.807267 27982 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.808348 20873 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:29:03.808792 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "f6f5b2279782499486c004421b2f4dc5"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:03.809264 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:03.836201 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:03.837558 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:03.838894 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:03.841858 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:03.842170 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.842446 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:03.842619 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:03.885284 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:33411
I20260709 12:29:03.885461 28044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:33411 every 8 connection(s)
I20260709 12:29:03.900275 28045 heartbeater.cc:344] Connected to a master server at 127.20.98.126:33791
I20260709 12:29:03.900754 28045 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:03.901639 28045 heartbeater.cc:507] Master 127.20.98.126:33791 requested a full tablet report, sending...
I20260709 12:29:03.903632 27768 ts_manager.cc:194] Registered new tserver with Master: f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:03.904337 20873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015560715s
I20260709 12:29:03.905030 27768 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42422
I20260709 12:29:03.931449 27768 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42436:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:03.934487 27768 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:04.038342 27861 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd6aec33a594695826f64ae3a97fa86 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:04.039939 27861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd6aec33a594695826f64ae3a97fa86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.041347 27936 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd6aec33a594695826f64ae3a97fa86 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:04.042287 27935 tablet_service.cc:1511] Processing CreateTablet for tablet d88d3dcf02054ae39a33869ff8b6d81a (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:04.042837 27936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd6aec33a594695826f64ae3a97fa86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.043797 27935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88d3dcf02054ae39a33869ff8b6d81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.044966 28010 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd6aec33a594695826f64ae3a97fa86 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:04.046393 28010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd6aec33a594695826f64ae3a97fa86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.046934 27930 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6c40920c0d41208b6a56ad145e541e (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:04.047672 27933 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac4d14120c44fdaacd9a7572f20b2af (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:04.048381 27930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6c40920c0d41208b6a56ad145e541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.049104 27933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac4d14120c44fdaacd9a7572f20b2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.050710 28008 tablet_service.cc:1511] Processing CreateTablet for tablet 392b04dfa76c4fdfbe3d8d2316dad4dd (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:04.052251 28008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392b04dfa76c4fdfbe3d8d2316dad4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.052071 27932 tablet_service.cc:1511] Processing CreateTablet for tablet f57b11c122b8407c8ba4bf6197edf1a4 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:04.053736 27932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57b11c122b8407c8ba4bf6197edf1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.054749 28007 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac4d14120c44fdaacd9a7572f20b2af (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:04.056420 28007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac4d14120c44fdaacd9a7572f20b2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.056655 27860 tablet_service.cc:1511] Processing CreateTablet for tablet d88d3dcf02054ae39a33869ff8b6d81a (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:04.058058 27860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88d3dcf02054ae39a33869ff8b6d81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.058357 28005 tablet_service.cc:1511] Processing CreateTablet for tablet b6000eb157754ffba1e9979fe4b37ca2 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:04.059840 28005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6000eb157754ffba1e9979fe4b37ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.061784 28004 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6c40920c0d41208b6a56ad145e541e (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:04.063251 28004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6c40920c0d41208b6a56ad145e541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.065769 28003 tablet_service.cc:1511] Processing CreateTablet for tablet 43f6a267e3d0495b9f7d1eaad51a6b92 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:04.068827 28001 tablet_service.cc:1511] Processing CreateTablet for tablet 3afbb1d098c245af8cacb514544b7e53 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:04.070556 28001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afbb1d098c245af8cacb514544b7e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.073065 28006 tablet_service.cc:1511] Processing CreateTablet for tablet f57b11c122b8407c8ba4bf6197edf1a4 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:04.074785 28006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57b11c122b8407c8ba4bf6197edf1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.077155 28002 tablet_service.cc:1511] Processing CreateTablet for tablet dd9e3721b7ea4a2bae806b4730790b59 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:04.078883 28002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd9e3721b7ea4a2bae806b4730790b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.049257 28009 tablet_service.cc:1511] Processing CreateTablet for tablet d88d3dcf02054ae39a33869ff8b6d81a (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:04.081561 28009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88d3dcf02054ae39a33869ff8b6d81a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.050737 27931 tablet_service.cc:1511] Processing CreateTablet for tablet b6000eb157754ffba1e9979fe4b37ca2 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:04.083812 27931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6000eb157754ffba1e9979fe4b37ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.046422 27934 tablet_service.cc:1511] Processing CreateTablet for tablet 392b04dfa76c4fdfbe3d8d2316dad4dd (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:04.087081 27934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392b04dfa76c4fdfbe3d8d2316dad4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.088634 28003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f6a267e3d0495b9f7d1eaad51a6b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.090811 27929 tablet_service.cc:1511] Processing CreateTablet for tablet 43f6a267e3d0495b9f7d1eaad51a6b92 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:04.097076 27929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f6a267e3d0495b9f7d1eaad51a6b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.094202 27928 tablet_service.cc:1511] Processing CreateTablet for tablet dd9e3721b7ea4a2bae806b4730790b59 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:04.099174 27928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd9e3721b7ea4a2bae806b4730790b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.104709 27859 tablet_service.cc:1511] Processing CreateTablet for tablet 392b04dfa76c4fdfbe3d8d2316dad4dd (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:04.106236 27859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392b04dfa76c4fdfbe3d8d2316dad4dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.123530 27858 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac4d14120c44fdaacd9a7572f20b2af (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:04.125255 27858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac4d14120c44fdaacd9a7572f20b2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.125255 28060 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
I20260709 12:29:04.133252 28060 tablet_bootstrap.cc:654] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.134966 27857 tablet_service.cc:1511] Processing CreateTablet for tablet f57b11c122b8407c8ba4bf6197edf1a4 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:04.136583 27857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57b11c122b8407c8ba4bf6197edf1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.146039 27930 tablet_service.cc:1511] Processing CreateTablet for tablet 3afbb1d098c245af8cacb514544b7e53 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:04.147522 27930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afbb1d098c245af8cacb514544b7e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.151631 27856 tablet_service.cc:1511] Processing CreateTablet for tablet b6000eb157754ffba1e9979fe4b37ca2 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:04.153764 27856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6000eb157754ffba1e9979fe4b37ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.158847 28062 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.162878 27860 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6c40920c0d41208b6a56ad145e541e (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:04.164273 27860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6c40920c0d41208b6a56ad145e541e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.163924 27855 tablet_service.cc:1511] Processing CreateTablet for tablet 43f6a267e3d0495b9f7d1eaad51a6b92 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:04.165834 27855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f6a267e3d0495b9f7d1eaad51a6b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.175597 27854 tablet_service.cc:1511] Processing CreateTablet for tablet dd9e3721b7ea4a2bae806b4730790b59 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:04.178372 27854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd9e3721b7ea4a2bae806b4730790b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.206207 28062 tablet_bootstrap.cc:654] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.219575 27853 tablet_service.cc:1511] Processing CreateTablet for tablet 3afbb1d098c245af8cacb514544b7e53 (DEFAULT_TABLE table=test-workload [id=78048fcab4c64071b2b9a40639cb2fcb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:04.221589 27853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afbb1d098c245af8cacb514544b7e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:04.305505 28062 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.306155 28062 ts_tablet_manager.cc:1403] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.000s
I20260709 12:29:04.313722 28062 raft_consensus.cc:359] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.314751 28062 raft_consensus.cc:385] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.315147 28062 raft_consensus.cc:740] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.326453 28062 consensus_queue.cc:260] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.369657 28060 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.370262 28060 ts_tablet_manager.cc:1403] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.245s	user 0.103s	sys 0.136s
I20260709 12:29:04.376526 28064 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:04.382655 28060 raft_consensus.cc:359] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.383514 28060 raft_consensus.cc:385] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.383782 27896 heartbeater.cc:499] Master 127.20.98.126:33791 was elected leader, sending a full tablet report...
I20260709 12:29:04.385161 28062 ts_tablet_manager.cc:1434] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.075s	user 0.016s	sys 0.015s
I20260709 12:29:04.385960 28064 tablet_bootstrap.cc:654] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.386193 28062 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.383811 28060 raft_consensus.cc:740] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.389249 28060 consensus_queue.cc:260] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.394557 28062 tablet_bootstrap.cc:654] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.398129 27971 heartbeater.cc:499] Master 127.20.98.126:33791 was elected leader, sending a full tablet report...
I20260709 12:29:04.398737 28060 ts_tablet_manager.cc:1434] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.009s
I20260709 12:29:04.400110 28060 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
W20260709 12:29:04.408954 27897 tablet.cc:2406] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:29:04.409257 28060 tablet_bootstrap.cc:654] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.448406 28064 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:04.448966 28064 ts_tablet_manager.cc:1403] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.073s	user 0.028s	sys 0.038s
I20260709 12:29:04.449486 28062 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.449891 28060 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.450110 28062 ts_tablet_manager.cc:1403] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.038s
I20260709 12:29:04.450484 28060 ts_tablet_manager.cc:1403] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.024s
I20260709 12:29:04.452168 28064 raft_consensus.cc:359] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.453037 28064 raft_consensus.cc:385] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.453389 28064 raft_consensus.cc:740] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.454002 28062 raft_consensus.cc:359] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.454078 28060 raft_consensus.cc:359] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.454317 28064 consensus_queue.cc:260] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.455022 28062 raft_consensus.cc:385] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.455063 28060 raft_consensus.cc:385] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.455765 28060 raft_consensus.cc:740] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.455691 28062 raft_consensus.cc:740] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.456833 28060 consensus_queue.cc:260] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.457307 28062 consensus_queue.cc:260] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.461309 28064 ts_tablet_manager.cc:1434] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:29:04.461750 28062 ts_tablet_manager.cc:1434] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:29:04.462100 28045 heartbeater.cc:499] Master 127.20.98.126:33791 was elected leader, sending a full tablet report...
I20260709 12:29:04.462868 28062 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.468331 28064 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:04.470230 28062 tablet_bootstrap.cc:654] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.459242 28060 ts_tablet_manager.cc:1434] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:04.476342 28060 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
I20260709 12:29:04.477546 28067 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.477066 28064 tablet_bootstrap.cc:654] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.478250 28067 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
W20260709 12:29:04.478228 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:04.483438 28067 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.483963 28060 tablet_bootstrap.cc:654] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.487751 28062 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.488446 28062 ts_tablet_manager.cc:1403] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 12:29:04.491937 28062 raft_consensus.cc:359] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.493111 28062 raft_consensus.cc:385] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.493513 28062 raft_consensus.cc:740] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.494503 28062 consensus_queue.cc:260] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.498944 28062 ts_tablet_manager.cc:1434] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:29:04.500154 28062 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.503543 28064 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:04.504205 28064 ts_tablet_manager.cc:1403] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.008s
I20260709 12:29:04.506414 28060 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.507032 28060 ts_tablet_manager.cc:1403] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.007s
I20260709 12:29:04.507519 28064 raft_consensus.cc:359] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.508315 28064 raft_consensus.cc:385] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.508617 28064 raft_consensus.cc:740] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.509411 28064 consensus_queue.cc:260] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.509984 28060 raft_consensus.cc:359] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.510638 28060 raft_consensus.cc:385] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.510878 28060 raft_consensus.cc:740] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.511551 28060 consensus_queue.cc:260] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.515514 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.516969 28064 ts_tablet_manager.cc:1434] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 12:29:04.517897 28060 ts_tablet_manager.cc:1434] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:29:04.518224 28064 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
W20260709 12:29:04.518690 27909 leader_election.cc:343] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.516911 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.520596 28060 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
W20260709 12:29:04.521319 27909 leader_election.cc:343] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.521782 27909 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d; no voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:04.521978 28067 raft_consensus.cc:493] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.522514 28067 raft_consensus.cc:515] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.524593 28067 leader_election.cc:290] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.525120 28067 raft_consensus.cc:2749] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:04.528803 28060 tablet_bootstrap.cc:654] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.531010 28062 tablet_bootstrap.cc:654] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.535753 28064 tablet_bootstrap.cc:654] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.539402 28060 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.539871 28060 ts_tablet_manager.cc:1403] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 12:29:04.542541 28060 raft_consensus.cc:359] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.543318 28060 raft_consensus.cc:385] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.543656 28060 raft_consensus.cc:740] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.543004 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.544590 28020 raft_consensus.cc:2468] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 0.
I20260709 12:29:04.542999 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.544837 28060 consensus_queue.cc:260] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.545938 27909 leader_election.cc:304] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:04.546782 28067 raft_consensus.cc:2804] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:04.547153 28067 raft_consensus.cc:493] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.547564 28067 raft_consensus.cc:3060] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.547740 28060 ts_tablet_manager.cc:1434] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:04.549131 28060 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
W20260709 12:29:04.553596 27909 leader_election.cc:343] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.556818 28067 raft_consensus.cc:515] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.558365 28060 tablet_bootstrap.cc:654] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.561115 28067 leader_election.cc:290] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.559338 28062 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.561975 28062 ts_tablet_manager.cc:1403] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.013s
I20260709 12:29:04.561792 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:04.562141 28064 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:04.563011 28064 ts_tablet_manager.cc:1403] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.007s
I20260709 12:29:04.563367 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:04.564028 28020 raft_consensus.cc:3060] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.566068 28062 raft_consensus.cc:359] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.566825 28062 raft_consensus.cc:385] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.567124 28062 raft_consensus.cc:740] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.567835 28065 raft_consensus.cc:493] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.567648 28064 raft_consensus.cc:359] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.568578 28065 raft_consensus.cc:515] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.568835 28064 raft_consensus.cc:385] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.569432 28064 raft_consensus.cc:740] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.569607 28070 raft_consensus.cc:493] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:04.570340 27909 leader_election.cc:343] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.570237 28070 raft_consensus.cc:515] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.571277 28065 leader_election.cc:290] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.574090 28020 raft_consensus.cc:2468] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:04.576663 28070 leader_election.cc:290] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:04.575606 27909 leader_election.cc:304] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6
I20260709 12:29:04.579214 28067 raft_consensus.cc:2804] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:04.580013 28067 raft_consensus.cc:697] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:04.580857 28067 consensus_queue.cc:237] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.586160 28064 consensus_queue.cc:260] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.598755 28064 ts_tablet_manager.cc:1434] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:29:04.605517 28062 consensus_queue.cc:260] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.611578 28062 ts_tablet_manager.cc:1434] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:29:04.612736 28062 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.607095 28060 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.613555 28060 ts_tablet_manager.cc:1403] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.023s
I20260709 12:29:04.617106 28060 raft_consensus.cc:359] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.618036 28060 raft_consensus.cc:385] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.618355 28060 raft_consensus.cc:740] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.623488 28065 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.624053 28065 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.623776 27767 catalog_manager.cc:5697] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 0 to 1, leader changed from <none> to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 1 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:04.625818 28065 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.625533 28060 consensus_queue.cc:260] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.632943 28062 tablet_bootstrap.cc:654] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.637840 28060 ts_tablet_manager.cc:1434] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 12:29:04.639032 28060 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
I20260709 12:29:04.640780 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.621212 28064 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:04.641533 27871 raft_consensus.cc:2468] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 0.
I20260709 12:29:04.643523 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.645659 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.646092 28060 tablet_bootstrap.cc:654] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.646267 27946 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a03b376242c46cd820eacff320721b6 in term 0.
W20260709 12:29:04.648021 27834 leader_election.cc:343] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.648772 27834 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
I20260709 12:29:04.650251 27983 leader_election.cc:304] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:04.651312 28065 raft_consensus.cc:2804] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:04.651865 28065 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.652315 28065 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.655615 28064 tablet_bootstrap.cc:654] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.664187 28065 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.665422 28070 raft_consensus.cc:2804] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:04.676191 28070 raft_consensus.cc:493] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.676712 28070 raft_consensus.cc:3060] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.667284 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.670150 28062 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.680197 27946 raft_consensus.cc:2468] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 0.
I20260709 12:29:04.680708 28062 ts_tablet_manager.cc:1403] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.004s
I20260709 12:29:04.674686 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.675210 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.687305 28062 raft_consensus.cc:359] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.688535 28062 raft_consensus.cc:385] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.688968 28062 raft_consensus.cc:740] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.690268 28062 consensus_queue.cc:260] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.697818 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:04.698625 27946 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.711090 28062 ts_tablet_manager.cc:1434] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 12:29:04.712284 28062 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.713428 28065 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Requested vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.715374 28070 raft_consensus.cc:515] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.716754 28067 raft_consensus.cc:493] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.717324 28067 raft_consensus.cc:515] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.719174 28094 raft_consensus.cc:493] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.719643 28067 leader_election.cc:290] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.720126 28062 tablet_bootstrap.cc:654] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.719761 28094 raft_consensus.cc:515] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.721767 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6000eb157754ffba1e9979fe4b37ca2" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
W20260709 12:29:04.722227 27834 leader_election.cc:343] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.722726 27834 leader_election.cc:304] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a03b376242c46cd820eacff320721b6; no voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5
W20260709 12:29:04.724020 27909 leader_election.cc:343] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:04.724215 27834 leader_election.cc:343] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.725606 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6000eb157754ffba1e9979fe4b37ca2" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.726270 27871 raft_consensus.cc:2468] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 0.
I20260709 12:29:04.726882 28060 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.727402 28060 ts_tablet_manager.cc:1403] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.050s
I20260709 12:29:04.727957 28064 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:04.728570 27909 leader_election.cc:304] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:04.728793 28064 ts_tablet_manager.cc:1403] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.108s	user 0.031s	sys 0.017s
I20260709 12:29:04.729817 28067 raft_consensus.cc:2804] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:04.730676 28067 raft_consensus.cc:493] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.730827 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:04.731237 28067 raft_consensus.cc:3060] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.731571 27946 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a03b376242c46cd820eacff320721b6 in term 1.
W20260709 12:29:04.732153 27834 leader_election.cc:343] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.732908 27834 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:04.733196 28070 leader_election.cc:290] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:04.733740 28065 raft_consensus.cc:2804] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:04.735966 28094 leader_election.cc:290] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:04.736523 28065 raft_consensus.cc:697] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: Becoming Leader. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Running, Role: LEADER
I20260709 12:29:04.737205 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:04.737843 27871 raft_consensus.cc:3060] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.737466 28065 consensus_queue.cc:237] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.742259 28067 raft_consensus.cc:515] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.745062 27870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6000eb157754ffba1e9979fe4b37ca2" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:04.745337 28062 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.745739 27870 raft_consensus.cc:3060] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.746174 28062 ts_tablet_manager.cc:1403] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.023s
I20260709 12:29:04.747483 28064 raft_consensus.cc:359] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.748327 28064 raft_consensus.cc:385] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.748673 28064 raft_consensus.cc:740] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.729907 28095 raft_consensus.cc:2749] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:04.748817 27869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.747489 27871 raft_consensus.cc:2468] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 1.
I20260709 12:29:04.749977 28062 raft_consensus.cc:359] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.750875 28062 raft_consensus.cc:385] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.751246 28062 raft_consensus.cc:740] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.751485 28067 leader_election.cc:290] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.751715 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.752367 28062 consensus_queue.cc:260] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.752380 28064 consensus_queue.cc:260] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.753846 27870 raft_consensus.cc:2468] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:04.753954 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6000eb157754ffba1e9979fe4b37ca2" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:04.754711 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:04.755200 28064 ts_tablet_manager.cc:1434] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:29:04.755343 27946 raft_consensus.cc:3060] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:04.755437 27909 leader_election.cc:343] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.755615 28062 ts_tablet_manager.cc:1434] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:29:04.757205 27909 leader_election.cc:304] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:04.757499 28095 raft_consensus.cc:493] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.758396 28067 raft_consensus.cc:2804] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:04.758069 28095 raft_consensus.cc:515] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.757009 28062 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.760416 28095 leader_election.cc:290] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.759877 28064 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:04.762333 28067 raft_consensus.cc:697] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:04.762056 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.763273 28067 consensus_queue.cc:237] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
W20260709 12:29:04.763770 27834 leader_election.cc:343] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:04.761548 27983 leader_election.cc:343] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:04.764925 27983 leader_election.cc:343] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.765378 27983 leader_election.cc:304] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:04.766181 28094 raft_consensus.cc:2749] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:04.766623 27983 leader_election.cc:304] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:04.768095 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.768028 28060 raft_consensus.cc:359] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.769132 28060 raft_consensus.cc:385] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.769527 28094 raft_consensus.cc:2804] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:04.769531 28060 raft_consensus.cc:740] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.770514 28094 raft_consensus.cc:697] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:04.770562 28060 consensus_queue.cc:260] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.771507 28094 consensus_queue.cc:237] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
W20260709 12:29:04.772118 27834 leader_election.cc:343] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.772667 27834 leader_election.cc:304] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a03b376242c46cd820eacff320721b6; no voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:04.773480 28095 raft_consensus.cc:2749] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:04.776046 28060 ts_tablet_manager.cc:1434] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:29:04.776964 28062 tablet_bootstrap.cc:654] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.776964 28064 tablet_bootstrap.cc:654] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.780409 27946 raft_consensus.cc:2468] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 1.
I20260709 12:29:04.788763 28060 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
I20260709 12:29:04.790693 27767 catalog_manager.cc:5697] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:04.791816 27766 catalog_manager.cc:5697] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a03b376242c46cd820eacff320721b6 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "9a03b376242c46cd820eacff320721b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:04.798530 28060 tablet_bootstrap.cc:654] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.810822 28062 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.810822 28064 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:04.811947 28062 ts_tablet_manager.cc:1403] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.007s
I20260709 12:29:04.812042 28064 ts_tablet_manager.cc:1403] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.013s
I20260709 12:29:04.815580 28062 raft_consensus.cc:359] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.816458 28062 raft_consensus.cc:385] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.816835 28062 raft_consensus.cc:740] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.817900 28062 consensus_queue.cc:260] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.820020 28060 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.820596 28062 ts_tablet_manager.cc:1434] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:29:04.820592 28060 ts_tablet_manager.cc:1403] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.000s
I20260709 12:29:04.820786 27766 catalog_manager.cc:5697] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 0 to 1, leader changed from <none> to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 1 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:04.822068 28062 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.824189 28060 raft_consensus.cc:359] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.824729 28060 raft_consensus.cc:385] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.825037 28060 raft_consensus.cc:740] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.825832 28060 consensus_queue.cc:260] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.827627 28060 ts_tablet_manager.cc:1434] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:04.828603 28060 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
I20260709 12:29:04.830391 28062 tablet_bootstrap.cc:654] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.834362 28064 raft_consensus.cc:359] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.835502 28064 raft_consensus.cc:385] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.835916 28064 raft_consensus.cc:740] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.836210 28060 tablet_bootstrap.cc:654] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.837221 28064 consensus_queue.cc:260] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.841717 28062 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.842309 28062 ts_tablet_manager.cc:1403] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 12:29:04.844776 28094 raft_consensus.cc:493] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.845527 28062 raft_consensus.cc:359] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.845507 28094 raft_consensus.cc:515] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.847131 28064 ts_tablet_manager.cc:1434] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:29:04.848639 28064 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:04.849093 27870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.851617 28094 leader_election.cc:290] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:04.851874 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.852315 28062 raft_consensus.cc:385] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.852792 28062 raft_consensus.cc:740] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
W20260709 12:29:04.853602 27983 leader_election.cc:343] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.853732 28062 consensus_queue.cc:260] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.854866 27870 raft_consensus.cc:2468] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 0.
I20260709 12:29:04.857658 28064 tablet_bootstrap.cc:654] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.858863 27983 leader_election.cc:304] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:04.859898 28062 ts_tablet_manager.cc:1434] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:29:04.860349 28094 raft_consensus.cc:2804] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:04.860788 28094 raft_consensus.cc:493] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.860885 28062 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.863694 28060 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.864239 28060 ts_tablet_manager.cc:1403] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.008s
I20260709 12:29:04.861202 28094 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.867151 28060 raft_consensus.cc:359] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.867882 28060 raft_consensus.cc:385] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.868240 28062 tablet_bootstrap.cc:654] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.868175 28060 raft_consensus.cc:740] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.869132 28060 consensus_queue.cc:260] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.871281 28060 ts_tablet_manager.cc:1434] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:04.872454 28060 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
I20260709 12:29:04.873274 28067 raft_consensus.cc:493] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.873795 28067 raft_consensus.cc:515] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.875989 28067 leader_election.cc:290] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.878008 27870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.878621 28060 tablet_bootstrap.cc:654] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.878430 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.879226 28019 raft_consensus.cc:2468] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 0.
I20260709 12:29:04.882226 28062 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.882742 28062 ts_tablet_manager.cc:1403] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 12:29:04.883195 27909 leader_election.cc:304] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
W20260709 12:29:04.884205 27909 leader_election.cc:343] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:04.885118 28067 raft_consensus.cc:2804] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:04.885560 28067 raft_consensus.cc:493] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.885996 28067 raft_consensus.cc:3060] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.885646 28062 raft_consensus.cc:359] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.886401 28062 raft_consensus.cc:385] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.886665 28062 raft_consensus.cc:740] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.887348 28062 consensus_queue.cc:260] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.889585 28062 ts_tablet_manager.cc:1434] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:04.890535 28062 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:04.897397 28067 raft_consensus.cc:515] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.899125 28062 tablet_bootstrap.cc:654] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.913411 27870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:04.914086 27870 raft_consensus.cc:3060] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.923743 27870 raft_consensus.cc:2468] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:04.900542 28094 raft_consensus.cc:515] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.925762 28067 leader_election.cc:290] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.926741 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:04.930032 28019 raft_consensus.cc:3060] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.930333 27909 leader_election.cc:304] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
I20260709 12:29:04.932736 28094 leader_election.cc:290] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:04.933665 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:04.927695 28076 raft_consensus.cc:493] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.935706 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:04.935539 28076 raft_consensus.cc:515] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.936571 27871 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.938632 28076 leader_election.cc:290] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411), 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227)
I20260709 12:29:04.939428 28076 raft_consensus.cc:2804] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:04.939987 28076 raft_consensus.cc:697] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:04.940644 27946 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.941000 28076 consensus_queue.cc:237] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.944077 28060 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.944585 28060 ts_tablet_manager.cc:1403] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.072s	user 0.027s	sys 0.035s
I20260709 12:29:04.946170 27871 raft_consensus.cc:2468] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 1.
I20260709 12:29:04.947574 27983 leader_election.cc:304] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:04.947786 28060 raft_consensus.cc:359] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.948536 28060 raft_consensus.cc:385] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.948908 28060 raft_consensus.cc:740] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.929014 28064 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:04.953509 28064 ts_tablet_manager.cc:1403] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.105s	user 0.033s	sys 0.032s
I20260709 12:29:04.956774 27946 raft_consensus.cc:2468] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 1.
I20260709 12:29:04.928534 28062 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: No bootstrap required, opened a new log
I20260709 12:29:04.957733 28062 ts_tablet_manager.cc:1403] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.007s
I20260709 12:29:04.958516 28064 raft_consensus.cc:359] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.959781 28064 raft_consensus.cc:385] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.959263 27766 catalog_manager.cc:5697] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 0 to 1, leader changed from <none> to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 1 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:04.961508 28064 raft_consensus.cc:740] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.962411 28070 raft_consensus.cc:493] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.962955 28070 raft_consensus.cc:515] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.962930 28064 consensus_queue.cc:260] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.965423 28070 leader_election.cc:290] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:04.967245 28019 raft_consensus.cc:2468] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:04.960599 28062 raft_consensus.cc:359] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.969969 28062 raft_consensus.cc:385] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:04.953533 28060 consensus_queue.cc:260] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.970320 28062 raft_consensus.cc:740] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:04.971170 28062 consensus_queue.cc:260] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.971597 27870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.972023 28060 ts_tablet_manager.cc:1434] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:29:04.972477 27870 raft_consensus.cc:2393] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c07d60134b7141c6aec9994aafdffb6d in current term 1: Already voted for candidate f6f5b2279782499486c004421b2f4dc5 in this term.
I20260709 12:29:04.969848 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6000eb157754ffba1e9979fe4b37ca2" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:04.973760 27871 raft_consensus.cc:2393] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 1: Already voted for candidate c07d60134b7141c6aec9994aafdffb6d in this term.
I20260709 12:29:04.973042 28060 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d: Bootstrap starting.
I20260709 12:29:04.974886 28062 ts_tablet_manager.cc:1434] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:29:04.970372 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.980715 28060 tablet_bootstrap.cc:654] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:04.982759 28064 ts_tablet_manager.cc:1434] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.007s
I20260709 12:29:04.983909 28064 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:04.989985 28065 raft_consensus.cc:493] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.990531 28065 raft_consensus.cc:515] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.949082 28094 raft_consensus.cc:2804] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:04.992570 28094 raft_consensus.cc:697] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:04.992755 28065 leader_election.cc:290] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:04.993721 28094 consensus_queue.cc:237] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:04.994920 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.995642 27945 raft_consensus.cc:2468] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a03b376242c46cd820eacff320721b6 in term 0.
I20260709 12:29:04.996320 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:04.996733 28060 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d: No bootstrap required, opened a new log
I20260709 12:29:04.996795 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6000eb157754ffba1e9979fe4b37ca2" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:04.997339 27834 leader_election.cc:304] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
I20260709 12:29:04.997550 28065 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.997326 28060 ts_tablet_manager.cc:1403] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 12:29:04.998212 28065 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:04.999337 28095 raft_consensus.cc:2804] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:04.999804 28095 raft_consensus.cc:493] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.000142 28095 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.001624 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:05.002333 28065 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:05.002223 28060 raft_consensus.cc:359] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.003091 28060 raft_consensus.cc:385] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.003412 28060 raft_consensus.cc:740] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.002358 27946 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a03b376242c46cd820eacff320721b6 in term 0.
I20260709 12:29:05.004109 28060 consensus_queue.cc:260] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.004840 27834 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
W20260709 12:29:05.006031 27834 leader_election.cc:343] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.006040 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:05.006703 28060 ts_tablet_manager.cc:1434] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:29:05.004890 28064 tablet_bootstrap.cc:654] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.008116 27983 leader_election.cc:304] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:05.008288 28111 raft_consensus.cc:493] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.009464 28113 raft_consensus.cc:3060] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:05.010104 27834 leader_election.cc:343] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.012253 28095 raft_consensus.cc:515] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.013182 28065 raft_consensus.cc:2804] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.015782 28065 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.016595 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:05.009042 28111 raft_consensus.cc:515] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.016853 28065 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:05.018134 27834 leader_election.cc:343] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.019479 28111 leader_election.cc:290] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:05.023245 28095 leader_election.cc:290] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Requested vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:05.025319 28065 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.026801 28064 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:05.027347 28064 ts_tablet_manager.cc:1403] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.000s
I20260709 12:29:05.028614 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:05.029321 27946 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.030462 28064 raft_consensus.cc:359] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.031168 28064 raft_consensus.cc:385] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.031492 28113 raft_consensus.cc:2749] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.031467 28064 raft_consensus.cc:740] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.032457 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:05.033540 27945 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.033315 28064 consensus_queue.cc:260] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.034253 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:05.034943 27871 raft_consensus.cc:2468] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 0.
I20260709 12:29:05.035919 28064 ts_tablet_manager.cc:1434] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:05.037147 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:05.037070 28064 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:05.037400 27946 raft_consensus.cc:2468] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a03b376242c46cd820eacff320721b6 in term 1.
I20260709 12:29:05.038620 27834 leader_election.cc:304] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:05.039847 27871 raft_consensus.cc:3060] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.040216 27909 leader_election.cc:304] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d; no voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:05.041085 28076 raft_consensus.cc:2749] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:29:05.041558 27909 leader_election.cc:343] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.042388 27909 leader_election.cc:304] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:05.043165 28076 raft_consensus.cc:2804] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.043560 28076 raft_consensus.cc:493] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.043805 28065 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Requested vote from peers c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:05.043898 28076 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.030052 27767 catalog_manager.cc:5697] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.045641 28064 tablet_bootstrap.cc:654] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.039857 28111 consensus_queue.cc:1048] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:29:05.047818 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "9a03b376242c46cd820eacff320721b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
W20260709 12:29:05.049376 27834 leader_election.cc:343] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.052125 27945 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a03b376242c46cd820eacff320721b6 in term 1.
I20260709 12:29:05.039913 28095 raft_consensus.cc:2804] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.053212 28095 raft_consensus.cc:697] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: Becoming Leader. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Running, Role: LEADER
I20260709 12:29:05.053440 27834 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:05.054131 28095 consensus_queue.cc:237] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.054584 28097 raft_consensus.cc:2804] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.055152 28097 raft_consensus.cc:697] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: Becoming Leader. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Running, Role: LEADER
I20260709 12:29:05.056077 28097 consensus_queue.cc:237] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.062796 28076 raft_consensus.cc:515] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.067128 28111 consensus_queue.cc:1048] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.071184 28076 leader_election.cc:290] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:05.072686 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:05.073733 27870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:05.075343 27870 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:05.075878 27909 leader_election.cc:343] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:05.074294 28064 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:05.079877 28064 ts_tablet_manager.cc:1403] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.007s
I20260709 12:29:05.081327 28113 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.082031 28113 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.082621 28064 raft_consensus.cc:359] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.083274 28064 raft_consensus.cc:385] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.083528 28064 raft_consensus.cc:740] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.084183 28064 consensus_queue.cc:260] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.085680 27869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:05.086236 28064 ts_tablet_manager.cc:1434] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:05.086483 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:05.087303 28064 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:05.087646 27945 raft_consensus.cc:2393] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 1: Already voted for candidate 9a03b376242c46cd820eacff320721b6 in this term.
I20260709 12:29:05.092679 27983 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:05.092733 28113 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:05.093685 28064 tablet_bootstrap.cc:654] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.099220 27765 catalog_manager.cc:5697] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a03b376242c46cd820eacff320721b6 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "9a03b376242c46cd820eacff320721b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.101361 28113 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.103282 28064 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:05.103777 28064 ts_tablet_manager.cc:1403] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:29:05.106216 28064 raft_consensus.cc:359] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.106854 28064 raft_consensus.cc:385] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.107120 28064 raft_consensus.cc:740] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.107934 28064 consensus_queue.cc:260] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.109916 28064 ts_tablet_manager.cc:1434] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:29:05.110978 28064 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5: Bootstrap starting.
I20260709 12:29:05.112125 28113 raft_consensus.cc:2749] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.116729 27870 raft_consensus.cc:2468] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:05.116966 28064 tablet_bootstrap.cc:654] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:05.120867 27909 leader_election.cc:304] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:05.122128 28076 raft_consensus.cc:2804] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.122649 28076 raft_consensus.cc:697] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:05.123553 28076 consensus_queue.cc:237] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.142921 27765 catalog_manager.cc:5697] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a03b376242c46cd820eacff320721b6 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "9a03b376242c46cd820eacff320721b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.157218 27767 catalog_manager.cc:5697] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 0 to 1, leader changed from <none> to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 1 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.159818 28064 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5: No bootstrap required, opened a new log
I20260709 12:29:05.160419 28064 ts_tablet_manager.cc:1403] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.024s
I20260709 12:29:05.163141 28064 raft_consensus.cc:359] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.163810 28064 raft_consensus.cc:385] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:05.164067 28064 raft_consensus.cc:740] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.164722 28064 consensus_queue.cc:260] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.167097 28064 ts_tablet_manager.cc:1434] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:29:05.177220 28095 consensus_queue.cc:1048] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.190392 28095 consensus_queue.cc:1048] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.223656 28113 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.223656 28111 consensus_queue.cc:1048] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.224416 28113 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.226678 28113 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:05.227973 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:05.228292 28113 consensus_queue.cc:1048] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.228621 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:05.229835 27945 raft_consensus.cc:2393] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 1: Already voted for candidate 9a03b376242c46cd820eacff320721b6 in this term.
I20260709 12:29:05.231097 27983 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:05.232259 28113 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.241529 28076 consensus_queue.cc:1048] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:05.248775 28094 consensus_queue.cc:1048] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.254287 28113 raft_consensus.cc:2749] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.267525 28111 raft_consensus.cc:493] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.268177 28111 raft_consensus.cc:515] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.271224 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:05.271822 27871 raft_consensus.cc:2468] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 0.
I20260709 12:29:05.276206 28113 raft_consensus.cc:493] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.276717 28113 raft_consensus.cc:515] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.277572 27909 leader_election.cc:304] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
I20260709 12:29:05.278507 28076 raft_consensus.cc:2804] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.278898 28076 raft_consensus.cc:493] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.279275 28076 raft_consensus.cc:3060] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.279517 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:05.280208 27871 raft_consensus.cc:2468] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 0.
I20260709 12:29:05.280436 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:05.281208 28113 leader_election.cc:290] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:05.281574 27983 leader_election.cc:304] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:05.282351 28111 leader_election.cc:290] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:05.282433 28113 raft_consensus.cc:2804] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:05.283044 28113 raft_consensus.cc:493] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:05.283409 28113 raft_consensus.cc:3060] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.283567 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:05.286213 28076 raft_consensus.cc:515] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.287308 27945 raft_consensus.cc:2393] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 1: Already voted for candidate c07d60134b7141c6aec9994aafdffb6d in this term.
I20260709 12:29:05.288404 28076 leader_election.cc:290] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:05.289619 27871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:05.289945 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:05.289646 28113 raft_consensus.cc:515] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.290469 27871 raft_consensus.cc:3060] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.290972 28070 raft_consensus.cc:493] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.291471 28019 raft_consensus.cc:2393] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c07d60134b7141c6aec9994aafdffb6d in current term 1: Already voted for candidate f6f5b2279782499486c004421b2f4dc5 in this term.
I20260709 12:29:05.291973 28113 leader_election.cc:290] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:05.291494 28070 raft_consensus.cc:515] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.294073 28070 leader_election.cc:290] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:05.294206 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:05.294551 27870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:05.295099 27945 raft_consensus.cc:2393] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 1: Already voted for candidate c07d60134b7141c6aec9994aafdffb6d in this term.
I20260709 12:29:05.295158 27869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:05.296021 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:05.296312 28070 raft_consensus.cc:493] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:05.296838 27946 raft_consensus.cc:2393] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 1: Already voted for candidate 9a03b376242c46cd820eacff320721b6 in this term.
I20260709 12:29:05.296788 28070 raft_consensus.cc:515] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.297052 27983 leader_election.cc:304] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:05.298513 28070 leader_election.cc:290] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:05.298954 28113 raft_consensus.cc:2749] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.298385 27983 leader_election.cc:304] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:05.299865 28113 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.300894 27869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a03b376242c46cd820eacff320721b6" is_pre_election: true
I20260709 12:29:05.301803 27869 raft_consensus.cc:2393] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 1: Already voted for candidate c07d60134b7141c6aec9994aafdffb6d in this term.
I20260709 12:29:05.301635 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:05.303393 27983 leader_election.cc:304] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:05.303771 27871 raft_consensus.cc:2468] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:05.305059 27909 leader_election.cc:304] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:05.306217 28076 raft_consensus.cc:2804] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:05.304318 28070 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:05.307356 28076 raft_consensus.cc:697] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:05.308662 28076 consensus_queue.cc:237] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:05.309590 28113 raft_consensus.cc:2749] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.314821 28070 raft_consensus.cc:2749] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:05.318595 27767 catalog_manager.cc:5697] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 0 to 1, leader changed from <none> to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 1 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:05.362074 28076 consensus_queue.cc:1048] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.373600 28067 consensus_queue.cc:1048] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.393520 20873 ts_manager.cc:295] Set tserver state for 9a03b376242c46cd820eacff320721b6 to MAINTENANCE_MODE
I20260709 12:29:05.394287 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
I20260709 12:29:05.417439 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:05.418344 20873 tablet_replica.cc:333] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.419240 20873 raft_consensus.cc:2243] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.419852 20873 pending_rounds.cc:70] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Trying to abort 1 pending ops.
I20260709 12:29:05.420027 20873 pending_rounds.cc:77] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626194152599552 op_type: NO_OP noop_request { }
I20260709 12:29:05.420298 20873 raft_consensus.cc:2889] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:05.420542 20873 raft_consensus.cc:2272] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.423260 20873 tablet_replica.cc:333] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.423794 20873 raft_consensus.cc:2243] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.424126 20873 raft_consensus.cc:2272] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.425907 20873 tablet_replica.cc:333] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.426530 20873 raft_consensus.cc:2243] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.426942 20873 raft_consensus.cc:2272] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.428097 27983 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 325 similar messages]
I20260709 12:29:05.429281 20873 tablet_replica.cc:333] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.430069 20873 raft_consensus.cc:2243] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.430558 20873 raft_consensus.cc:2272] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.431288 27983 consensus_peers.cc:597] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.432802 20873 tablet_replica.cc:333] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.433478 20873 raft_consensus.cc:2243] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.433885 20873 raft_consensus.cc:2272] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.435959 20873 tablet_replica.cc:333] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.436498 20873 raft_consensus.cc:2243] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.436872 20873 raft_consensus.cc:2272] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.438581 20873 tablet_replica.cc:333] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.439100 20873 raft_consensus.cc:2243] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.439518 20873 raft_consensus.cc:2272] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.441622 20873 tablet_replica.cc:333] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.442123 20873 raft_consensus.cc:2243] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.443101 20873 raft_consensus.cc:2272] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.445087 20873 tablet_replica.cc:333] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.445645 20873 raft_consensus.cc:2243] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.446206 20873 pending_rounds.cc:70] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Trying to abort 1 pending ops.
I20260709 12:29:05.446419 20873 pending_rounds.cc:77] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626194167517184 op_type: NO_OP noop_request { }
I20260709 12:29:05.446700 20873 raft_consensus.cc:2889] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:05.446969 20873 raft_consensus.cc:2272] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.448853 20873 tablet_replica.cc:333] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: stopping tablet replica
I20260709 12:29:05.449396 20873 raft_consensus.cc:2243] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.449767 20873 raft_consensus.cc:2272] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.473361 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
W20260709 12:29:05.483491 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:05.533957 28070 consensus_queue.cc:1048] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:29:05.553639 27909 consensus_peers.cc:597] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.641692 27983 consensus_peers.cc:597] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.659174 27909 consensus_peers.cc:597] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.735042 28067 consensus_queue.cc:1048] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:05.847851 27909 consensus_peers.cc:597] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.888320 27909 consensus_peers.cc:597] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.925230 28067 consensus_queue.cc:1048] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:05.931545 27909 consensus_peers.cc:597] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:06.484537 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:06.690721 28111 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a03b376242c46cd820eacff320721b6)
I20260709 12:29:06.691291 28111 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.693123 28111 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:06.694252 28094 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a03b376242c46cd820eacff320721b6)
I20260709 12:29:06.694808 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:06.694836 28094 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.696285 28019 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
W20260709 12:29:06.697757 27909 leader_election.cc:336] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.698882 27909 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6
I20260709 12:29:06.699060 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d" is_pre_election: true
I20260709 12:29:06.699795 27946 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 1.
I20260709 12:29:06.700228 28094 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:06.700997 27983 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:06.701084 28067 raft_consensus.cc:2804] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:06.701843 27983 leader_election.cc:336] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.701856 28094 raft_consensus.cc:2804] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.702342 28094 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a03b376242c46cd820eacff320721b6)
I20260709 12:29:06.702342 28067 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a03b376242c46cd820eacff320721b6)
I20260709 12:29:06.702805 28094 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.702893 28067 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.710285 28067 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.710285 28094 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.712548 28094 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:06.712548 28067 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:06.714205 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:06.714784 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:06.715024 28019 raft_consensus.cc:2393] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c07d60134b7141c6aec9994aafdffb6d in current term 2: Already voted for candidate f6f5b2279782499486c004421b2f4dc5 in this term.
I20260709 12:29:06.715616 27946 raft_consensus.cc:2393] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6f5b2279782499486c004421b2f4dc5 in current term 2: Already voted for candidate c07d60134b7141c6aec9994aafdffb6d in this term.
W20260709 12:29:06.717371 27983 leader_election.cc:336] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.717808 27983 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d
W20260709 12:29:06.717864 27909 leader_election.cc:336] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.718346 27909 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d; no voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:06.718487 28094 raft_consensus.cc:2749] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.719017 28067 raft_consensus.cc:2749] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.771842 28067 raft_consensus.cc:493] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.772322 28067 raft_consensus.cc:515] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.774305 28067 leader_election.cc:290] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:06.775826 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:06.776655 28019 raft_consensus.cc:2468] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:06.777824 27909 leader_election.cc:304] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
W20260709 12:29:06.778592 27909 leader_election.cc:336] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.778721 28067 raft_consensus.cc:2804] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.779213 28067 raft_consensus.cc:493] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:06.779532 28067 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.784792 28067 raft_consensus.cc:515] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.786600 28067 leader_election.cc:290] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:06.788206 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:06.788872 28019 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:06.790403 27909 leader_election.cc:336] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.794451 28019 raft_consensus.cc:2468] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 2.
I20260709 12:29:06.795521 27909 leader_election.cc:304] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6
I20260709 12:29:06.796200 28067 raft_consensus.cc:2804] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.796604 28067 raft_consensus.cc:697] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:06.797292 28067 consensus_queue.cc:237] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.805450 27767 catalog_manager.cc:5697] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 1 to 2, leader changed from 9a03b376242c46cd820eacff320721b6 (127.20.98.65) to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 2 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.974787 28067 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:06.975382 28067 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.977448 28067 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:06.979230 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:06.980026 28019 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 1.
I20260709 12:29:06.981065 27909 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:06.981819 28067 raft_consensus.cc:2804] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:29:06.981853 27909 leader_election.cc:336] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.982180 28067 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:06.982543 28067 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.987803 28067 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:06.989414 28067 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:06.990978 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:06.991571 28019 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:06.993273 27909 leader_election.cc:336] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:06.997459 28019 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 2.
I20260709 12:29:06.998591 27909 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6
I20260709 12:29:06.999933 28067 raft_consensus.cc:2804] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.000324 28067 raft_consensus.cc:697] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:07.001060 28067 consensus_queue.cc:237] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:07.008932 27767 catalog_manager.cc:5697] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 1 to 2, leader changed from 9a03b376242c46cd820eacff320721b6 (127.20.98.65) to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 2 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:07.233937 27909 consensus_peers.cc:597] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:07.299911 28019 raft_consensus.cc:1275] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:07.301275 28067 consensus_queue.cc:1048] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:07.421734 27909 consensus_peers.cc:597] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:07.485544 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:07.503528 28019 raft_consensus.cc:1275] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:07.505138 28067 consensus_queue.cc:1048] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:07.782105 27983 consensus_peers.cc:597] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:08.042128 27909 consensus_peers.cc:597] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:08.153687 27909 consensus_peers.cc:597] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:08.160524 27983 consensus_peers.cc:597] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:08.170617 27909 consensus_peers.cc:597] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:08.325331 28156 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:08.325897 28156 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:08.327783 28156 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:08.329232 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5" is_pre_election: true
I20260709 12:29:08.329861 28020 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 2.
I20260709 12:29:08.330991 27909 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:08.331622 28156 raft_consensus.cc:2804] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:29:08.331663 27909 leader_election.cc:336] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:08.332057 28156 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:08.332412 28156 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:08.337806 28156 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:08.339498 28156 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:08.340972 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:08.341610 28020 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:29:08.342691 27909 leader_election.cc:336] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111)
I20260709 12:29:08.347096 28020 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 3.
I20260709 12:29:08.348026 27909 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 9a03b376242c46cd820eacff320721b6
I20260709 12:29:08.348598 28156 raft_consensus.cc:2804] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:08.349534 28156 raft_consensus.cc:697] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:08.350379 28156 consensus_queue.cc:237] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:08.357457 27767 catalog_manager.cc:5697] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 1 to 3, leader changed from 9a03b376242c46cd820eacff320721b6 (127.20.98.65) to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 3 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:08.462246 27909 consensus_peers.cc:597] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:08.486513 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:08.558805 27909 consensus_peers.cc:597] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:08.771612 27909 consensus_peers.cc:597] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:08.961443 28020 raft_consensus.cc:1275] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:08.962761 28156 consensus_queue.cc:1048] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:09.423489 27909 consensus_peers.cc:597] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:09.487581 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:09.958247 27909 consensus_peers.cc:597] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:10.443733 27909 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111) [suppressed 96 similar messages]
W20260709 12:29:10.488765 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:10.492238 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:10.499332 28167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:10.500931 28168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:10.501384 28170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:10.504073 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:10.506605 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:10.506806 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:10.506939 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600150506928 us; error 0 us; skew 500 ppm
I20260709 12:29:10.507457 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:10.509939 20873 webserver.cc:533] Webserver started at http://127.20.98.65:38305/ using document root <none> and password file <none>
I20260709 12:29:10.510445 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:10.510594 20873 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:29:10.514125 20873 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:29:10.517910 28175 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:10.518796 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.003s
I20260709 12:29:10.519059 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "9a03b376242c46cd820eacff320721b6"
format_stamp: "Formatted at 2026-07-09 12:29:03 on dist-test-slave-g3x6"
I20260709 12:29:10.519340 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:29:10.527501 27983 consensus_peers.cc:597] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:10.533396 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:10.534762 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:10.536319 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:10.540016 28182 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:29:10.594555 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:29:10.594903 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.002s	sys 0.000s
I20260709 12:29:10.595178 20873 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:29:10.600102 28182 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.616729 28182 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.617931 28182 tablet_bootstrap.cc:492] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.618628 28182 ts_tablet_manager.cc:1403] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:29:10.621647 28182 raft_consensus.cc:359] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.622398 28182 raft_consensus.cc:740] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.623196 28182 consensus_queue.cc:260] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.626103 28182 ts_tablet_manager.cc:1434] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:10.626987 28182 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.641615 28182 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.642530 28182 tablet_bootstrap.cc:492] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.643287 28182 ts_tablet_manager.cc:1403] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:29:10.646118 28182 raft_consensus.cc:359] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.646847 28182 raft_consensus.cc:740] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.647606 28182 consensus_queue.cc:260] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.649784 28182 ts_tablet_manager.cc:1434] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:29:10.650704 28182 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.653647 20873 ts_tablet_manager.cc:616] Registered 10 tablets
W20260709 12:29:10.653903 27909 consensus_peers.cc:597] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:10.654037 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.059s	user 0.059s	sys 0.000s
I20260709 12:29:10.670152 28182 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.671496 28182 tablet_bootstrap.cc:492] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.672417 28182 ts_tablet_manager.cc:1403] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:29:10.676095 28182 raft_consensus.cc:359] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.677111 28182 raft_consensus.cc:740] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.678212 28182 consensus_queue.cc:260] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.681105 28182 ts_tablet_manager.cc:1434] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:10.682268 28182 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.698333 28182 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.699527 28182 tablet_bootstrap.cc:492] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.700503 28182 ts_tablet_manager.cc:1403] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:29:10.703732 28182 raft_consensus.cc:359] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:10.704630 28182 raft_consensus.cc:740] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.705672 28182 consensus_queue.cc:260] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:10.708333 28182 ts_tablet_manager.cc:1434] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:29:10.709460 28182 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
W20260709 12:29:10.710148 27909 consensus_peers.cc:597] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:10.717895 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:34227
I20260709 12:29:10.718015 28243 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:34227 every 8 connection(s)
I20260709 12:29:10.724262 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:10.726454 28182 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.727528 28182 tablet_bootstrap.cc:492] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.728221 28182 ts_tablet_manager.cc:1403] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:29:10.730762 28182 raft_consensus.cc:359] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.731523 28182 raft_consensus.cc:740] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.732430 28182 consensus_queue.cc:260] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.734424 28182 ts_tablet_manager.cc:1434] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:10.735172 28182 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.762039 28182 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:10.762979 28182 tablet_bootstrap.cc:492] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.763722 28182 ts_tablet_manager.cc:1403] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 12:29:10.766428 28182 raft_consensus.cc:359] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.767297 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:10.767328 28182 raft_consensus.cc:740] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.767903 28244 heartbeater.cc:344] Connected to a master server at 127.20.98.126:33791
I20260709 12:29:10.768139 27946 raft_consensus.cc:606] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:10.768421 28244 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:10.768668 28182 consensus_queue.cc:260] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.769377 28244 heartbeater.cc:507] Master 127.20.98.126:33791 requested a full tablet report, sending...
I20260709 12:29:10.772131 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:10.772612 28182 ts_tablet_manager.cc:1434] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:29:10.772742 27946 raft_consensus.cc:606] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:10.773502 28182 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.775592 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:10.776129 27946 raft_consensus.cc:606] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:10.776427 27767 ts_manager.cc:194] Re-registered known tserver with Master: 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227)
I20260709 12:29:10.778596 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:10.779150 27946 raft_consensus.cc:606] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:10.780350 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:29:10.781002 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:10.781785 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:10.787315 28182 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.788380 28182 tablet_bootstrap.cc:492] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.789218 28182 ts_tablet_manager.cc:1403] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:29:10.790797 27767 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57364
I20260709 12:29:10.791862 28182 raft_consensus.cc:359] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.792697 28182 raft_consensus.cc:740] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.793387 28182 consensus_queue.cc:260] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.794402 28244 heartbeater.cc:499] Master 127.20.98.126:33791 was elected leader, sending a full tablet report...
I20260709 12:29:10.795027 28182 ts_tablet_manager.cc:1434] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:10.795756 28182 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.809350 28182 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:10.810384 28182 tablet_bootstrap.cc:492] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.811121 28182 ts_tablet_manager.cc:1403] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:29:10.813661 28182 raft_consensus.cc:359] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.814492 28182 raft_consensus.cc:740] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.815207 28182 consensus_queue.cc:260] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.817286 28182 ts_tablet_manager.cc:1434] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:29:10.818159 28182 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
I20260709 12:29:10.818974 28256 raft_consensus.cc:993] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:10.819573 28156 raft_consensus.cc:1081] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:10.821074 28020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:10.821651 28020 raft_consensus.cc:493] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:10.821980 28020 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.827518 28020 raft_consensus.cc:515] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.829288 28020 leader_election.cc:290] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:10.830077 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:10.830771 28218 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.831991 28182 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.832782 28182 tablet_bootstrap.cc:492] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.833465 28182 ts_tablet_manager.cc:1403] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:29:10.834299 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f6a267e3d0495b9f7d1eaad51a6b92" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:10.834962 27946 raft_consensus.cc:3055] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:10.835301 27946 raft_consensus.cc:740] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:10.836531 28218 raft_consensus.cc:2468] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 3.
I20260709 12:29:10.836162 28182 raft_consensus.cc:359] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.836210 27946 consensus_queue.cc:260] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.837092 28182 raft_consensus.cc:740] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.837816 27983 leader_election.cc:304] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:10.837821 27946 raft_consensus.cc:3060] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:10.838635 28094 raft_consensus.cc:2804] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:10.837870 28182 consensus_queue.cc:260] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.840473 28182 ts_tablet_manager.cc:1434] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:10.842396 28182 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Bootstrap starting.
W20260709 12:29:10.863950 27909 consensus_peers.cc:597] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:10.866011 28182 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:10.866307 27946 raft_consensus.cc:2468] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 3.
I20260709 12:29:10.867332 28182 tablet_bootstrap.cc:492] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Bootstrap complete.
I20260709 12:29:10.867667 28094 raft_consensus.cc:697] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:10.868141 28182 ts_tablet_manager.cc:1403] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.009s
I20260709 12:29:10.868702 28094 consensus_queue.cc:237] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.870937 28182 raft_consensus.cc:359] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.871628 28182 raft_consensus.cc:740] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a03b376242c46cd820eacff320721b6, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.872458 28182 consensus_queue.cc:260] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.874095 28182 ts_tablet_manager.cc:1434] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:10.877708 27767 catalog_manager.cc:5697] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 2 to 3, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:10.956053 28218 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.961539 28218 pending_rounds.cc:85] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Aborting all ops after (but not including) 0
I20260709 12:29:10.961750 28218 pending_rounds.cc:107] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:10.961941 28218 raft_consensus.cc:2889] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:10.978010 28156 raft_consensus.cc:993] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:10.978555 28256 raft_consensus.cc:1081] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:10.980211 28020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:10.980772 28020 raft_consensus.cc:493] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:10.981220 28020 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.989464 28020 raft_consensus.cc:515] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.990830 28256 raft_consensus.cc:993] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:10.991345 28256 raft_consensus.cc:1081] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:10.991793 28020 leader_election.cc:290] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:10.993113 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:10.993451 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:10.993571 28020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:10.993984 28218 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:10.994212 27946 raft_consensus.cc:3055] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:10.994292 28020 raft_consensus.cc:493] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:10.994716 27946 raft_consensus.cc:740] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:10.994935 28020 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:10.995674 27946 consensus_queue.cc:260] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:10.997047 27946 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.003526 28218 raft_consensus.cc:2468] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:11.004402 28020 raft_consensus.cc:515] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:11.005040 27983 leader_election.cc:304] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:11.006110 28094 raft_consensus.cc:2804] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.006626 28094 raft_consensus.cc:697] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:11.006742 28020 leader_election.cc:290] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 4 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:11.007563 28094 consensus_queue.cc:237] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:11.008524 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:11.009285 27945 raft_consensus.cc:3055] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:11.009449 27946 raft_consensus.cc:2468] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:11.009716 27945 raft_consensus.cc:740] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:11.009893 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd9e3721b7ea4a2bae806b4730790b59" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:11.010725 28218 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 4
I20260709 12:29:11.010663 27945 consensus_queue.cc:260] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:11.012521 27945 raft_consensus.cc:3060] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:11.018359 27767 catalog_manager.cc:5697] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 1 to 2, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.019891 28256 raft_consensus.cc:993] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:11.020439 28156 raft_consensus.cc:1081] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:11.021632 28218 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 4.
I20260709 12:29:11.022240 28020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:11.022926 28020 raft_consensus.cc:493] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:11.022935 27983 leader_election.cc:304] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:11.023437 28020 raft_consensus.cc:3060] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.023792 27945 raft_consensus.cc:2468] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 4.
I20260709 12:29:11.024055 28094 raft_consensus.cc:2804] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:11.024619 28094 raft_consensus.cc:697] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 4 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:11.025484 28094 consensus_queue.cc:237] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:11.031838 28020 raft_consensus.cc:515] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:11.033939 28020 leader_election.cc:290] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:11.034988 27945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:11.035619 27945 raft_consensus.cc:3055] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.035897 27945 raft_consensus.cc:740] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:11.035967 27767 catalog_manager.cc:5697] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 3 to 4, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 4 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.036603 27945 consensus_queue.cc:260] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:11.037712 27945 raft_consensus.cc:3060] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.037635 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88d3dcf02054ae39a33869ff8b6d81a" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:11.038450 28218 raft_consensus.cc:3060] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.044286 27945 raft_consensus.cc:2468] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:11.045374 27983 leader_election.cc:304] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:11.045418 28218 raft_consensus.cc:2468] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:11.046207 28094 raft_consensus.cc:2804] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.046741 28094 raft_consensus.cc:697] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:11.047478 28094 consensus_queue.cc:237] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:11.054119 27767 catalog_manager.cc:5697] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 1 to 2, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.251157 28218 raft_consensus.cc:1275] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:11.252550 28272 consensus_queue.cc:1048] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:11.253064 28272 consensus_queue.cc:1243] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Peer 9a03b376242c46cd820eacff320721b6 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:29:11.255206 28218 pending_rounds.cc:85] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Aborting all ops after (but not including) 0
I20260709 12:29:11.255455 28218 pending_rounds.cc:107] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:11.255633 28218 raft_consensus.cc:2889] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:11.264168 27945 raft_consensus.cc:1275] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:11.265640 28258 consensus_queue.cc:1048] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.427331 28217 raft_consensus.cc:1275] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.428726 28272 consensus_queue.cc:1048] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:11.439512 27945 raft_consensus.cc:1275] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.441965 28258 consensus_queue.cc:1048] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:11.489889 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:11.527283 28217 raft_consensus.cc:1275] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:11.528812 28258 consensus_queue.cc:1048] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.538674 27945 raft_consensus.cc:1275] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 4 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:11.539748 27946 raft_consensus.cc:1275] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.541958 28094 consensus_queue.cc:1048] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:11.542569 28258 consensus_queue.cc:1048] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.555029 28217 raft_consensus.cc:1275] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.556480 28094 consensus_queue.cc:1048] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.790345 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:11.809147 28020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
mode: GRACEFUL
new_leader_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:43746
I20260709 12:29:11.809747 28020 raft_consensus.cc:606] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Received request to transfer leadership to TS c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:11.812492 28020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
mode: GRACEFUL
new_leader_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:43746
I20260709 12:29:11.813077 28020 raft_consensus.cc:606] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Received request to transfer leadership to TS c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:11.814170 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:11.814682 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:11.815302 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:12.249083 28281 raft_consensus.cc:993] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5: : Instructing follower c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:12.249666 28094 raft_consensus.cc:1081] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Signalling peer c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:12.251479 27945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:60418
I20260709 12:29:12.252029 27945 raft_consensus.cc:493] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:12.252359 27945 raft_consensus.cc:3060] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.257840 27945 raft_consensus.cc:515] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:12.259547 27945 leader_election.cc:290] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:12.260574 28217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:12.260828 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6c40920c0d41208b6a56ad145e541e" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:12.261312 28217 raft_consensus.cc:3060] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.261528 28020 raft_consensus.cc:3055] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.261940 28020 raft_consensus.cc:740] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:12.262887 28020 consensus_queue.cc:260] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:12.264424 28020 raft_consensus.cc:3060] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.269165 28217 raft_consensus.cc:2468] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 2.
I20260709 12:29:12.270440 27909 leader_election.cc:304] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
I20260709 12:29:12.270967 28020 raft_consensus.cc:2468] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 2.
I20260709 12:29:12.271255 28156 raft_consensus.cc:2804] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:12.271800 28156 raft_consensus.cc:697] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:12.272675 28156 consensus_queue.cc:237] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:12.276634 28281 raft_consensus.cc:993] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5: : Instructing follower c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:12.277267 28258 raft_consensus.cc:1081] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Signalling peer c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:12.279556 27945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:60418
I20260709 12:29:12.280217 27945 raft_consensus.cc:493] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:12.280642 27945 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.281737 27765 catalog_manager.cc:5697] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 1 to 2, leader changed from f6f5b2279782499486c004421b2f4dc5 (127.20.98.67) to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 2 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:12.288208 27945 raft_consensus.cc:515] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:12.291065 27945 leader_election.cc:290] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Requested vote from peers f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411), 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227)
I20260709 12:29:12.291878 28020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:12.292850 28020 raft_consensus.cc:3055] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:12.293402 28020 raft_consensus.cc:740] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:12.294461 28020 consensus_queue.cc:260] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:12.295480 28020 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.301450 28020 raft_consensus.cc:2468] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 2.
I20260709 12:29:12.301741 28217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:12.302452 27909 leader_election.cc:304] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c07d60134b7141c6aec9994aafdffb6d, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:12.302439 28217 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:12.303260 28156 raft_consensus.cc:2804] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:12.303678 28156 raft_consensus.cc:697] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:12.304456 28156 consensus_queue.cc:237] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:12.309161 28217 raft_consensus.cc:2468] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 2.
I20260709 12:29:12.313493 27765 catalog_manager.cc:5697] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 1 to 2, leader changed from f6f5b2279782499486c004421b2f4dc5 (127.20.98.67) to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 2 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:12.491020 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:12.764564 28020 raft_consensus.cc:1275] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.765913 28156 consensus_queue.cc:1048] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:12.779374 28217 raft_consensus.cc:1275] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.781540 28156 consensus_queue.cc:1048] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:12.822793 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:12.830658 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:12.831233 27946 raft_consensus.cc:606] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:12.833688 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:12.834164 27946 raft_consensus.cc:606] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:12.835283 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:12.835779 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:12.836325 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:12.864691 28020 raft_consensus.cc:1275] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.866024 28156 consensus_queue.cc:1048] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:12.871224 28217 raft_consensus.cc:1275] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:12.872659 28294 consensus_queue.cc:1048] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:13.017699 28277 raft_consensus.cc:993] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:13.018210 28294 raft_consensus.cc:1081] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:13.019779 28020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:13.020275 28020 raft_consensus.cc:493] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:13.020648 28020 raft_consensus.cc:3060] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:13.025722 28020 raft_consensus.cc:515] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.027321 28020 leader_election.cc:290] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:13.028251 28217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:13.028553 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57b11c122b8407c8ba4bf6197edf1a4" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:13.028998 28217 raft_consensus.cc:3060] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:13.029295 27946 raft_consensus.cc:3055] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:13.029783 27946 raft_consensus.cc:740] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:13.030694 27946 consensus_queue.cc:260] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.032021 27946 raft_consensus.cc:3060] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:13.035377 28217 raft_consensus.cc:2468] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:13.036518 27983 leader_election.cc:304] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:13.037523 28094 raft_consensus.cc:2804] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:13.038076 28094 raft_consensus.cc:697] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:13.038587 27946 raft_consensus.cc:2468] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:13.038978 28094 consensus_queue.cc:237] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.046762 27768 catalog_manager.cc:5697] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 1 to 2, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:13.139989 28277 raft_consensus.cc:993] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:13.140473 28294 raft_consensus.cc:1081] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:13.141974 28020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:13.142407 28020 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:13.142657 28020 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.147603 28020 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.149024 28020 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:13.150063 28217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:13.150279 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:13.150656 28217 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.150882 27946 raft_consensus.cc:3055] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:13.151254 27946 raft_consensus.cc:740] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:13.151922 27946 consensus_queue.cc:260] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.152877 27946 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.156073 28217 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 3.
I20260709 12:29:13.157123 27983 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:13.157826 28094 raft_consensus.cc:2804] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:13.158178 27946 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 3.
I20260709 12:29:13.158247 28094 raft_consensus.cc:697] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:13.159155 28094 consensus_queue.cc:237] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.166802 27768 catalog_manager.cc:5697] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 2 to 3, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:13.492357 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:13.602324 28218 raft_consensus.cc:1275] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:13.603793 28281 consensus_queue.cc:1048] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:13.622203 27946 raft_consensus.cc:1275] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:13.624322 28094 consensus_queue.cc:1048] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:13.630455 27945 raft_consensus.cc:1275] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:13.632750 28094 consensus_queue.cc:1048] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:13.646603 28217 raft_consensus.cc:1275] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:13.648815 28281 consensus_queue.cc:1048] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:13.843281 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:13.855113 28019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
mode: GRACEFUL
new_leader_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:43746
I20260709 12:29:13.855955 28019 raft_consensus.cc:606] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Received request to transfer leadership to TS c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:13.859954 28019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
mode: GRACEFUL
new_leader_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:43746
I20260709 12:29:13.860745 28019 raft_consensus.cc:606] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Received request to transfer leadership to TS c07d60134b7141c6aec9994aafdffb6d
I20260709 12:29:13.862576 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:13.863109 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:13.863857 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:13.974933 28281 raft_consensus.cc:993] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5: : Instructing follower c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:13.975612 28309 raft_consensus.cc:1081] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Signalling peer c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:13.977519 27946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:60418
I20260709 12:29:13.978070 27946 raft_consensus.cc:493] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:13.978400 27946 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.986367 27946 raft_consensus.cc:515] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.988111 27946 leader_election.cc:290] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:13.989113 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:13.989359 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392b04dfa76c4fdfbe3d8d2316dad4dd" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:13.989988 28218 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.990085 28019 raft_consensus.cc:3055] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:13.990546 28019 raft_consensus.cc:740] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:13.991510 28019 consensus_queue.cc:260] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:13.992736 28019 raft_consensus.cc:3060] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:13.997234 28218 raft_consensus.cc:2468] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 3.
I20260709 12:29:13.998685 27909 leader_election.cc:304] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
I20260709 12:29:13.999680 28277 raft_consensus.cc:2804] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:14.000124 28277 raft_consensus.cc:697] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 3 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:14.001263 28277 consensus_queue.cc:237] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:14.001938 28019 raft_consensus.cc:2468] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 3.
I20260709 12:29:14.010464 27767 catalog_manager.cc:5697] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 2 to 3, leader changed from f6f5b2279782499486c004421b2f4dc5 (127.20.98.67) to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 3 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:14.138417 28309 raft_consensus.cc:993] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5: : Instructing follower c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:14.138895 28281 raft_consensus.cc:1081] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Signalling peer c07d60134b7141c6aec9994aafdffb6d to start an election
I20260709 12:29:14.140412 27946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
 from {username='slave'} at 127.0.0.1:60418
I20260709 12:29:14.140853 27946 raft_consensus.cc:493] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:14.141127 27946 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:14.149204 27946 raft_consensus.cc:515] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:14.151047 27946 leader_election.cc:290] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 4 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), f6f5b2279782499486c004421b2f4dc5 (127.20.98.67:33411)
I20260709 12:29:14.151746 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:14.152050 28019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac4d14120c44fdaacd9a7572f20b2af" candidate_uuid: "c07d60134b7141c6aec9994aafdffb6d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
I20260709 12:29:14.152446 28218 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:14.152680 28019 raft_consensus.cc:3055] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:14.153045 28019 raft_consensus.cc:740] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:14.153904 28019 consensus_queue.cc:260] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:14.154898 28019 raft_consensus.cc:3060] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:14.158891 28218 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 4.
I20260709 12:29:14.160123 27909 leader_election.cc:304] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, c07d60134b7141c6aec9994aafdffb6d; no voters: 
I20260709 12:29:14.160903 28277 raft_consensus.cc:2804] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:14.160949 28019 raft_consensus.cc:2468] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c07d60134b7141c6aec9994aafdffb6d in term 4.
I20260709 12:29:14.161549 28277 raft_consensus.cc:697] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 4 LEADER]: Becoming Leader. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:14.162734 28277 consensus_queue.cc:237] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:14.168992 27767 catalog_manager.cc:5697] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d reported cstate change: term changed from 3 to 4, leader changed from f6f5b2279782499486c004421b2f4dc5 (127.20.98.67) to c07d60134b7141c6aec9994aafdffb6d (127.20.98.66). New cstate: current_term: 4 leader_uuid: "c07d60134b7141c6aec9994aafdffb6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:14.395018 28019 raft_consensus.cc:1275] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:14.396428 28294 consensus_queue.cc:1048] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:14.403600 28218 raft_consensus.cc:1275] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:14.405251 28294 consensus_queue.cc:1048] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:29:14.493589 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:14.626120 28019 raft_consensus.cc:1275] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 4 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:14.627632 28277 consensus_queue.cc:1048] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:14.637368 28218 raft_consensus.cc:1275] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Refusing update from remote peer c07d60134b7141c6aec9994aafdffb6d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:14.638855 28326 consensus_queue.cc:1048] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:14.874400 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:14.881876 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:14.882486 27946 raft_consensus.cc:606] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:14.885113 27946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53"
dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
mode: GRACEFUL
new_leader_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:60420
I20260709 12:29:14.885612 27946 raft_consensus.cc:606] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Received request to transfer leadership to TS f6f5b2279782499486c004421b2f4dc5
I20260709 12:29:14.886768 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:14.887279 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:14.887849 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:15.148903 28327 raft_consensus.cc:993] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:15.149413 28326 raft_consensus.cc:1081] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:15.151008 28019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:15.151499 28019 raft_consensus.cc:493] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.151790 28019 raft_consensus.cc:3060] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.157883 28019 raft_consensus.cc:515] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:15.159606 28019 leader_election.cc:290] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:15.160777 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:15.160806 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3afbb1d098c245af8cacb514544b7e53" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:15.161379 27946 raft_consensus.cc:3055] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.161567 28218 raft_consensus.cc:3060] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.161666 27946 raft_consensus.cc:740] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:15.162581 27946 consensus_queue.cc:260] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:15.163611 27946 raft_consensus.cc:3060] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.167346 28218 raft_consensus.cc:2468] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:15.168627 27983 leader_election.cc:304] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:15.169322 27946 raft_consensus.cc:2468] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 2.
I20260709 12:29:15.169346 28309 raft_consensus.cc:2804] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:15.170625 28309 raft_consensus.cc:697] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:15.171638 28309 consensus_queue.cc:237] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } }
I20260709 12:29:15.180114 27765 catalog_manager.cc:5697] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 1 to 2, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:15.433100 28327 raft_consensus.cc:993] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d: : Instructing follower f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:15.433877 28326 raft_consensus.cc:1081] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Signalling peer f6f5b2279782499486c004421b2f4dc5 to start an election
I20260709 12:29:15.435328 28019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86"
dest_uuid: "f6f5b2279782499486c004421b2f4dc5"
 from {username='slave'} at 127.0.0.1:51522
I20260709 12:29:15.435798 28019 raft_consensus.cc:493] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.436105 28019 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.441510 28019 raft_consensus.cc:515] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:15.443171 28019 leader_election.cc:290] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 3 election: Requested vote from peers 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227), c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443)
I20260709 12:29:15.443818 28218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a03b376242c46cd820eacff320721b6"
I20260709 12:29:15.444108 27946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd6aec33a594695826f64ae3a97fa86" candidate_uuid: "f6f5b2279782499486c004421b2f4dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c07d60134b7141c6aec9994aafdffb6d"
I20260709 12:29:15.444473 28218 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.444694 27946 raft_consensus.cc:3055] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:15.445036 27946 raft_consensus.cc:740] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c07d60134b7141c6aec9994aafdffb6d, State: Running, Role: LEADER
I20260709 12:29:15.446050 27946 consensus_queue.cc:260] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:15.447454 27946 raft_consensus.cc:3060] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:15.452348 28218 raft_consensus.cc:2468] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 3.
I20260709 12:29:15.453653 27983 leader_election.cc:304] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a03b376242c46cd820eacff320721b6, f6f5b2279782499486c004421b2f4dc5; no voters: 
I20260709 12:29:15.454305 28328 raft_consensus.cc:2804] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:15.454649 27946 raft_consensus.cc:2468] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6f5b2279782499486c004421b2f4dc5 in term 3.
I20260709 12:29:15.454804 28328 raft_consensus.cc:697] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Becoming Leader. State: Replica: f6f5b2279782499486c004421b2f4dc5, State: Running, Role: LEADER
I20260709 12:29:15.455993 28328 consensus_queue.cc:237] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } }
I20260709 12:29:15.464517 27765 catalog_manager.cc:5697] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 reported cstate change: term changed from 2 to 3, leader changed from c07d60134b7141c6aec9994aafdffb6d (127.20.98.66) to f6f5b2279782499486c004421b2f4dc5 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "f6f5b2279782499486c004421b2f4dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6f5b2279782499486c004421b2f4dc5" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 33411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:15.494640 27816 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:15.665886 27946 raft_consensus.cc:1275] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.667588 28328 consensus_queue.cc:1048] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.677933 28218 raft_consensus.cc:1275] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.679535 28328 consensus_queue.cc:1048] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:15.892119 28218 raft_consensus.cc:1275] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:15.893350 28309 consensus_queue.cc:1048] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a03b376242c46cd820eacff320721b6" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:15.894294 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:15.903781 27946 raft_consensus.cc:1275] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Refusing update from remote peer f6f5b2279782499486c004421b2f4dc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:15.908288 28342 consensus_queue.cc:1048] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c07d60134b7141c6aec9994aafdffb6d" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 40443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:15.940653 20873 tablet_server.cc:179] TabletServer@127.20.98.65:34227 shutting down...
I20260709 12:29:15.965363 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:15.966370 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:15.967290 20873 raft_consensus.cc:2243] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:15.967836 20873 raft_consensus.cc:2272] T b6000eb157754ffba1e9979fe4b37ca2 P 9a03b376242c46cd820eacff320721b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:15.971755 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:15.972926 20873 raft_consensus.cc:2243] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:15.973688 20873 raft_consensus.cc:2272] T 43f6a267e3d0495b9f7d1eaad51a6b92 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:15.976347 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:15.977082 20873 raft_consensus.cc:2243] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:15.977793 20873 raft_consensus.cc:2272] T 3afbb1d098c245af8cacb514544b7e53 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:15.981549 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:15.982374 20873 raft_consensus.cc:2243] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:15.982895 20873 raft_consensus.cc:2272] T 0bd6aec33a594695826f64ae3a97fa86 P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:15.986243 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:15.986958 20873 raft_consensus.cc:2243] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:15.987424 20873 raft_consensus.cc:2272] T f57b11c122b8407c8ba4bf6197edf1a4 P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:15.990281 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:15.990887 20873 raft_consensus.cc:2243] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:15.991444 20873 raft_consensus.cc:2272] T d88d3dcf02054ae39a33869ff8b6d81a P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:15.994863 20873 tablet_replica.cc:333] stopping tablet replica
W20260709 12:29:15.995389 27909 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:29:15.995604 20873 raft_consensus.cc:2243] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:15.996380 20873 raft_consensus.cc:2272] T dd9e3721b7ea4a2bae806b4730790b59 P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:15.998742 27909 consensus_peers.cc:597] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:15.999864 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:16.000571 20873 raft_consensus.cc:2243] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.001113 20873 raft_consensus.cc:2272] T 9e6c40920c0d41208b6a56ad145e541e P 9a03b376242c46cd820eacff320721b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.003818 20873 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:16.004457 20873 raft_consensus.cc:2243] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.005079 20873 raft_consensus.cc:2272] T 3ac4d14120c44fdaacd9a7572f20b2af P 9a03b376242c46cd820eacff320721b6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.008764 20873 tablet_replica.cc:333] stopping tablet replica
W20260709 12:29:16.009377 27909 consensus_peers.cc:597] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:16.009618 20873 raft_consensus.cc:2243] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.010212 20873 raft_consensus.cc:2272] T 392b04dfa76c4fdfbe3d8d2316dad4dd P 9a03b376242c46cd820eacff320721b6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:16.038684 27983 consensus_peers.cc:597] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:16.045446 20873 tablet_server.cc:196] TabletServer@127.20.98.65:34227 shutdown complete.
I20260709 12:29:16.072621 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
W20260709 12:29:16.080506 27983 consensus_peers.cc:597] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 -> Peer c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443): Couldn't send request to peer c07d60134b7141c6aec9994aafdffb6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:16.099216 27983 consensus_peers.cc:597] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:16.102782 27983 consensus_peers.cc:597] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 -> Peer c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443): Couldn't send request to peer c07d60134b7141c6aec9994aafdffb6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:16.106328 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:29:16.106442 27983 consensus_peers.cc:597] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:16.107296 20873 tablet_replica.cc:333] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.108112 20873 raft_consensus.cc:2243] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.108573 20873 raft_consensus.cc:2272] T 0bd6aec33a594695826f64ae3a97fa86 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.111969 20873 tablet_replica.cc:333] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.112613 20873 raft_consensus.cc:2243] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.113138 20873 raft_consensus.cc:2272] T 43f6a267e3d0495b9f7d1eaad51a6b92 P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.115458 20873 tablet_replica.cc:333] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.116034 20873 raft_consensus.cc:2243] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.116971 20873 raft_consensus.cc:2272] T b6000eb157754ffba1e9979fe4b37ca2 P c07d60134b7141c6aec9994aafdffb6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.119303 20873 tablet_replica.cc:333] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.119894 20873 raft_consensus.cc:2243] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.120306 20873 raft_consensus.cc:2272] T 3afbb1d098c245af8cacb514544b7e53 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.123289 20873 tablet_replica.cc:333] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.123888 20873 raft_consensus.cc:2243] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.124421 20873 raft_consensus.cc:2272] T d88d3dcf02054ae39a33869ff8b6d81a P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.126528 20873 tablet_replica.cc:333] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.127068 20873 raft_consensus.cc:2243] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.127509 20873 raft_consensus.cc:2272] T f57b11c122b8407c8ba4bf6197edf1a4 P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.129566 20873 tablet_replica.cc:333] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.130105 20873 raft_consensus.cc:2243] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.130945 20873 raft_consensus.cc:2272] T 9e6c40920c0d41208b6a56ad145e541e P c07d60134b7141c6aec9994aafdffb6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.133040 20873 tablet_replica.cc:333] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.133589 20873 raft_consensus.cc:2243] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.134116 20873 raft_consensus.cc:2272] T dd9e3721b7ea4a2bae806b4730790b59 P c07d60134b7141c6aec9994aafdffb6d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.136819 20873 tablet_replica.cc:333] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.137457 20873 raft_consensus.cc:2243] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.138101 20873 raft_consensus.cc:2272] T 392b04dfa76c4fdfbe3d8d2316dad4dd P c07d60134b7141c6aec9994aafdffb6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.140332 20873 tablet_replica.cc:333] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d: stopping tablet replica
I20260709 12:29:16.140822 20873 raft_consensus.cc:2243] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.141644 20873 raft_consensus.cc:2272] T 3ac4d14120c44fdaacd9a7572f20b2af P c07d60134b7141c6aec9994aafdffb6d [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:16.148794 27983 consensus_peers.cc:597] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:16.175578 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
W20260709 12:29:16.202358 27983 consensus_peers.cc:597] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 -> Peer 9a03b376242c46cd820eacff320721b6 (127.20.98.65:34227): Couldn't send request to peer 9a03b376242c46cd820eacff320721b6. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:34227: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:16.205063 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
W20260709 12:29:16.212401 27983 consensus_peers.cc:597] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 -> Peer c07d60134b7141c6aec9994aafdffb6d (127.20.98.66:40443): Couldn't send request to peer c07d60134b7141c6aec9994aafdffb6d. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:40443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:16.231702 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:16.232496 20873 tablet_replica.cc:333] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.233276 20873 raft_consensus.cc:2243] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.233736 20873 raft_consensus.cc:2272] T 392b04dfa76c4fdfbe3d8d2316dad4dd P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.236056 20873 tablet_replica.cc:333] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.236654 20873 raft_consensus.cc:2243] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.237208 20873 raft_consensus.cc:2272] T 3ac4d14120c44fdaacd9a7572f20b2af P f6f5b2279782499486c004421b2f4dc5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.239399 20873 tablet_replica.cc:333] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.239970 20873 raft_consensus.cc:2243] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.240849 20873 raft_consensus.cc:2272] T 43f6a267e3d0495b9f7d1eaad51a6b92 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.243072 20873 tablet_replica.cc:333] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.243657 20873 raft_consensus.cc:2243] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.244098 20873 raft_consensus.cc:2272] T b6000eb157754ffba1e9979fe4b37ca2 P f6f5b2279782499486c004421b2f4dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.246297 20873 tablet_replica.cc:333] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.246852 20873 raft_consensus.cc:2243] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.247715 20873 raft_consensus.cc:2272] T dd9e3721b7ea4a2bae806b4730790b59 P f6f5b2279782499486c004421b2f4dc5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.250057 20873 tablet_replica.cc:333] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.250836 20873 raft_consensus.cc:2243] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.251725 20873 raft_consensus.cc:2272] T d88d3dcf02054ae39a33869ff8b6d81a P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.254038 20873 tablet_replica.cc:333] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.254597 20873 raft_consensus.cc:2243] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:16.255050 20873 raft_consensus.cc:2272] T 9e6c40920c0d41208b6a56ad145e541e P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.257153 20873 tablet_replica.cc:333] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.257719 20873 raft_consensus.cc:2243] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.258478 20873 raft_consensus.cc:2272] T f57b11c122b8407c8ba4bf6197edf1a4 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.260536 20873 tablet_replica.cc:333] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.261021 20873 raft_consensus.cc:2243] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.261790 20873 raft_consensus.cc:2272] T 0bd6aec33a594695826f64ae3a97fa86 P f6f5b2279782499486c004421b2f4dc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.264154 20873 tablet_replica.cc:333] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5: stopping tablet replica
I20260709 12:29:16.264668 20873 raft_consensus.cc:2243] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.265494 20873 raft_consensus.cc:2272] T 3afbb1d098c245af8cacb514544b7e53 P f6f5b2279782499486c004421b2f4dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.299206 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
I20260709 12:29:16.328382 20873 master.cc:562] Master@127.20.98.126:33791 shutting down...
I20260709 12:29:16.350848 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:16.351454 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:16.351799 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P e75e04895670425c81113d1aa6aced7b: stopping tablet replica
I20260709 12:29:16.373924 20873 master.cc:584] Master@127.20.98.126:33791 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13131 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:29:16.421892 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:43951
I20260709 12:29:16.423030 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:16.429039 28349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.429129 28350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.429512 28352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:16.431120 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:16.432051 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:16.432261 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:16.432422 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600156432407 us; error 0 us; skew 500 ppm
I20260709 12:29:16.432982 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:16.435410 20873 webserver.cc:533] Webserver started at http://127.20.98.126:39147/ using document root <none> and password file <none>
I20260709 12:29:16.435920 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:16.436146 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:16.436432 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:16.437695 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "b58e8cd85bdf48f69b1da6a681f92c20"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.442162 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:29:16.445745 28357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.446614 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:29:16.446854 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "b58e8cd85bdf48f69b1da6a681f92c20"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.447116 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:16.462764 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:16.463979 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:16.504441 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:43951
I20260709 12:29:16.504554 28408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:43951 every 8 connection(s)
I20260709 12:29:16.508920 28409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:16.522897 28409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20: Bootstrap starting.
I20260709 12:29:16.528837 28409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:16.533794 28409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20: No bootstrap required, opened a new log
I20260709 12:29:16.536278 28409 raft_consensus.cc:359] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" member_type: VOTER }
I20260709 12:29:16.536736 28409 raft_consensus.cc:385] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:16.536993 28409 raft_consensus.cc:740] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b58e8cd85bdf48f69b1da6a681f92c20, State: Initialized, Role: FOLLOWER
I20260709 12:29:16.537654 28409 consensus_queue.cc:260] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" member_type: VOTER }
I20260709 12:29:16.538156 28409 raft_consensus.cc:399] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:16.538425 28409 raft_consensus.cc:493] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:16.538718 28409 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:16.544111 28409 raft_consensus.cc:515] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" member_type: VOTER }
I20260709 12:29:16.544690 28409 leader_election.cc:304] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b58e8cd85bdf48f69b1da6a681f92c20; no voters: 
I20260709 12:29:16.545909 28409 leader_election.cc:290] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:16.546252 28412 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:16.547700 28412 raft_consensus.cc:697] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 1 LEADER]: Becoming Leader. State: Replica: b58e8cd85bdf48f69b1da6a681f92c20, State: Running, Role: LEADER
I20260709 12:29:16.548307 28412 consensus_queue.cc:237] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" member_type: VOTER }
I20260709 12:29:16.549448 28409 sys_catalog.cc:565] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:16.553578 28413 sys_catalog.cc:455] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" member_type: VOTER } }
I20260709 12:29:16.554507 28414 sys_catalog.cc:455] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b58e8cd85bdf48f69b1da6a681f92c20. Latest consensus state: current_term: 1 leader_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b58e8cd85bdf48f69b1da6a681f92c20" member_type: VOTER } }
I20260709 12:29:16.554999 28413 sys_catalog.cc:458] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:16.555092 28414 sys_catalog.cc:458] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:16.556958 28419 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:16.562355 28419 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:16.565541 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:16.570840 28419 catalog_manager.cc:1383] Generated new cluster ID: 8ac788fe4c50488aa148229a3635e360
I20260709 12:29:16.571131 28419 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:16.591116 28419 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:16.592476 28419 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:16.604261 28419 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20: Generated new TSK 0
I20260709 12:29:16.604930 28419 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:16.632268 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:16.639657 28430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.641630 28431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.643497 28433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:16.647506 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:16.648551 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:16.648815 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:16.649008 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600156648979 us; error 0 us; skew 500 ppm
I20260709 12:29:16.649603 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:16.652105 20873 webserver.cc:533] Webserver started at http://127.20.98.65:39485/ using document root <none> and password file <none>
I20260709 12:29:16.652659 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:16.652853 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:16.653141 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:16.654331 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.658946 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:16.662305 28438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.663018 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:29:16.663308 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.663599 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:16.698179 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:16.699805 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:16.701514 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:16.703810 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:16.704037 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.704276 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:16.704474 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.744596 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:34941
I20260709 12:29:16.744753 28500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:34941 every 8 connection(s)
I20260709 12:29:16.749830 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:16.757253 28505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.757612 28506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.760790 28508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:16.762887 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:16.763837 28501 heartbeater.cc:344] Connected to a master server at 127.20.98.126:43951
I20260709 12:29:16.764264 28501 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:16.764405 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:16.764693 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:16.764874 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600156764857 us; error 0 us; skew 500 ppm
I20260709 12:29:16.765115 28501 heartbeater.cc:507] Master 127.20.98.126:43951 requested a full tablet report, sending...
I20260709 12:29:16.765643 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:16.767424 28374 ts_manager.cc:194] Registered new tserver with Master: d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65:34941)
I20260709 12:29:16.768168 20873 webserver.cc:533] Webserver started at http://127.20.98.66:38673/ using document root <none> and password file <none>
I20260709 12:29:16.768729 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:16.768935 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:16.769243 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:16.769495 28374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46448
I20260709 12:29:16.770591 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "437622bf51d64158adc0fe88001aad98"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.775262 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:16.778759 28513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.779642 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:29:16.779965 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "437622bf51d64158adc0fe88001aad98"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.780265 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:16.789114 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:16.790369 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:16.791826 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:16.794114 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:16.794337 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.794577 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:16.794746 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.836146 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:43295
I20260709 12:29:16.836253 28575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:43295 every 8 connection(s)
I20260709 12:29:16.841256 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:16.848942 28579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.849967 28580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:16.852041 28582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:16.852991 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:16.854212 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:16.854496 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:16.854715 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600156854696 us; error 0 us; skew 500 ppm
I20260709 12:29:16.855427 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:16.855623 28576 heartbeater.cc:344] Connected to a master server at 127.20.98.126:43951
I20260709 12:29:16.856120 28576 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:16.857054 28576 heartbeater.cc:507] Master 127.20.98.126:43951 requested a full tablet report, sending...
I20260709 12:29:16.858184 20873 webserver.cc:533] Webserver started at http://127.20.98.67:33041/ using document root <none> and password file <none>
I20260709 12:29:16.858908 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:16.859160 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:16.859488 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:16.859412 28374 ts_manager.cc:194] Registered new tserver with Master: 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295)
I20260709 12:29:16.861299 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "1e801e5118914af299cb14c9347a16b4"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.861560 28374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46452
I20260709 12:29:16.866569 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:16.870266 28587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.871078 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:29:16.871399 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "1e801e5118914af299cb14c9347a16b4"
format_stamp: "Formatted at 2026-07-09 12:29:16 on dist-test-slave-g3x6"
I20260709 12:29:16.871709 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:16.883121 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:16.884291 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:16.885792 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:16.888053 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:16.888286 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.888530 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:16.888700 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:16.928794 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:37021
I20260709 12:29:16.928908 28649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:37021 every 8 connection(s)
I20260709 12:29:16.942979 28650 heartbeater.cc:344] Connected to a master server at 127.20.98.126:43951
I20260709 12:29:16.943447 28650 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:16.944195 28650 heartbeater.cc:507] Master 127.20.98.126:43951 requested a full tablet report, sending...
I20260709 12:29:16.946856 28374 ts_manager.cc:194] Registered new tserver with Master: 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:16.947747 20873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015624689s
I20260709 12:29:16.948323 28374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46466
I20260709 12:29:16.972517 28374 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46468:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:16.974748 28374 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:17.025976 28466 tablet_service.cc:1511] Processing CreateTablet for tablet 8c89283edb564b48bb9f6d11779347bc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1d0b632a9a5841119840190a5c0c0a06]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:17.027994 28466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c89283edb564b48bb9f6d11779347bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.030433 28465 tablet_service.cc:1511] Processing CreateTablet for tablet 57c54fd39f3042d6b7b22bb6f88ef9d0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1d0b632a9a5841119840190a5c0c0a06]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:17.031849 28465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c54fd39f3042d6b7b22bb6f88ef9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.043751 28541 tablet_service.cc:1511] Processing CreateTablet for tablet 8c89283edb564b48bb9f6d11779347bc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1d0b632a9a5841119840190a5c0c0a06]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:17.044358 28540 tablet_service.cc:1511] Processing CreateTablet for tablet 57c54fd39f3042d6b7b22bb6f88ef9d0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1d0b632a9a5841119840190a5c0c0a06]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:17.045339 28541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c89283edb564b48bb9f6d11779347bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.045010 28615 tablet_service.cc:1511] Processing CreateTablet for tablet 8c89283edb564b48bb9f6d11779347bc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1d0b632a9a5841119840190a5c0c0a06]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:17.046025 28540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c54fd39f3042d6b7b22bb6f88ef9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.046419 28615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c89283edb564b48bb9f6d11779347bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.055768 28614 tablet_service.cc:1511] Processing CreateTablet for tablet 57c54fd39f3042d6b7b22bb6f88ef9d0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=1d0b632a9a5841119840190a5c0c0a06]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:17.057682 28614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c54fd39f3042d6b7b22bb6f88ef9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.069187 28665 tablet_bootstrap.cc:492] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28: Bootstrap starting.
I20260709 12:29:17.072348 28666 tablet_bootstrap.cc:492] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98: Bootstrap starting.
I20260709 12:29:17.078363 28665 tablet_bootstrap.cc:654] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.080502 28666 tablet_bootstrap.cc:654] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.086107 28668 tablet_bootstrap.cc:492] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4: Bootstrap starting.
I20260709 12:29:17.088712 28665 tablet_bootstrap.cc:492] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28: No bootstrap required, opened a new log
I20260709 12:29:17.089007 28666 tablet_bootstrap.cc:492] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98: No bootstrap required, opened a new log
I20260709 12:29:17.089305 28665 ts_tablet_manager.cc:1403] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:29:17.089646 28666 ts_tablet_manager.cc:1403] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:29:17.092038 28665 raft_consensus.cc:359] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.092687 28665 raft_consensus.cc:385] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.092937 28665 raft_consensus.cc:740] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.092878 28666 raft_consensus.cc:359] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.093951 28666 raft_consensus.cc:385] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.093916 28665 consensus_queue.cc:260] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.094352 28666 raft_consensus.cc:740] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.094853 28668 tablet_bootstrap.cc:654] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.095295 28666 consensus_queue.cc:260] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.096366 28501 heartbeater.cc:499] Master 127.20.98.126:43951 was elected leader, sending a full tablet report...
I20260709 12:29:17.096882 28665 ts_tablet_manager.cc:1434] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:17.097878 28665 tablet_bootstrap.cc:492] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28: Bootstrap starting.
I20260709 12:29:17.103785 28665 tablet_bootstrap.cc:654] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.107262 28668 tablet_bootstrap.cc:492] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4: No bootstrap required, opened a new log
I20260709 12:29:17.107805 28668 ts_tablet_manager.cc:1403] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.005s
I20260709 12:29:17.111060 28668 raft_consensus.cc:359] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.111929 28668 raft_consensus.cc:385] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.112283 28668 raft_consensus.cc:740] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e801e5118914af299cb14c9347a16b4, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.113195 28668 consensus_queue.cc:260] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.114215 28576 heartbeater.cc:499] Master 127.20.98.126:43951 was elected leader, sending a full tablet report...
I20260709 12:29:17.115319 28666 ts_tablet_manager.cc:1434] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 12:29:17.116082 28665 tablet_bootstrap.cc:492] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28: No bootstrap required, opened a new log
I20260709 12:29:17.116451 28666 tablet_bootstrap.cc:492] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98: Bootstrap starting.
I20260709 12:29:17.116863 28665 ts_tablet_manager.cc:1403] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:29:17.120172 28670 raft_consensus.cc:493] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.120669 28670 raft_consensus.cc:515] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.121057 28665 raft_consensus.cc:359] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.122195 28665 raft_consensus.cc:385] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.122579 28665 raft_consensus.cc:740] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.123298 28670 leader_election.cc:290] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021), 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295)
I20260709 12:29:17.131798 28665 consensus_queue.cc:260] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.135039 28665 ts_tablet_manager.cc:1434] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.010s
I20260709 12:29:17.139279 28666 tablet_bootstrap.cc:654] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.146680 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4" is_pre_election: true
I20260709 12:29:17.148464 28650 heartbeater.cc:499] Master 127.20.98.126:43951 was elected leader, sending a full tablet report...
W20260709 12:29:17.148952 28439 leader_election.cc:343] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:17.150329 28668 ts_tablet_manager.cc:1434] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.027s
I20260709 12:29:17.151443 28668 tablet_bootstrap.cc:492] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4: Bootstrap starting.
I20260709 12:29:17.158445 28668 tablet_bootstrap.cc:654] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.162433 28666 tablet_bootstrap.cc:492] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98: No bootstrap required, opened a new log
I20260709 12:29:17.162529 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "437622bf51d64158adc0fe88001aad98" is_pre_election: true
I20260709 12:29:17.162918 28666 ts_tablet_manager.cc:1403] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.007s
W20260709 12:29:17.164237 28439 leader_election.cc:343] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:17.164584 28668 tablet_bootstrap.cc:492] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4: No bootstrap required, opened a new log
I20260709 12:29:17.164724 28439 leader_election.cc:304] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 1e801e5118914af299cb14c9347a16b4, 437622bf51d64158adc0fe88001aad98
I20260709 12:29:17.165158 28668 ts_tablet_manager.cc:1403] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 12:29:17.165618 28670 raft_consensus.cc:2749] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:17.166908 28666 raft_consensus.cc:359] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.167542 28666 raft_consensus.cc:385] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.167822 28666 raft_consensus.cc:740] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.167869 28668 raft_consensus.cc:359] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.168742 28668 raft_consensus.cc:385] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.169107 28668 raft_consensus.cc:740] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e801e5118914af299cb14c9347a16b4, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.168793 28666 consensus_queue.cc:260] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.169919 28668 consensus_queue.cc:260] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.172017 28668 ts_tablet_manager.cc:1434] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:29:17.172713 28666 ts_tablet_manager.cc:1434] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:17.185204 28671 raft_consensus.cc:493] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.185671 28671 raft_consensus.cc:515] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.188200 28671 leader_election.cc:290] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65:34941), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.198563 28476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" is_pre_election: true
I20260709 12:29:17.199332 28476 raft_consensus.cc:2468] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 0.
I20260709 12:29:17.200407 28517 leader_election.cc:304] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437622bf51d64158adc0fe88001aad98, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.201220 28671 raft_consensus.cc:2804] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:17.201203 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4" is_pre_election: true
I20260709 12:29:17.201884 28671 raft_consensus.cc:493] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.202279 28671 raft_consensus.cc:3060] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.202159 28625 raft_consensus.cc:2468] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 0.
I20260709 12:29:17.207736 28671 raft_consensus.cc:515] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.209282 28671 leader_election.cc:290] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 election: Requested vote from peers d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65:34941), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.210197 28476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
I20260709 12:29:17.210247 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4"
I20260709 12:29:17.210767 28476 raft_consensus.cc:3060] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.210918 28625 raft_consensus.cc:3060] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.216279 28476 raft_consensus.cc:2468] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 1.
I20260709 12:29:17.216840 28625 raft_consensus.cc:2468] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 1.
I20260709 12:29:17.217374 28517 leader_election.cc:304] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437622bf51d64158adc0fe88001aad98, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.218236 28671 raft_consensus.cc:2804] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:17.219434 28671 raft_consensus.cc:697] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Becoming Leader. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Running, Role: LEADER
I20260709 12:29:17.220136 28671 consensus_queue.cc:237] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.227279 28372 catalog_manager.cc:5697] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 437622bf51d64158adc0fe88001aad98 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "437622bf51d64158adc0fe88001aad98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:17.340850 28670 raft_consensus.cc:493] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.341538 28670 raft_consensus.cc:515] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.343230 28670 leader_election.cc:290] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.344146 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "437622bf51d64158adc0fe88001aad98" is_pre_election: true
I20260709 12:29:17.344309 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4" is_pre_election: true
I20260709 12:29:17.344816 28551 raft_consensus.cc:2468] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 0.
I20260709 12:29:17.345011 28625 raft_consensus.cc:2468] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 0.
I20260709 12:29:17.345957 28439 leader_election.cc:304] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437622bf51d64158adc0fe88001aad98, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.346688 28670 raft_consensus.cc:2804] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:17.347028 28670 raft_consensus.cc:493] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.347313 28670 raft_consensus.cc:3060] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.353569 28670 raft_consensus.cc:515] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.355225 28670 leader_election.cc:290] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 election: Requested vote from peers 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.356165 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "437622bf51d64158adc0fe88001aad98"
I20260709 12:29:17.356310 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4"
I20260709 12:29:17.356788 28551 raft_consensus.cc:3060] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.356923 28625 raft_consensus.cc:3060] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.362618 28625 raft_consensus.cc:2468] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 1.
I20260709 12:29:17.362653 28551 raft_consensus.cc:2468] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 1.
I20260709 12:29:17.363754 28439 leader_election.cc:304] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e801e5118914af299cb14c9347a16b4, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.364457 28670 raft_consensus.cc:2804] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:17.365427 28670 raft_consensus.cc:697] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Becoming Leader. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Running, Role: LEADER
I20260709 12:29:17.366312 28670 consensus_queue.cc:237] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.374814 28372 catalog_manager.cc:5697] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.417834 28372 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46470:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:17.419888 28372 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:17.445608 28466 tablet_service.cc:1511] Processing CreateTablet for tablet 707a8c22970e4c8d8c2c39aff3fdb0cb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ddae7d09b4ca4f6080a33bf029671cdb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:17.446640 28540 tablet_service.cc:1511] Processing CreateTablet for tablet 707a8c22970e4c8d8c2c39aff3fdb0cb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ddae7d09b4ca4f6080a33bf029671cdb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:17.446961 28466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707a8c22970e4c8d8c2c39aff3fdb0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.447899 28540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707a8c22970e4c8d8c2c39aff3fdb0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.448720 28614 tablet_service.cc:1511] Processing CreateTablet for tablet 707a8c22970e4c8d8c2c39aff3fdb0cb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ddae7d09b4ca4f6080a33bf029671cdb]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:17.450248 28614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707a8c22970e4c8d8c2c39aff3fdb0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.453377 28465 tablet_service.cc:1511] Processing CreateTablet for tablet ad7f0003c292407a8e2917d920d2ce8e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ddae7d09b4ca4f6080a33bf029671cdb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:17.454689 28465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad7f0003c292407a8e2917d920d2ce8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.454443 28615 tablet_service.cc:1511] Processing CreateTablet for tablet ad7f0003c292407a8e2917d920d2ce8e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ddae7d09b4ca4f6080a33bf029671cdb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:17.455749 28615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad7f0003c292407a8e2917d920d2ce8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.458753 28541 tablet_service.cc:1511] Processing CreateTablet for tablet ad7f0003c292407a8e2917d920d2ce8e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=ddae7d09b4ca4f6080a33bf029671cdb]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:17.460058 28541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad7f0003c292407a8e2917d920d2ce8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:17.467379 28665 tablet_bootstrap.cc:492] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28: Bootstrap starting.
I20260709 12:29:17.474222 28665 tablet_bootstrap.cc:654] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.475040 28666 tablet_bootstrap.cc:492] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98: Bootstrap starting.
I20260709 12:29:17.489995 28668 tablet_bootstrap.cc:492] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4: Bootstrap starting.
I20260709 12:29:17.492815 28666 tablet_bootstrap.cc:654] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.497475 28668 tablet_bootstrap.cc:654] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.499583 28665 tablet_bootstrap.cc:492] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28: No bootstrap required, opened a new log
I20260709 12:29:17.501246 28665 ts_tablet_manager.cc:1403] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 12:29:17.504094 28665 raft_consensus.cc:359] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.504868 28665 raft_consensus.cc:385] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.505247 28665 raft_consensus.cc:740] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.506138 28665 consensus_queue.cc:260] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.507262 28668 tablet_bootstrap.cc:492] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4: No bootstrap required, opened a new log
I20260709 12:29:17.508133 28668 ts_tablet_manager.cc:1403] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 12:29:17.508296 28665 ts_tablet_manager.cc:1434] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:29:17.509902 28665 tablet_bootstrap.cc:492] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28: Bootstrap starting.
I20260709 12:29:17.513203 28666 tablet_bootstrap.cc:492] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98: No bootstrap required, opened a new log
I20260709 12:29:17.513895 28666 ts_tablet_manager.cc:1403] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.012s
I20260709 12:29:17.513283 28668 raft_consensus.cc:359] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.515039 28668 raft_consensus.cc:385] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.515408 28668 raft_consensus.cc:740] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e801e5118914af299cb14c9347a16b4, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.516286 28665 tablet_bootstrap.cc:654] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.516455 28668 consensus_queue.cc:260] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.517015 28666 raft_consensus.cc:359] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.517907 28666 raft_consensus.cc:385] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.518249 28666 raft_consensus.cc:740] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.519248 28668 ts_tablet_manager.cc:1434] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:29:17.519217 28666 consensus_queue.cc:260] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.520532 28668 tablet_bootstrap.cc:492] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4: Bootstrap starting.
I20260709 12:29:17.522280 28666 ts_tablet_manager.cc:1434] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:17.523648 28666 tablet_bootstrap.cc:492] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: Bootstrap starting.
I20260709 12:29:17.525846 28665 tablet_bootstrap.cc:492] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28: No bootstrap required, opened a new log
I20260709 12:29:17.526307 28671 raft_consensus.cc:493] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.526860 28671 raft_consensus.cc:515] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.528259 28668 tablet_bootstrap.cc:654] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.529076 28671 leader_election.cc:290] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65:34941), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.531054 28666 tablet_bootstrap.cc:654] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:17.531623 28476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" is_pre_election: true
I20260709 12:29:17.532358 28476 raft_consensus.cc:2468] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 0.
I20260709 12:29:17.533430 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4" is_pre_election: true
I20260709 12:29:17.534117 28625 raft_consensus.cc:2468] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 0.
I20260709 12:29:17.536598 28665 ts_tablet_manager.cc:1403] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 12:29:17.536387 28514 leader_election.cc:304] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e801e5118914af299cb14c9347a16b4, 437622bf51d64158adc0fe88001aad98; no voters: 
I20260709 12:29:17.542037 28671 raft_consensus.cc:2804] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:17.542610 28671 raft_consensus.cc:493] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.543262 28671 raft_consensus.cc:3060] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.552882 28665 raft_consensus.cc:359] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.556270 28665 raft_consensus.cc:385] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.556656 28665 raft_consensus.cc:740] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.557451 28665 consensus_queue.cc:260] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.558555 28668 tablet_bootstrap.cc:492] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4: No bootstrap required, opened a new log
I20260709 12:29:17.559221 28668 ts_tablet_manager.cc:1403] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.012s
I20260709 12:29:17.559549 28671 raft_consensus.cc:515] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
W20260709 12:29:17.560413 28422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:17.561921 28665 ts_tablet_manager.cc:1434] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:29:17.562714 28476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
I20260709 12:29:17.563352 28476 raft_consensus.cc:3060] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.563902 28668 raft_consensus.cc:359] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.564658 28668 raft_consensus.cc:385] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.564944 28668 raft_consensus.cc:740] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e801e5118914af299cb14c9347a16b4, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.566306 28668 consensus_queue.cc:260] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.568841 28668 ts_tablet_manager.cc:1434] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:17.570101 28666 tablet_bootstrap.cc:492] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: No bootstrap required, opened a new log
I20260709 12:29:17.570747 28666 ts_tablet_manager.cc:1403] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.017s
I20260709 12:29:17.571310 28476 raft_consensus.cc:2468] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 1.
I20260709 12:29:17.572467 28517 leader_election.cc:304] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437622bf51d64158adc0fe88001aad98, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.573441 28679 raft_consensus.cc:2804] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:17.573752 28671 leader_election.cc:290] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 1 election: Requested vote from peers d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65:34941), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.575526 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4"
I20260709 12:29:17.575344 28666 raft_consensus.cc:359] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.576170 28666 raft_consensus.cc:385] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:17.576170 28625 raft_consensus.cc:3060] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.576611 28666 raft_consensus.cc:740] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Initialized, Role: FOLLOWER
I20260709 12:29:17.577553 28666 consensus_queue.cc:260] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.580152 28666 ts_tablet_manager.cc:1434] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:17.580026 28670 raft_consensus.cc:493] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:17.580878 28670 raft_consensus.cc:515] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.581696 28679 raft_consensus.cc:697] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Becoming Leader. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Running, Role: LEADER
I20260709 12:29:17.582742 28679 consensus_queue.cc:237] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.583350 28670 leader_election.cc:290] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.584654 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "437622bf51d64158adc0fe88001aad98" is_pre_election: true
I20260709 12:29:17.585335 28551 raft_consensus.cc:2468] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 0.
I20260709 12:29:17.586467 28439 leader_election.cc:304] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437622bf51d64158adc0fe88001aad98, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.587136 28624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4" is_pre_election: true
I20260709 12:29:17.587643 28670 raft_consensus.cc:2804] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:17.587885 28624 raft_consensus.cc:2468] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 0.
I20260709 12:29:17.588608 28670 raft_consensus.cc:493] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:17.589015 28670 raft_consensus.cc:3060] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.591872 28625 raft_consensus.cc:2468] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 1.
I20260709 12:29:17.593132 28371 catalog_manager.cc:5697] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 437622bf51d64158adc0fe88001aad98 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "437622bf51d64158adc0fe88001aad98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.596477 28670 raft_consensus.cc:515] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.598423 28670 leader_election.cc:290] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 election: Requested vote from peers 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:17.599462 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "437622bf51d64158adc0fe88001aad98"
I20260709 12:29:17.599462 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e801e5118914af299cb14c9347a16b4"
I20260709 12:29:17.600289 28551 raft_consensus.cc:3060] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.600360 28625 raft_consensus.cc:3060] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:17.607661 28551 raft_consensus.cc:2468] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 1.
I20260709 12:29:17.607661 28625 raft_consensus.cc:2468] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 1.
I20260709 12:29:17.608968 28439 leader_election.cc:304] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437622bf51d64158adc0fe88001aad98, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.609776 28670 raft_consensus.cc:2804] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:17.610581 28670 raft_consensus.cc:697] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Becoming Leader. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Running, Role: LEADER
I20260709 12:29:17.611552 28670 consensus_queue.cc:237] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.618918 28373 catalog_manager.cc:5697] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.656270 28551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc"
dest_uuid: "437622bf51d64158adc0fe88001aad98"
mode: GRACEFUL
new_leader_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:29:17.656836 28551 raft_consensus.cc:606] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Received request to transfer leadership to TS d8db7578ec5f400cb4eb9dbbcdd21e28
I20260709 12:29:17.669126 28476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0"
dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
mode: GRACEFUL
new_leader_uuid: "1e801e5118914af299cb14c9347a16b4"
 from {username='slave'} at 127.0.0.1:43648
I20260709 12:29:17.669703 28476 raft_consensus.cc:606] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Received request to transfer leadership to TS 1e801e5118914af299cb14c9347a16b4
I20260709 12:29:17.675339 28551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb"
dest_uuid: "437622bf51d64158adc0fe88001aad98"
mode: GRACEFUL
new_leader_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:29:17.675879 28551 raft_consensus.cc:606] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Received request to transfer leadership to TS d8db7578ec5f400cb4eb9dbbcdd21e28
I20260709 12:29:17.740139 28694 consensus_queue.cc:1048] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:17.741058 28679 consensus_queue.cc:1048] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:17.759579 28679 raft_consensus.cc:993] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98: : Instructing follower d8db7578ec5f400cb4eb9dbbcdd21e28 to start an election
I20260709 12:29:17.760224 28679 raft_consensus.cc:1081] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Signalling peer d8db7578ec5f400cb4eb9dbbcdd21e28 to start an election
I20260709 12:29:17.763733 28475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc"
dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
 from {username='slave'} at 127.0.0.1:43642
I20260709 12:29:17.764354 28475 raft_consensus.cc:493] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.764747 28475 raft_consensus.cc:3060] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.774403 28475 raft_consensus.cc:515] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.782141 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e801e5118914af299cb14c9347a16b4"
I20260709 12:29:17.782925 28625 raft_consensus.cc:3060] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.783514 28475 leader_election.cc:290] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 2 election: Requested vote from peers 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021), 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295)
I20260709 12:29:17.786372 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c89283edb564b48bb9f6d11779347bc" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "437622bf51d64158adc0fe88001aad98"
I20260709 12:29:17.786948 28551 raft_consensus.cc:3055] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:17.787325 28551 raft_consensus.cc:740] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Running, Role: LEADER
I20260709 12:29:17.788215 28551 consensus_queue.cc:260] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.789597 28551 raft_consensus.cc:3060] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.791657 28625 raft_consensus.cc:2468] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 2.
I20260709 12:29:17.792851 28439 leader_election.cc:304] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e801e5118914af299cb14c9347a16b4, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:17.793728 28670 raft_consensus.cc:2804] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:17.794273 28670 raft_consensus.cc:697] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 LEADER]: Becoming Leader. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Running, Role: LEADER
I20260709 12:29:17.795233 28670 consensus_queue.cc:237] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } }
I20260709 12:29:17.795650 28551 raft_consensus.cc:2468] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 2.
I20260709 12:29:17.800757 28670 consensus_queue.cc:1048] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:17.804104 28373 catalog_manager.cc:5697] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 reported cstate change: term changed from 1 to 2, leader changed from 437622bf51d64158adc0fe88001aad98 (127.20.98.66) to d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.811478 28670 raft_consensus.cc:993] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28: : Instructing follower 1e801e5118914af299cb14c9347a16b4 to start an election
I20260709 12:29:17.812021 28670 raft_consensus.cc:1081] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Signalling peer 1e801e5118914af299cb14c9347a16b4 to start an election
I20260709 12:29:17.818454 28625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0"
dest_uuid: "1e801e5118914af299cb14c9347a16b4"
 from {username='slave'} at 127.0.0.1:43522
I20260709 12:29:17.819367 28625 raft_consensus.cc:493] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.819957 28625 raft_consensus.cc:3060] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.822791 28670 consensus_queue.cc:1048] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:17.829501 28625 raft_consensus.cc:515] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.840257 28625 leader_election.cc:290] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [CANDIDATE]: Term 2 election: Requested vote from peers d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65:34941), 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295)
I20260709 12:29:17.855312 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0" candidate_uuid: "1e801e5118914af299cb14c9347a16b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "437622bf51d64158adc0fe88001aad98"
I20260709 12:29:17.855729 28475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c54fd39f3042d6b7b22bb6f88ef9d0" candidate_uuid: "1e801e5118914af299cb14c9347a16b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
I20260709 12:29:17.856107 28551 raft_consensus.cc:3060] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.856532 28475 raft_consensus.cc:3055] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:17.856952 28475 raft_consensus.cc:740] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Running, Role: LEADER
I20260709 12:29:17.858026 28475 consensus_queue.cc:260] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.859925 28475 raft_consensus.cc:3060] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.865294 28551 raft_consensus.cc:2468] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e801e5118914af299cb14c9347a16b4 in term 2.
I20260709 12:29:17.866815 28588 leader_election.cc:304] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e801e5118914af299cb14c9347a16b4, 437622bf51d64158adc0fe88001aad98; no voters: 
I20260709 12:29:17.867914 28674 raft_consensus.cc:2804] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:17.868721 28475 raft_consensus.cc:2468] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e801e5118914af299cb14c9347a16b4 in term 2.
I20260709 12:29:17.869591 28674 raft_consensus.cc:697] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 2 LEADER]: Becoming Leader. State: Replica: 1e801e5118914af299cb14c9347a16b4, State: Running, Role: LEADER
I20260709 12:29:17.870749 28674 consensus_queue.cc:237] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:17.879066 28374 catalog_manager.cc:5697] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 reported cstate change: term changed from 1 to 2, leader changed from d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65) to 1e801e5118914af299cb14c9347a16b4 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "1e801e5118914af299cb14c9347a16b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:18.039570 28705 consensus_queue.cc:1048] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:18.045217 28702 consensus_queue.cc:1048] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:18.052896 28711 consensus_queue.cc:1048] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:18.058538 28702 raft_consensus.cc:993] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98: : Instructing follower d8db7578ec5f400cb4eb9dbbcdd21e28 to start an election
I20260709 12:29:18.059012 28702 raft_consensus.cc:1081] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Signalling peer d8db7578ec5f400cb4eb9dbbcdd21e28 to start an election
I20260709 12:29:18.062916 28476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb"
dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
 from {username='slave'} at 127.0.0.1:43642
I20260709 12:29:18.063613 28476 raft_consensus.cc:493] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.064047 28476 raft_consensus.cc:3060] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.065092 28679 consensus_queue.cc:1048] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:18.077816 28476 raft_consensus.cc:515] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:18.079167 28475 raft_consensus.cc:1240] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Rejecting Update request from peer 437622bf51d64158adc0fe88001aad98 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:18.080971 28551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "437622bf51d64158adc0fe88001aad98"
I20260709 12:29:18.081712 28551 raft_consensus.cc:3055] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.082055 28551 raft_consensus.cc:740] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Running, Role: LEADER
I20260709 12:29:18.082996 28551 consensus_queue.cc:260] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:18.083295 28476 leader_election.cc:290] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 2 election: Requested vote from peers 437622bf51d64158adc0fe88001aad98 (127.20.98.66:43295), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:18.084187 28551 raft_consensus.cc:3060] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.085763 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "707a8c22970e4c8d8c2c39aff3fdb0cb" candidate_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e801e5118914af299cb14c9347a16b4"
I20260709 12:29:18.086292 28625 raft_consensus.cc:3060] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.089934 28551 raft_consensus.cc:2468] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 2.
I20260709 12:29:18.091079 28439 leader_election.cc:304] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 437622bf51d64158adc0fe88001aad98, d8db7578ec5f400cb4eb9dbbcdd21e28; no voters: 
I20260709 12:29:18.091938 28711 raft_consensus.cc:2804] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:18.092422 28711 raft_consensus.cc:697] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 LEADER]: Becoming Leader. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Running, Role: LEADER
I20260709 12:29:18.092955 28625 raft_consensus.cc:2468] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8db7578ec5f400cb4eb9dbbcdd21e28 in term 2.
I20260709 12:29:18.093298 28711 consensus_queue.cc:237] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:18.100911 28373 catalog_manager.cc:5697] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 reported cstate change: term changed from 1 to 2, leader changed from 437622bf51d64158adc0fe88001aad98 (127.20.98.66) to d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:18.164361 20873 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:29:18.166095 20873 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:29:18.166482 20873 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:29:18.178339 28476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e"
dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
mode: GRACEFUL
new_leader_uuid: "437622bf51d64158adc0fe88001aad98"
 from {username='slave'} at 127.0.0.1:43654
I20260709 12:29:18.178931 28476 raft_consensus.cc:606] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Received request to transfer leadership to TS 437622bf51d64158adc0fe88001aad98
I20260709 12:29:18.179961 20873 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:29:18.187260 28551 raft_consensus.cc:1275] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Refusing update from remote peer d8db7578ec5f400cb4eb9dbbcdd21e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.188745 28711 consensus_queue.cc:1048] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.198036 28625 raft_consensus.cc:1275] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Refusing update from remote peer d8db7578ec5f400cb4eb9dbbcdd21e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.199644 28670 consensus_queue.cc:1048] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.372077 28476 raft_consensus.cc:1275] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Refusing update from remote peer 1e801e5118914af299cb14c9347a16b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.373518 28674 consensus_queue.cc:1048] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.382853 28551 raft_consensus.cc:1275] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Refusing update from remote peer 1e801e5118914af299cb14c9347a16b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.384680 28674 consensus_queue.cc:1048] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.485795 28711 raft_consensus.cc:993] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28: : Instructing follower 437622bf51d64158adc0fe88001aad98 to start an election
I20260709 12:29:18.486284 28670 raft_consensus.cc:1081] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Signalling peer 437622bf51d64158adc0fe88001aad98 to start an election
I20260709 12:29:18.487980 28551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e"
dest_uuid: "437622bf51d64158adc0fe88001aad98"
 from {username='slave'} at 127.0.0.1:59738
I20260709 12:29:18.488530 28551 raft_consensus.cc:493] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.488852 28551 raft_consensus.cc:3060] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.494050 28551 raft_consensus.cc:515] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:18.495944 28551 leader_election.cc:290] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 2 election: Requested vote from peers d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65:34941), 1e801e5118914af299cb14c9347a16b4 (127.20.98.67:37021)
I20260709 12:29:18.496786 28476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28"
I20260709 12:29:18.497234 28550 raft_consensus.cc:1275] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Refusing update from remote peer d8db7578ec5f400cb4eb9dbbcdd21e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.497520 28476 raft_consensus.cc:3055] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.497449 28625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad7f0003c292407a8e2917d920d2ce8e" candidate_uuid: "437622bf51d64158adc0fe88001aad98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e801e5118914af299cb14c9347a16b4"
I20260709 12:29:18.498059 28476 raft_consensus.cc:740] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8db7578ec5f400cb4eb9dbbcdd21e28, State: Running, Role: LEADER
I20260709 12:29:18.498261 28625 raft_consensus.cc:3060] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.498732 28670 consensus_queue.cc:1048] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.498980 28476 consensus_queue.cc:260] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:18.500185 28476 raft_consensus.cc:3060] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.508045 28624 raft_consensus.cc:1275] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Refusing update from remote peer d8db7578ec5f400cb4eb9dbbcdd21e28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.509186 28625 raft_consensus.cc:2468] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 2.
I20260709 12:29:18.509379 28476 raft_consensus.cc:2468] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 437622bf51d64158adc0fe88001aad98 in term 2.
I20260709 12:29:18.510401 28514 leader_election.cc:304] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e801e5118914af299cb14c9347a16b4, 437622bf51d64158adc0fe88001aad98; no voters: 
I20260709 12:29:18.511233 28702 raft_consensus.cc:2804] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:18.511695 28702 raft_consensus.cc:697] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 2 LEADER]: Becoming Leader. State: Replica: 437622bf51d64158adc0fe88001aad98, State: Running, Role: LEADER
I20260709 12:29:18.512389 28712 consensus_queue.cc:1048] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:18.512504 28702 consensus_queue.cc:237] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } }
I20260709 12:29:18.525053 28374 catalog_manager.cc:5697] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 reported cstate change: term changed from 1 to 2, leader changed from d8db7578ec5f400cb4eb9dbbcdd21e28 (127.20.98.65) to 437622bf51d64158adc0fe88001aad98 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "437622bf51d64158adc0fe88001aad98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8db7578ec5f400cb4eb9dbbcdd21e28" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 34941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "437622bf51d64158adc0fe88001aad98" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 43295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e801e5118914af299cb14c9347a16b4" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:18.537948 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
I20260709 12:29:18.559336 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:18.560139 20873 tablet_replica.cc:333] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28: stopping tablet replica
I20260709 12:29:18.560802 20873 raft_consensus.cc:2243] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.561378 20873 raft_consensus.cc:2272] T ad7f0003c292407a8e2917d920d2ce8e P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.564297 20873 tablet_replica.cc:333] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28: stopping tablet replica
I20260709 12:29:18.565047 20873 raft_consensus.cc:2243] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:18.566216 20873 raft_consensus.cc:2272] T 707a8c22970e4c8d8c2c39aff3fdb0cb P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.569268 20873 tablet_replica.cc:333] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28: stopping tablet replica
I20260709 12:29:18.570046 20873 raft_consensus.cc:2243] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.570631 20873 raft_consensus.cc:2272] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.572969 20873 tablet_replica.cc:333] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28: stopping tablet replica
I20260709 12:29:18.573621 20873 raft_consensus.cc:2243] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:18.574404 20873 raft_consensus.cc:2272] T 8c89283edb564b48bb9f6d11779347bc P d8db7578ec5f400cb4eb9dbbcdd21e28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.598438 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
I20260709 12:29:18.611096 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
I20260709 12:29:18.630981 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:18.631580 20873 tablet_replica.cc:333] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: stopping tablet replica
I20260709 12:29:18.632100 20873 raft_consensus.cc:2243] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:18.632699 20873 pending_rounds.cc:70] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: Trying to abort 1 pending ops.
I20260709 12:29:18.632848 20873 pending_rounds.cc:77] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305626249277759488 op_type: NO_OP noop_request { }
I20260709 12:29:18.633100 20873 raft_consensus.cc:2889] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:18.633400 20873 raft_consensus.cc:2272] T ad7f0003c292407a8e2917d920d2ce8e P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.635785 20873 tablet_replica.cc:333] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98: stopping tablet replica
I20260709 12:29:18.636293 20873 raft_consensus.cc:2243] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.636699 20873 raft_consensus.cc:2272] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.638855 20873 tablet_replica.cc:333] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98: stopping tablet replica
I20260709 12:29:18.639335 20873 raft_consensus.cc:2243] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.639711 20873 raft_consensus.cc:2272] T 8c89283edb564b48bb9f6d11779347bc P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.642225 20873 tablet_replica.cc:333] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98: stopping tablet replica
I20260709 12:29:18.642818 20873 raft_consensus.cc:2243] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.643379 20873 raft_consensus.cc:2272] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 437622bf51d64158adc0fe88001aad98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.667759 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
I20260709 12:29:18.682636 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
I20260709 12:29:18.702913 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:18.703931 20873 tablet_replica.cc:333] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4: stopping tablet replica
I20260709 12:29:18.704613 20873 raft_consensus.cc:2243] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.705215 20873 raft_consensus.cc:2272] T ad7f0003c292407a8e2917d920d2ce8e P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.707577 20873 tablet_replica.cc:333] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4: stopping tablet replica
I20260709 12:29:18.708112 20873 raft_consensus.cc:2243] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.708513 20873 raft_consensus.cc:2272] T 707a8c22970e4c8d8c2c39aff3fdb0cb P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.711450 20873 tablet_replica.cc:333] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4: stopping tablet replica
I20260709 12:29:18.711997 20873 raft_consensus.cc:2243] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:18.712457 20873 raft_consensus.cc:2272] T 8c89283edb564b48bb9f6d11779347bc P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.714951 20873 tablet_replica.cc:333] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4: stopping tablet replica
I20260709 12:29:18.715555 20873 raft_consensus.cc:2243] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:18.716467 20873 raft_consensus.cc:2272] T 57c54fd39f3042d6b7b22bb6f88ef9d0 P 1e801e5118914af299cb14c9347a16b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.730293 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
I20260709 12:29:18.742931 20873 master.cc:562] Master@127.20.98.126:43951 shutting down...
I20260709 12:29:18.759071 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:18.759682 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:18.760048 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P b58e8cd85bdf48f69b1da6a681f92c20: stopping tablet replica
I20260709 12:29:18.778602 20873 master.cc:584] Master@127.20.98.126:43951 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2387 ms)
[----------] 6 tests from LeaderRebalancerTest (270224 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:29:18.808816 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:43045
I20260709 12:29:18.809985 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:18.814945 28719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:18.815228 28720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:18.816433 28722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:18.817523 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:18.818246 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:18.818425 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:18.818550 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600158818539 us; error 0 us; skew 500 ppm
I20260709 12:29:18.819065 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:18.821422 20873 webserver.cc:533] Webserver started at http://127.20.98.126:43557/ using document root <none> and password file <none>
I20260709 12:29:18.821849 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:18.822016 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:18.822223 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:18.823251 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "cc4d9cdbb73e4155bed0ad1919beae52"
format_stamp: "Formatted at 2026-07-09 12:29:18 on dist-test-slave-g3x6"
I20260709 12:29:18.827632 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:29:18.831089 28727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:18.831828 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:29:18.832077 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "cc4d9cdbb73e4155bed0ad1919beae52"
format_stamp: "Formatted at 2026-07-09 12:29:18 on dist-test-slave-g3x6"
I20260709 12:29:18.832315 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:18.850415 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:18.851452 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:18.887234 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:43045
I20260709 12:29:18.887324 28778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:43045 every 8 connection(s)
I20260709 12:29:18.891130 28779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:18.902204 28779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52: Bootstrap starting.
I20260709 12:29:18.906778 28779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:18.910727 28779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52: No bootstrap required, opened a new log
I20260709 12:29:18.912778 28779 raft_consensus.cc:359] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" member_type: VOTER }
I20260709 12:29:18.913178 28779 raft_consensus.cc:385] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:18.913421 28779 raft_consensus.cc:740] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc4d9cdbb73e4155bed0ad1919beae52, State: Initialized, Role: FOLLOWER
I20260709 12:29:18.914093 28779 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" member_type: VOTER }
I20260709 12:29:18.914553 28779 raft_consensus.cc:399] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:18.914772 28779 raft_consensus.cc:493] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:18.915041 28779 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:18.919768 28779 raft_consensus.cc:515] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" member_type: VOTER }
I20260709 12:29:18.920295 28779 leader_election.cc:304] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc4d9cdbb73e4155bed0ad1919beae52; no voters: 
I20260709 12:29:18.921502 28779 leader_election.cc:290] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:18.921818 28782 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:18.923164 28782 raft_consensus.cc:697] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 1 LEADER]: Becoming Leader. State: Replica: cc4d9cdbb73e4155bed0ad1919beae52, State: Running, Role: LEADER
I20260709 12:29:18.923820 28782 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" member_type: VOTER }
I20260709 12:29:18.924422 28779 sys_catalog.cc:565] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:18.926656 28783 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" member_type: VOTER } }
I20260709 12:29:18.926662 28784 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc4d9cdbb73e4155bed0ad1919beae52. Latest consensus state: current_term: 1 leader_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc4d9cdbb73e4155bed0ad1919beae52" member_type: VOTER } }
I20260709 12:29:18.927423 28783 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:18.927438 28784 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:18.931674 28787 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:18.936551 28787 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:18.940832 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:18.945386 28787 catalog_manager.cc:1383] Generated new cluster ID: 97782e369ab2424b849a20e9be7e8c2d
I20260709 12:29:18.945649 28787 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:18.961252 28787 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:18.962570 28787 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:18.980634 28787 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52: Generated new TSK 0
I20260709 12:29:18.981321 28787 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:19.007440 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:19.013676 28800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:19.014750 28801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:19.017009 20873 server_base.cc:1061] running on GCE node
W20260709 12:29:19.017045 28803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:19.018239 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:19.018466 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:19.018641 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600159018619 us; error 0 us; skew 500 ppm
I20260709 12:29:19.019232 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:19.021611 20873 webserver.cc:533] Webserver started at http://127.20.98.65:37569/ using document root <none> and password file <none>
I20260709 12:29:19.022106 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:19.022311 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:19.022583 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:19.023694 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "e36c559027954e63b5050e833d0973e9"
format_stamp: "Formatted at 2026-07-09 12:29:19 on dist-test-slave-g3x6"
I20260709 12:29:19.028311 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:29:19.031775 28808 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.032682 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:19.033046 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "e36c559027954e63b5050e833d0973e9"
format_stamp: "Formatted at 2026-07-09 12:29:19 on dist-test-slave-g3x6"
I20260709 12:29:19.033479 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:19.064592 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:19.065824 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:19.067281 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:19.069614 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:19.069836 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.070081 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:19.070248 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.109148 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:40209
I20260709 12:29:19.109316 28870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:40209 every 8 connection(s)
I20260709 12:29:19.114331 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:19.120908 28875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:19.121794 28876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:19.124475 28878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:19.124830 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:19.126612 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:19.126926 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:19.127131 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600159127115 us; error 0 us; skew 500 ppm
I20260709 12:29:19.127173 28871 heartbeater.cc:344] Connected to a master server at 127.20.98.126:43045
I20260709 12:29:19.127622 28871 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:19.127914 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:19.128522 28871 heartbeater.cc:507] Master 127.20.98.126:43045 requested a full tablet report, sending...
I20260709 12:29:19.130796 20873 webserver.cc:533] Webserver started at http://127.20.98.66:35683/ using document root <none> and password file <none>
I20260709 12:29:19.131362 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:19.131314 28744 ts_manager.cc:194] Registered new tserver with Master: e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209)
I20260709 12:29:19.131804 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:19.132170 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:19.133298 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "b3bda356dbc749128232aabd729ab8d4"
format_stamp: "Formatted at 2026-07-09 12:29:19 on dist-test-slave-g3x6"
I20260709 12:29:19.133841 28744 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46902
I20260709 12:29:19.138106 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:29:19.141557 28883 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.142268 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:29:19.142573 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "b3bda356dbc749128232aabd729ab8d4"
format_stamp: "Formatted at 2026-07-09 12:29:19 on dist-test-slave-g3x6"
I20260709 12:29:19.142858 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:19.158152 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:19.159283 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:19.160718 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:19.163089 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:19.163314 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.163548 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:19.163714 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.203089 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:41075
I20260709 12:29:19.203203 28945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:41075 every 8 connection(s)
I20260709 12:29:19.208027 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:19.214468 28949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:19.216419 28950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:19.218722 28952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:19.219058 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:19.220188 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:19.220471 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:19.220708 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600159220687 us; error 0 us; skew 500 ppm
I20260709 12:29:19.221199 28946 heartbeater.cc:344] Connected to a master server at 127.20.98.126:43045
I20260709 12:29:19.221511 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:19.221701 28946 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:19.222815 28946 heartbeater.cc:507] Master 127.20.98.126:43045 requested a full tablet report, sending...
I20260709 12:29:19.224488 20873 webserver.cc:533] Webserver started at http://127.20.98.67:45825/ using document root <none> and password file <none>
I20260709 12:29:19.225153 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:19.225277 28744 ts_manager.cc:194] Registered new tserver with Master: b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:19.225430 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:19.225948 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:19.226967 28744 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46904
I20260709 12:29:19.227172 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "a0410b4c47e14f779bb1ba114b0261fd"
format_stamp: "Formatted at 2026-07-09 12:29:19 on dist-test-slave-g3x6"
I20260709 12:29:19.232231 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:29:19.235822 28957 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.236656 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:19.236985 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "a0410b4c47e14f779bb1ba114b0261fd"
format_stamp: "Formatted at 2026-07-09 12:29:19 on dist-test-slave-g3x6"
I20260709 12:29:19.237299 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:19.251281 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:19.252370 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:19.253824 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:19.256150 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:19.256372 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.256609 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:19.256775 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:19.295290 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:35231
I20260709 12:29:19.295411 29019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:35231 every 8 connection(s)
I20260709 12:29:19.309659 29020 heartbeater.cc:344] Connected to a master server at 127.20.98.126:43045
I20260709 12:29:19.310199 29020 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:19.310992 29020 heartbeater.cc:507] Master 127.20.98.126:43045 requested a full tablet report, sending...
I20260709 12:29:19.312983 28744 ts_manager.cc:194] Registered new tserver with Master: a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:19.313468 20873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015004973s
I20260709 12:29:19.314441 28744 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46918
I20260709 12:29:19.338234 28744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46934:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:19.341117 28744 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:19.418160 28911 tablet_service.cc:1511] Processing CreateTablet for tablet 61ef4114dac34a739ee409d4a29763e7 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:19.419739 28911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ef4114dac34a739ee409d4a29763e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.421540 28832 tablet_service.cc:1511] Processing CreateTablet for tablet dc2ad640b1264286871e3b9e3eecb5a1 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:19.421919 28833 tablet_service.cc:1511] Processing CreateTablet for tablet 4805c4b9992c492c9db07f4b8146c634 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:19.422868 28910 tablet_service.cc:1511] Processing CreateTablet for tablet aaed468b0c104dcdabdbb36c13a7c1d6 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:19.423360 28832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2ad640b1264286871e3b9e3eecb5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.424358 28831 tablet_service.cc:1511] Processing CreateTablet for tablet b7d1b3b3d9ca4e9ea5cb52f4369b198e (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:19.425774 28831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d1b3b3d9ca4e9ea5cb52f4369b198e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.425611 28909 tablet_service.cc:1511] Processing CreateTablet for tablet 6894bf56d09a4ca89befe3ac36f35b9d (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:19.426617 28833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4805c4b9992c492c9db07f4b8146c634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.424386 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaed468b0c104dcdabdbb36c13a7c1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.428038 28836 tablet_service.cc:1511] Processing CreateTablet for tablet 61ef4114dac34a739ee409d4a29763e7 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:19.429730 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ef4114dac34a739ee409d4a29763e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.430387 28830 tablet_service.cc:1511] Processing CreateTablet for tablet ed151fd7ca6544468ea431cff007c13f (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:19.431660 28830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed151fd7ca6544468ea431cff007c13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.434772 28834 tablet_service.cc:1511] Processing CreateTablet for tablet 6894bf56d09a4ca89befe3ac36f35b9d (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:19.436192 28834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6894bf56d09a4ca89befe3ac36f35b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.436425 28835 tablet_service.cc:1511] Processing CreateTablet for tablet aaed468b0c104dcdabdbb36c13a7c1d6 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:19.437716 28909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6894bf56d09a4ca89befe3ac36f35b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.443769 28835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaed468b0c104dcdabdbb36c13a7c1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.453974 28985 tablet_service.cc:1511] Processing CreateTablet for tablet 61ef4114dac34a739ee409d4a29763e7 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:19.455561 28985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ef4114dac34a739ee409d4a29763e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.458407 28984 tablet_service.cc:1511] Processing CreateTablet for tablet aaed468b0c104dcdabdbb36c13a7c1d6 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:19.460048 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaed468b0c104dcdabdbb36c13a7c1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.462388 28983 tablet_service.cc:1511] Processing CreateTablet for tablet 6894bf56d09a4ca89befe3ac36f35b9d (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:19.484007 28983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6894bf56d09a4ca89befe3ac36f35b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.483737 28828 tablet_service.cc:1511] Processing CreateTablet for tablet 9728c0f18e9f4026a8ffad1a59efad3b (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:19.484946 28910 tablet_service.cc:1511] Processing CreateTablet for tablet 9728c0f18e9f4026a8ffad1a59efad3b (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:19.469568 28982 tablet_service.cc:1511] Processing CreateTablet for tablet 4805c4b9992c492c9db07f4b8146c634 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:19.486274 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9728c0f18e9f4026a8ffad1a59efad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.486646 28977 tablet_service.cc:1511] Processing CreateTablet for tablet 9728c0f18e9f4026a8ffad1a59efad3b (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:19.470763 28981 tablet_service.cc:1511] Processing CreateTablet for tablet dc2ad640b1264286871e3b9e3eecb5a1 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:19.471967 28980 tablet_service.cc:1511] Processing CreateTablet for tablet b7d1b3b3d9ca4e9ea5cb52f4369b198e (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:19.476734 28829 tablet_service.cc:1511] Processing CreateTablet for tablet 585b41d7c794421398e81a52b5a935db (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:19.482234 28978 tablet_service.cc:1511] Processing CreateTablet for tablet 585b41d7c794421398e81a52b5a935db (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:19.473124 28908 tablet_service.cc:1511] Processing CreateTablet for tablet 4805c4b9992c492c9db07f4b8146c634 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:19.520488 28908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4805c4b9992c492c9db07f4b8146c634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.477945 28904 tablet_service.cc:1511] Processing CreateTablet for tablet 585b41d7c794421398e81a52b5a935db (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:19.524225 28904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585b41d7c794421398e81a52b5a935db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.511655 28828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9728c0f18e9f4026a8ffad1a59efad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.474356 28906 tablet_service.cc:1511] Processing CreateTablet for tablet b7d1b3b3d9ca4e9ea5cb52f4369b198e (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:19.528927 28829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585b41d7c794421398e81a52b5a935db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.508507 28982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4805c4b9992c492c9db07f4b8146c634. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.475564 28905 tablet_service.cc:1511] Processing CreateTablet for tablet ed151fd7ca6544468ea431cff007c13f (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:19.479139 28907 tablet_service.cc:1511] Processing CreateTablet for tablet dc2ad640b1264286871e3b9e3eecb5a1 (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:19.480393 28979 tablet_service.cc:1511] Processing CreateTablet for tablet ed151fd7ca6544468ea431cff007c13f (DEFAULT_TABLE table=test-workload [id=b4093d7637be432096ebc446471f80cf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:19.556865 28979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed151fd7ca6544468ea431cff007c13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.585232 28906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d1b3b3d9ca4e9ea5cb52f4369b198e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.586227 29036 tablet_bootstrap.cc:492] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:19.585462 28977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9728c0f18e9f4026a8ffad1a59efad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.589537 28907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2ad640b1264286871e3b9e3eecb5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.590986 28980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7d1b3b3d9ca4e9ea5cb52f4369b198e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.593593 28978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 585b41d7c794421398e81a52b5a935db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.593969 29035 tablet_bootstrap.cc:492] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:19.597785 28905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed151fd7ca6544468ea431cff007c13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.601804 28981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2ad640b1264286871e3b9e3eecb5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:19.617244 29035 tablet_bootstrap.cc:654] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.634418 29036 tablet_bootstrap.cc:654] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.638294 29037 tablet_bootstrap.cc:492] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:19.647900 29036 tablet_bootstrap.cc:492] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:19.648715 29036 ts_tablet_manager.cc:1403] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.005s
I20260709 12:29:19.650575 29037 tablet_bootstrap.cc:654] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.652484 29036 raft_consensus.cc:359] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.653396 29036 raft_consensus.cc:385] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.653761 29036 raft_consensus.cc:740] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.671667 29035 tablet_bootstrap.cc:492] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:19.672290 29035 ts_tablet_manager.cc:1403] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.079s	user 0.005s	sys 0.013s
I20260709 12:29:19.661504 29036 consensus_queue.cc:260] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.675727 29035 raft_consensus.cc:359] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.676506 29035 raft_consensus.cc:385] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.676801 29035 raft_consensus.cc:740] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.685735 29036 ts_tablet_manager.cc:1434] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.037s	user 0.018s	sys 0.000s
I20260709 12:29:19.687527 28871 heartbeater.cc:499] Master 127.20.98.126:43045 was elected leader, sending a full tablet report...
I20260709 12:29:19.690501 29036 tablet_bootstrap.cc:492] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:19.697381 29035 consensus_queue.cc:260] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.698372 29037 tablet_bootstrap.cc:492] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:19.699433 29037 ts_tablet_manager.cc:1403] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.004s
I20260709 12:29:19.699580 29036 tablet_bootstrap.cc:654] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.698673 29042 raft_consensus.cc:493] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.702934 29037 raft_consensus.cc:359] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.704449 29037 raft_consensus.cc:385] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.704268 29042 raft_consensus.cc:515] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.704876 29037 raft_consensus.cc:740] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.705816 29037 consensus_queue.cc:260] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.709856 29036 tablet_bootstrap.cc:492] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:19.710697 29036 ts_tablet_manager.cc:1403] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:29:19.714669 29036 raft_consensus.cc:359] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.717052 29020 heartbeater.cc:499] Master 127.20.98.126:43045 was elected leader, sending a full tablet report...
I20260709 12:29:19.718765 29037 ts_tablet_manager.cc:1434] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.001s
I20260709 12:29:19.720101 29037 tablet_bootstrap.cc:492] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:19.722072 29036 raft_consensus.cc:385] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.722512 29036 raft_consensus.cc:740] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.723531 29036 consensus_queue.cc:260] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.725483 28946 heartbeater.cc:499] Master 127.20.98.126:43045 was elected leader, sending a full tablet report...
I20260709 12:29:19.725651 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
W20260709 12:29:19.728483 28887 leader_election.cc:343] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:19.730700 29036 ts_tablet_manager.cc:1434] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:29:19.732074 29036 tablet_bootstrap.cc:492] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:19.734743 29035 ts_tablet_manager.cc:1434] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.004s
I20260709 12:29:19.736222 29035 tablet_bootstrap.cc:492] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:19.742708 29035 tablet_bootstrap.cc:654] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.742708 29036 tablet_bootstrap.cc:654] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.746146 29037 tablet_bootstrap.cc:654] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.748324 29036 tablet_bootstrap.cc:492] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:19.748998 29036 ts_tablet_manager.cc:1403] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:29:19.752192 29036 raft_consensus.cc:359] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.752658 29037 tablet_bootstrap.cc:492] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:19.752985 29036 raft_consensus.cc:385] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.753569 29037 ts_tablet_manager.cc:1403] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.003s
I20260709 12:29:19.753386 29036 raft_consensus.cc:740] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.755503 29036 consensus_queue.cc:260] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.756807 29037 raft_consensus.cc:359] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.757305 29042 leader_election.cc:290] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231), e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209)
I20260709 12:29:19.757584 29037 raft_consensus.cc:385] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.757937 29037 raft_consensus.cc:740] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.761518 29036 ts_tablet_manager.cc:1434] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:29:19.762763 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:19.763068 29036 tablet_bootstrap.cc:492] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:19.763407 28846 raft_consensus.cc:2468] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:19.763934 29037 consensus_queue.cc:260] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.764875 28886 leader_election.cc:304] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:19.766286 29037 ts_tablet_manager.cc:1434] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:29:19.767325 29037 tablet_bootstrap.cc:492] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:19.771399 29042 raft_consensus.cc:2804] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:19.771891 29042 raft_consensus.cc:493] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.772235 29042 raft_consensus.cc:3060] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:19.773073 29036 tablet_bootstrap.cc:654] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.784862 29037 tablet_bootstrap.cc:654] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.786223 29042 raft_consensus.cc:515] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.788159 29035 tablet_bootstrap.cc:492] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:19.788735 29035 ts_tablet_manager.cc:1403] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.012s
I20260709 12:29:19.792131 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:19.792084 29035 raft_consensus.cc:359] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.792898 28995 raft_consensus.cc:3060] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:19.793253 29037 tablet_bootstrap.cc:492] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:19.793845 29037 ts_tablet_manager.cc:1403] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 12:29:19.794806 29042 leader_election.cc:290] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231), e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209)
I20260709 12:29:19.795989 29036 tablet_bootstrap.cc:492] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:19.796542 29036 ts_tablet_manager.cc:1403] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.009s
I20260709 12:29:19.796835 29037 raft_consensus.cc:359] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.792898 29035 raft_consensus.cc:385] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.797614 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:19.797973 29035 raft_consensus.cc:740] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.798386 28846 raft_consensus.cc:3060] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:19.799081 29035 consensus_queue.cc:260] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.799438 29036 raft_consensus.cc:359] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.800220 29036 raft_consensus.cc:385] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.801723 29036 raft_consensus.cc:740] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.801923 29035 ts_tablet_manager.cc:1434] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:29:19.803051 29035 tablet_bootstrap.cc:492] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:19.802630 29036 consensus_queue.cc:260] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.804180 28995 raft_consensus.cc:2468] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:19.805260 29036 ts_tablet_manager.cc:1434] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:29:19.805629 28887 leader_election.cc:304] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:19.806468 29036 tablet_bootstrap.cc:492] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:19.806664 29042 raft_consensus.cc:2804] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:19.807299 29042 raft_consensus.cc:697] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:19.808244 29042 consensus_queue.cc:237] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:19.810806 29035 tablet_bootstrap.cc:654] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.815268 29036 tablet_bootstrap.cc:654] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.823436 28846 raft_consensus.cc:2468] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:19.797780 29037 raft_consensus.cc:385] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.825968 29037 raft_consensus.cc:740] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.826877 29037 consensus_queue.cc:260] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.828298 29035 tablet_bootstrap.cc:492] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:19.831388 29035 ts_tablet_manager.cc:1403] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.007s
I20260709 12:29:19.832216 29036 tablet_bootstrap.cc:492] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:19.832778 29036 ts_tablet_manager.cc:1403] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.005s
I20260709 12:29:19.834335 29035 raft_consensus.cc:359] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.835225 29035 raft_consensus.cc:385] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.834179 28742 catalog_manager.cc:5697] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:19.835598 29035 raft_consensus.cc:740] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.835903 29036 raft_consensus.cc:359] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.828907 29041 raft_consensus.cc:493] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.836735 29036 raft_consensus.cc:385] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.837081 29036 raft_consensus.cc:740] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.836982 29041 raft_consensus.cc:515] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.837778 29035 consensus_queue.cc:260] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.838044 29036 consensus_queue.cc:260] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.840518 29035 ts_tablet_manager.cc:1434] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:29:19.841627 29035 tablet_bootstrap.cc:492] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:19.847141 29037 ts_tablet_manager.cc:1434] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 12:29:19.848583 29037 tablet_bootstrap.cc:492] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:19.861783 29037 tablet_bootstrap.cc:654] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.845635 29041 leader_election.cc:290] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:19.866870 29035 tablet_bootstrap.cc:654] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.873960 29036 ts_tablet_manager.cc:1434] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.041s	user 0.015s	sys 0.022s
I20260709 12:29:19.875424 29036 tablet_bootstrap.cc:492] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:19.880550 29054 raft_consensus.cc:493] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.881372 29054 raft_consensus.cc:515] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.883024 29036 tablet_bootstrap.cc:654] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.891158 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ad640b1264286871e3b9e3eecb5a1" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:19.893440 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894bf56d09a4ca89befe3ac36f35b9d" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:19.894454 28920 raft_consensus.cc:2468] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 0.
W20260709 12:29:19.896414 28809 leader_election.cc:343] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:19.897398 28809 leader_election.cc:304] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:19.898305 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ad640b1264286871e3b9e3eecb5a1" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:19.898515 29041 raft_consensus.cc:2804] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:19.899988 29041 raft_consensus.cc:493] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:19.900516 29041 raft_consensus.cc:3060] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:19.901919 28812 leader_election.cc:343] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:19.902278 29054 leader_election.cc:290] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:19.902472 28812 leader_election.cc:304] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:19.902877 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894bf56d09a4ca89befe3ac36f35b9d" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:19.903731 29054 raft_consensus.cc:2749] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:19.903832 28995 raft_consensus.cc:2468] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 0.
I20260709 12:29:19.904510 29037 tablet_bootstrap.cc:492] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:19.905054 29037 ts_tablet_manager.cc:1403] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.057s	user 0.029s	sys 0.015s
I20260709 12:29:19.907895 29037 raft_consensus.cc:359] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.908367 29037 raft_consensus.cc:385] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.908558 29037 raft_consensus.cc:740] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.910542 29037 consensus_queue.cc:260] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.912462 29037 ts_tablet_manager.cc:1434] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:29:19.913498 29037 tablet_bootstrap.cc:492] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:19.913892 29035 tablet_bootstrap.cc:492] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:19.914507 29035 ts_tablet_manager.cc:1403] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.006s
I20260709 12:29:19.915598 29041 raft_consensus.cc:515] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.918092 29035 raft_consensus.cc:359] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.918934 29035 raft_consensus.cc:385] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.919076 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894bf56d09a4ca89befe3ac36f35b9d" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:19.919852 28920 raft_consensus.cc:3060] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:19.920470 29036 tablet_bootstrap.cc:492] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:19.921281 29036 ts_tablet_manager.cc:1403] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.012s
I20260709 12:29:19.920456 29037 tablet_bootstrap.cc:654] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.924825 29036 raft_consensus.cc:359] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.925686 29036 raft_consensus.cc:385] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.926026 29036 raft_consensus.cc:740] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.926990 29036 consensus_queue.cc:260] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.929664 29036 ts_tablet_manager.cc:1434] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:19.930635 29041 leader_election.cc:290] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:19.919317 29035 raft_consensus.cc:740] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.931962 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6894bf56d09a4ca89befe3ac36f35b9d" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:19.932708 28995 raft_consensus.cc:3060] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:19.933255 29035 consensus_queue.cc:260] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.936302 29035 ts_tablet_manager.cc:1434] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:29:19.937577 29035 tablet_bootstrap.cc:492] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
W20260709 12:29:19.939077 28792 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:19.945540 29035 tablet_bootstrap.cc:654] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.946779 28995 raft_consensus.cc:2468] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:19.948366 28812 leader_election.cc:304] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:19.949625 29041 raft_consensus.cc:2804] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:19.951633 29041 raft_consensus.cc:697] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:19.952942 29041 consensus_queue.cc:237] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.957630 29036 tablet_bootstrap.cc:492] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:19.961113 29035 tablet_bootstrap.cc:492] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:19.961930 29035 ts_tablet_manager.cc:1403] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 12:29:19.966496 29036 tablet_bootstrap.cc:654] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.932001 28920 raft_consensus.cc:2468] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:19.966106 29035 raft_consensus.cc:359] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.968838 29035 raft_consensus.cc:385] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:19.969276 29035 raft_consensus.cc:740] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:19.970685 29035 consensus_queue.cc:260] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.970430 28743 catalog_manager.cc:5697] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:19.979211 29035 ts_tablet_manager.cc:1434] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:29:19.980971 29035 tablet_bootstrap.cc:492] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:19.991492 29035 tablet_bootstrap.cc:654] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:19.991928 29037 tablet_bootstrap.cc:492] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:19.995127 29036 tablet_bootstrap.cc:492] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:19.995733 29037 ts_tablet_manager.cc:1403] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.082s	user 0.031s	sys 0.044s
I20260709 12:29:19.995913 29036 ts_tablet_manager.cc:1403] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.020s
I20260709 12:29:19.997067 29042 raft_consensus.cc:493] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:19.997840 29042 raft_consensus.cc:515] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.998992 29037 raft_consensus.cc:359] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:19.999784 29037 raft_consensus.cc:385] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.000092 29037 raft_consensus.cc:740] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.000905 29037 consensus_queue.cc:260] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.001659 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.003255 29037 ts_tablet_manager.cc:1434] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:29:20.003921 28886 leader_election.cc:343] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.004563 29042 leader_election.cc:290] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.004706 29037 tablet_bootstrap.cc:492] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:20.005402 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.006472 28995 raft_consensus.cc:2468] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:20.009469 29036 raft_consensus.cc:359] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.009591 28887 leader_election.cc:304] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.010433 29036 raft_consensus.cc:385] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.010816 29036 raft_consensus.cc:740] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.011554 29042 raft_consensus.cc:2804] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:20.011732 29036 consensus_queue.cc:260] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.012369 29042 raft_consensus.cc:493] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.012604 29037 tablet_bootstrap.cc:654] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.014556 29036 ts_tablet_manager.cc:1434] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 12:29:20.016167 29042 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.021937 29043 raft_consensus.cc:493] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.022585 29043 raft_consensus.cc:515] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.024390 29042 raft_consensus.cc:515] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.026412 29037 tablet_bootstrap.cc:492] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:20.026577 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.026971 29037 ts_tablet_manager.cc:1403] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:29:20.027366 28846 raft_consensus.cc:2468] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:20.027797 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.028862 29043 leader_election.cc:290] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.029706 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.030357 29037 raft_consensus.cc:359] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.031133 29037 raft_consensus.cc:385] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.031450 29037 raft_consensus.cc:740] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.031551 29035 tablet_bootstrap.cc:492] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
W20260709 12:29:20.031599 28887 leader_election.cc:343] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.032297 29035 ts_tablet_manager.cc:1403] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.007s
I20260709 12:29:20.032361 29037 consensus_queue.cc:260] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.033337 28886 leader_election.cc:304] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd
W20260709 12:29:20.034742 28886 leader_election.cc:343] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.035174 29037 ts_tablet_manager.cc:1434] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:20.035308 29036 tablet_bootstrap.cc:492] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:20.035575 29043 raft_consensus.cc:2804] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:20.036118 29043 raft_consensus.cc:493] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.036257 29037 tablet_bootstrap.cc:492] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:20.036549 29043 raft_consensus.cc:3060] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.036983 29035 raft_consensus.cc:359] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.037930 29035 raft_consensus.cc:385] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.038323 29035 raft_consensus.cc:740] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.039280 29035 consensus_queue.cc:260] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.043951 29037 tablet_bootstrap.cc:654] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.044351 29036 tablet_bootstrap.cc:654] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.063282 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.064106 28995 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.070390 29070 raft_consensus.cc:493] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.071086 29070 raft_consensus.cc:515] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.072610 28995 raft_consensus.cc:2468] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:20.073567 29042 leader_election.cc:290] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.077930 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.078562 29043 raft_consensus.cc:515] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.078766 28887 leader_election.cc:304] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.075565 29070 leader_election.cc:290] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.075486 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.080683 28845 raft_consensus.cc:2468] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:20.082405 29043 leader_election.cc:290] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.082623 29035 ts_tablet_manager.cc:1434] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.017s
I20260709 12:29:20.085516 29037 tablet_bootstrap.cc:492] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:20.108592 29037 ts_tablet_manager.cc:1403] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.073s	user 0.041s	sys 0.020s
I20260709 12:29:20.082712 28886 leader_election.cc:304] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.109774 29043 raft_consensus.cc:2804] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:20.096884 29070 raft_consensus.cc:2804] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.110277 29043 raft_consensus.cc:493] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.110692 29070 raft_consensus.cc:697] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:20.110731 29043 raft_consensus.cc:3060] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.111181 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.111851 29070 consensus_queue.cc:237] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.112865 29037 raft_consensus.cc:359] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.113672 29037 raft_consensus.cc:385] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.113725 29035 tablet_bootstrap.cc:492] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:20.114050 29037 raft_consensus.cc:740] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.115053 29037 consensus_queue.cc:260] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.083860 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.116467 28845 raft_consensus.cc:3060] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.123049 29035 tablet_bootstrap.cc:654] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.123180 29036 tablet_bootstrap.cc:492] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:20.122850 29043 raft_consensus.cc:515] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.124074 29036 ts_tablet_manager.cc:1403] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.034s
I20260709 12:29:20.125486 29037 ts_tablet_manager.cc:1434] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:29:20.126458 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.127177 28846 raft_consensus.cc:3060] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.128618 28845 raft_consensus.cc:2468] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:20.127677 29036 raft_consensus.cc:359] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.129724 29036 raft_consensus.cc:385] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.130215 29036 raft_consensus.cc:740] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.131263 29036 consensus_queue.cc:260] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.135842 29036 ts_tablet_manager.cc:1434] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:29:20.136010 29037 tablet_bootstrap.cc:492] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:20.139917 28846 raft_consensus.cc:2468] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:20.139945 29036 tablet_bootstrap.cc:492] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:20.132079 28886 leader_election.cc:304] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.145942 28886 leader_election.cc:304] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.146700 29037 tablet_bootstrap.cc:654] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.146983 29067 raft_consensus.cc:2804] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.147625 29043 leader_election.cc:290] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.147770 29067 raft_consensus.cc:697] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
W20260709 12:29:20.109540 28887 leader_election.cc:343] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.149598 29041 raft_consensus.cc:493] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.150383 29041 raft_consensus.cc:515] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.151310 29043 raft_consensus.cc:2804] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.151829 29043 raft_consensus.cc:697] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
W20260709 12:29:20.151746 28887 leader_election.cc:343] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.152729 29043 consensus_queue.cc:237] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.153620 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.154702 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.155431 28995 raft_consensus.cc:2468] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 0.
I20260709 12:29:20.156976 28812 leader_election.cc:304] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.157513 29036 tablet_bootstrap.cc:654] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.157941 29054 raft_consensus.cc:2804] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:20.158401 29054 raft_consensus.cc:493] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:20.158797 28887 leader_election.cc:343] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.158947 29067 consensus_queue.cc:237] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.160692 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:20.158815 29054 raft_consensus.cc:3060] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:20.162331 28809 leader_election.cc:343] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.152818 29041 leader_election.cc:290] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.168522 29036 tablet_bootstrap.cc:492] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:20.169044 29036 ts_tablet_manager.cc:1403] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.009s
I20260709 12:29:20.170647 29037 tablet_bootstrap.cc:492] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:20.171252 29037 ts_tablet_manager.cc:1403] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.010s
I20260709 12:29:20.171765 29036 raft_consensus.cc:359] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.172495 29036 raft_consensus.cc:385] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.172793 29036 raft_consensus.cc:740] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.172582 29054 raft_consensus.cc:515] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.173722 29036 consensus_queue.cc:260] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.175154 29054 leader_election.cc:290] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.175045 29037 raft_consensus.cc:359] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.176072 29037 raft_consensus.cc:385] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.175962 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:20.176635 29037 raft_consensus.cc:740] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.176709 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.175195 29045 raft_consensus.cc:493] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:20.177433 28809 leader_election.cc:343] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.180437 29036 ts_tablet_manager.cc:1434] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:29:20.177700 29037 consensus_queue.cc:260] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.180697 29035 tablet_bootstrap.cc:492] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:20.182111 29045 raft_consensus.cc:515] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.182740 29035 ts_tablet_manager.cc:1403] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.069s	user 0.027s	sys 0.003s
I20260709 12:29:20.177448 28995 raft_consensus.cc:3060] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.186635 29035 raft_consensus.cc:359] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.188508 29035 raft_consensus.cc:385] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.188853 29035 raft_consensus.cc:740] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.189371 29045 leader_election.cc:290] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:20.189742 29035 consensus_queue.cc:260] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.195940 29035 ts_tablet_manager.cc:1434] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:29:20.200150 29035 tablet_bootstrap.cc:492] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:20.201640 28995 raft_consensus.cc:2468] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:20.202965 28812 leader_election.cc:304] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:20.204658 29054 raft_consensus.cc:2804] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.205315 29054 raft_consensus.cc:697] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:20.206498 29054 consensus_queue.cc:237] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.207829 29035 tablet_bootstrap.cc:654] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.214057 29037 ts_tablet_manager.cc:1434] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.001s
I20260709 12:29:20.217646 29037 tablet_bootstrap.cc:492] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:20.222224 28743 catalog_manager.cc:5697] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.224344 29037 tablet_bootstrap.cc:654] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.225586 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.226420 28846 raft_consensus.cc:2468] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 0.
I20260709 12:29:20.228137 28960 leader_election.cc:304] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.229389 29077 raft_consensus.cc:2804] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:20.229938 29077 raft_consensus.cc:493] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.230383 29077 raft_consensus.cc:3060] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.241256 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
W20260709 12:29:20.243675 28958 leader_election.cc:343] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.246954 28743 catalog_manager.cc:5697] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.248454 28743 catalog_manager.cc:5697] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.249706 28743 catalog_manager.cc:5697] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.249754 29077 raft_consensus.cc:515] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.253944 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.254801 28846 raft_consensus.cc:3060] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.258345 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
W20260709 12:29:20.260532 28958 leader_election.cc:343] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:20.272365 28846 raft_consensus.cc:2468] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 1.
I20260709 12:29:20.272464 29037 tablet_bootstrap.cc:492] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:20.273726 29077 leader_election.cc:290] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:20.274029 28960 leader_election.cc:304] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:20.273931 29037 ts_tablet_manager.cc:1403] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.016s
I20260709 12:29:20.275403 29077 raft_consensus.cc:2804] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.275655 29035 tablet_bootstrap.cc:492] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:20.276182 29077 raft_consensus.cc:697] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:20.276286 29035 ts_tablet_manager.cc:1403] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.018s
I20260709 12:29:20.277104 29077 consensus_queue.cc:237] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.278131 29037 raft_consensus.cc:359] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.278870 29037 raft_consensus.cc:385] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.278880 29035 raft_consensus.cc:359] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.279244 29037 raft_consensus.cc:740] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.279706 29035 raft_consensus.cc:385] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.280035 29035 raft_consensus.cc:740] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.280259 29037 consensus_queue.cc:260] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.280761 29035 consensus_queue.cc:260] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.282862 29037 ts_tablet_manager.cc:1434] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:20.284876 29035 ts_tablet_manager.cc:1434] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:20.285797 29035 tablet_bootstrap.cc:492] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:20.287837 28743 catalog_manager.cc:5697] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 0 to 1, leader changed from <none> to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 1 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.290066 29035 tablet_bootstrap.cc:654] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:20.295557 29035 tablet_bootstrap.cc:492] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:20.296113 29035 ts_tablet_manager.cc:1403] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:29:20.299127 29035 raft_consensus.cc:359] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.299682 29035 raft_consensus.cc:385] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:20.299952 29035 raft_consensus.cc:740] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:20.300624 29035 consensus_queue.cc:260] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.302867 29035 ts_tablet_manager.cc:1434] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:20.308702 29067 consensus_queue.cc:1048] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.315994 29077 raft_consensus.cc:493] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.316313 29045 raft_consensus.cc:493] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.316573 29077 raft_consensus.cc:515] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.316946 29045 raft_consensus.cc:515] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.319233 29045 leader_election.cc:290] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:20.321313 29070 raft_consensus.cc:493] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.321376 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:20.322096 29070 raft_consensus.cc:515] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.324107 29070 leader_election.cc:290] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.324843 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:20.325664 28920 raft_consensus.cc:2468] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 0.
I20260709 12:29:20.327322 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ad640b1264286871e3b9e3eecb5a1" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.328778 28994 raft_consensus.cc:2468] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:20.331357 28887 leader_election.cc:304] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:20.331368 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.332777 28846 raft_consensus.cc:2468] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 0.
I20260709 12:29:20.331740 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.333480 29067 raft_consensus.cc:2804] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:20.333957 28845 raft_consensus.cc:2393] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0410b4c47e14f779bb1ba114b0261fd in current term 1: Already voted for candidate b3bda356dbc749128232aabd729ab8d4 in this term.
I20260709 12:29:20.333982 29067 raft_consensus.cc:493] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.334632 29067 raft_consensus.cc:3060] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.335563 28960 leader_election.cc:304] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd; no voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.337479 28958 leader_election.cc:304] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:20.338496 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ad640b1264286871e3b9e3eecb5a1" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.339191 28846 raft_consensus.cc:2468] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:20.339913 29070 consensus_queue.cc:1048] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.327734 29077 leader_election.cc:290] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:20.343068 29077 raft_consensus.cc:3060] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.343214 29045 raft_consensus.cc:2804] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:20.343230 29067 raft_consensus.cc:515] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.344066 29045 raft_consensus.cc:493] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:20.344503 29045 raft_consensus.cc:3060] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.347405 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ad640b1264286871e3b9e3eecb5a1" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.348078 28994 raft_consensus.cc:3060] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.347784 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2ad640b1264286871e3b9e3eecb5a1" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.348757 28845 raft_consensus.cc:3060] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.352525 29077 raft_consensus.cc:2749] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:20.354142 29067 leader_election.cc:290] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.359294 28845 raft_consensus.cc:2468] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:20.359555 28994 raft_consensus.cc:2468] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:20.360877 28887 leader_election.cc:304] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:20.362155 29067 raft_consensus.cc:2804] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.361811 29045 raft_consensus.cc:515] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.363781 29067 raft_consensus.cc:697] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:20.364977 29067 consensus_queue.cc:237] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.366192 29045 leader_election.cc:290] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:20.367585 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.368290 28846 raft_consensus.cc:3060] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.372922 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:20.373692 28920 raft_consensus.cc:3060] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.376231 28743 catalog_manager.cc:5697] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.381201 28846 raft_consensus.cc:2468] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 1.
I20260709 12:29:20.382324 28920 raft_consensus.cc:2468] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 1.
I20260709 12:29:20.383682 28958 leader_election.cc:304] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:20.384524 29045 raft_consensus.cc:2804] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:20.385066 29045 raft_consensus.cc:697] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:20.386039 29045 consensus_queue.cc:237] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.387701 29054 consensus_queue.cc:1048] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:20.395473 28743 catalog_manager.cc:5697] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 0 to 1, leader changed from <none> to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 1 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.400918 29041 consensus_queue.cc:1048] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:20.402990 29067 raft_consensus.cc:493] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.403609 29067 raft_consensus.cc:515] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.405942 29067 leader_election.cc:290] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.406797 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.408744 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.409745 28994 raft_consensus.cc:2393] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3bda356dbc749128232aabd729ab8d4 in current term 1: Already voted for candidate e36c559027954e63b5050e833d0973e9 in this term.
I20260709 12:29:20.410873 28887 leader_election.cc:304] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4; no voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.413463 29062 raft_consensus.cc:493] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.414060 29062 raft_consensus.cc:515] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.414683 29067 raft_consensus.cc:3060] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.416564 29062 leader_election.cc:290] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.418009 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.418946 28994 raft_consensus.cc:2393] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e36c559027954e63b5050e833d0973e9 in current term 1: Already voted for candidate b3bda356dbc749128232aabd729ab8d4 in this term.
I20260709 12:29:20.422103 29067 raft_consensus.cc:2749] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:20.424083 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:20.426013 28809 leader_election.cc:304] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:20.426848 29062 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.432996 29062 raft_consensus.cc:2749] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:20.463022 28920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
mode: GRACEFUL
new_leader_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:43702
I20260709 12:29:20.463744 28920 raft_consensus.cc:606] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Received request to transfer leadership to TS e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.469791 28920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
mode: GRACEFUL
new_leader_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:43702
I20260709 12:29:20.470400 28920 raft_consensus.cc:606] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Received request to transfer leadership to TS e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.487129 29067 raft_consensus.cc:493] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.487784 28994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
mode: GRACEFUL
new_leader_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:53522
I20260709 12:29:20.487803 29067 raft_consensus.cc:515] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.488390 28994 raft_consensus.cc:606] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Received request to transfer leadership to TS e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.490212 29067 leader_election.cc:290] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.491274 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.491232 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:20.492303 28846 raft_consensus.cc:2393] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b3bda356dbc749128232aabd729ab8d4 in current term 1: Already voted for candidate a0410b4c47e14f779bb1ba114b0261fd in this term.
I20260709 12:29:20.493343 28886 leader_election.cc:304] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4; no voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.494164 29067 raft_consensus.cc:3060] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.501314 29067 raft_consensus.cc:2749] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:20.505764 28846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
mode: GRACEFUL
new_leader_uuid: "b3bda356dbc749128232aabd729ab8d4"
 from {username='slave'} at 127.0.0.1:48452
I20260709 12:29:20.506405 28846 raft_consensus.cc:606] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Received request to transfer leadership to TS b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:20.514851 28994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "585b41d7c794421398e81a52b5a935db"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
mode: GRACEFUL
new_leader_uuid: "b3bda356dbc749128232aabd729ab8d4"
 from {username='slave'} at 127.0.0.1:53522
I20260709 12:29:20.515383 28994 raft_consensus.cc:606] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Received request to transfer leadership to TS b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:20.520411 28920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
mode: GRACEFUL
new_leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:43702
I20260709 12:29:20.520936 28920 raft_consensus.cc:606] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Received request to transfer leadership to TS a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:20.536499 29045 raft_consensus.cc:493] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:20.537325 29045 raft_consensus.cc:515] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.539279 29045 leader_election.cc:290] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:20.540122 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:20.540484 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:20.541100 28846 raft_consensus.cc:2393] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0410b4c47e14f779bb1ba114b0261fd in current term 1: Already voted for candidate b3bda356dbc749128232aabd729ab8d4 in this term.
I20260709 12:29:20.542194 28960 leader_election.cc:304] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd; no voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9
I20260709 12:29:20.543025 29045 raft_consensus.cc:3060] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:20.543301 29067 consensus_queue.cc:1048] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.550484 29045 raft_consensus.cc:2749] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:20.555157 29067 consensus_queue.cc:1048] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.597301 29067 consensus_queue.cc:1048] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.604333 29042 raft_consensus.cc:993] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4: : Instructing follower a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:20.604887 29043 raft_consensus.cc:1081] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Signalling peer a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:20.606578 28995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:53502
I20260709 12:29:20.608172 28995 raft_consensus.cc:493] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.608621 28995 raft_consensus.cc:3060] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.610953 29043 consensus_queue.cc:1048] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.617887 28995 raft_consensus.cc:515] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.624578 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.625029 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728c0f18e9f4026a8ffad1a59efad3b" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:20.625278 28846 raft_consensus.cc:3060] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.625733 28920 raft_consensus.cc:3055] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:20.625950 28995 leader_election.cc:290] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:20.626150 28920 raft_consensus.cc:740] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:20.627024 28920 consensus_queue.cc:260] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.628086 28920 raft_consensus.cc:3060] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.633306 28846 raft_consensus.cc:2468] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:20.633581 28920 raft_consensus.cc:2468] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:20.634676 28960 leader_election.cc:304] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.635542 29045 raft_consensus.cc:2804] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:20.636039 29045 raft_consensus.cc:697] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:20.636989 29045 consensus_queue.cc:237] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.644102 28742 catalog_manager.cc:5697] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 2 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.687012 29043 consensus_queue.cc:1048] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.698573 29042 consensus_queue.cc:1048] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.706985 29067 raft_consensus.cc:993] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4: : Instructing follower e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:20.707468 29042 raft_consensus.cc:1081] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Signalling peer e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:20.709535 28846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:29:20.710178 28846 raft_consensus.cc:493] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.710618 28846 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.716008 29045 consensus_queue.cc:1048] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.717928 28846 raft_consensus.cc:515] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.721204 28921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:20.721894 28921 raft_consensus.cc:3055] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:20.722267 28921 raft_consensus.cc:740] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:20.723161 28921 consensus_queue.cc:260] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.724089 29088 raft_consensus.cc:993] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd: : Instructing follower b3bda356dbc749128232aabd729ab8d4 to start an election
I20260709 12:29:20.724498 28921 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.724642 29077 raft_consensus.cc:1081] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Signalling peer b3bda356dbc749128232aabd729ab8d4 to start an election
I20260709 12:29:20.726589 28846 leader_election.cc:290] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.728154 28995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.728830 28995 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.731801 28920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "585b41d7c794421398e81a52b5a935db"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
 from {username='slave'} at 127.0.0.1:43686
I20260709 12:29:20.732487 28920 raft_consensus.cc:493] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.732858 28920 raft_consensus.cc:3060] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.733484 28921 raft_consensus.cc:2468] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:20.734998 28809 leader_election.cc:304] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.735749 29045 consensus_queue.cc:1048] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.735976 29062 raft_consensus.cc:2804] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:20.736656 29062 raft_consensus.cc:697] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:20.736935 28995 raft_consensus.cc:2468] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:20.737648 29062 consensus_queue.cc:237] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.746855 28920 raft_consensus.cc:515] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.748143 28919 raft_consensus.cc:1240] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Rejecting Update request from peer a0410b4c47e14f779bb1ba114b0261fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:20.749938 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.750604 28845 raft_consensus.cc:3060] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.751060 29045 consensus_queue.cc:1059] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.750731 28742 catalog_manager.cc:5697] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.751883 29077 raft_consensus.cc:3055] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:20.752242 29077 raft_consensus.cc:740] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:20.753077 29077 consensus_queue.cc:260] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.754208 29077 raft_consensus.cc:3060] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.757715 29042 consensus_queue.cc:1048] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.759624 29062 consensus_queue.cc:1048] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.761759 28845 raft_consensus.cc:2468] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 2.
I20260709 12:29:20.763031 28886 leader_election.cc:304] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.764087 29067 raft_consensus.cc:2804] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:20.764521 29067 raft_consensus.cc:697] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 2 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:20.765375 29067 consensus_queue.cc:237] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.780416 29045 consensus_queue.cc:1048] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.782437 29054 consensus_queue.cc:1048] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:20.782433 28742 catalog_manager.cc:5697] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 1 to 2, leader changed from a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67) to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.786126 28920 leader_election.cc:290] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.790006 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "585b41d7c794421398e81a52b5a935db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.790230 29067 raft_consensus.cc:993] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4: : Instructing follower e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:20.790923 29067 raft_consensus.cc:1081] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Signalling peer e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:20.792850 28846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:29:20.793551 28846 raft_consensus.cc:493] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.793979 28846 raft_consensus.cc:3060] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.801304 28994 raft_consensus.cc:2468] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 2.
I20260709 12:29:20.802176 28846 raft_consensus.cc:515] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:20.805514 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:20.806447 28919 raft_consensus.cc:3055] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:20.806880 28919 raft_consensus.cc:740] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:20.807857 28919 consensus_queue.cc:260] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:20.808142 29067 consensus_queue.cc:1048] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:20.809243 28919 raft_consensus.cc:3060] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.811780 28846 leader_election.cc:290] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.816131 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ef4114dac34a739ee409d4a29763e7" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.816751 28993 raft_consensus.cc:3060] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.820919 29045 consensus_queue.cc:1048] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:20.834120 29045 raft_consensus.cc:993] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd: : Instructing follower e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:20.834578 29045 raft_consensus.cc:1081] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Signalling peer e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:20.837270 28844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:48440
I20260709 12:29:20.837908 28844 raft_consensus.cc:493] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.838304 28844 raft_consensus.cc:3060] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.839423 28993 raft_consensus.cc:2468] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:20.840698 28812 leader_election.cc:304] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.841882 29062 raft_consensus.cc:2804] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:20.842381 29062 raft_consensus.cc:697] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:20.842828 28919 raft_consensus.cc:2468] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:20.843343 29062 consensus_queue.cc:237] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } }
I20260709 12:29:20.847579 29054 raft_consensus.cc:993] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9: : Instructing follower b3bda356dbc749128232aabd729ab8d4 to start an election
I20260709 12:29:20.847589 28844 raft_consensus.cc:515] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.848413 29062 raft_consensus.cc:1081] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Signalling peer b3bda356dbc749128232aabd729ab8d4 to start an election
I20260709 12:29:20.850323 28919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
 from {username='slave'} at 127.0.0.1:43674
I20260709 12:29:20.850929 28919 raft_consensus.cc:493] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.851338 28919 raft_consensus.cc:3060] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.853845 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:20.854476 28920 raft_consensus.cc:3060] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.859084 28919 raft_consensus.cc:515] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.861474 28919 leader_election.cc:290] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.861915 28920 raft_consensus.cc:2468] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:20.863090 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:20.863788 28845 raft_consensus.cc:3055] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:20.863677 28809 leader_election.cc:304] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.864282 28845 raft_consensus.cc:740] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:20.864809 29062 raft_consensus.cc:2804] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:20.864296 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7d1b3b3d9ca4e9ea5cb52f4369b198e" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.865558 29062 raft_consensus.cc:697] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:20.865267 28845 consensus_queue.cc:260] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.865873 28993 raft_consensus.cc:3060] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.866729 28845 raft_consensus.cc:3060] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.866616 29062 consensus_queue.cc:237] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.869396 28844 leader_election.cc:290] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:20.871817 28741 catalog_manager.cc:5697] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.874204 28845 raft_consensus.cc:2468] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 2.
I20260709 12:29:20.874555 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4805c4b9992c492c9db07f4b8146c634" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:20.875178 28994 raft_consensus.cc:3055] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:20.875516 28994 raft_consensus.cc:740] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:20.875608 28886 leader_election.cc:304] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:20.876543 29067 raft_consensus.cc:2804] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:20.876392 28994 consensus_queue.cc:260] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.877045 29067 raft_consensus.cc:697] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 2 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:20.877983 29067 consensus_queue.cc:237] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:20.879912 28994 raft_consensus.cc:3060] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:20.887732 28994 raft_consensus.cc:2468] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:20.873940 28993 raft_consensus.cc:2468] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 2.
I20260709 12:29:20.890268 28741 catalog_manager.cc:5697] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 1 to 2, leader changed from e36c559027954e63b5050e833d0973e9 (127.20.98.65) to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.891444 28742 catalog_manager.cc:5697] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 1 to 2, leader changed from a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67) to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:21.128018 28920 raft_consensus.cc:1275] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.129431 29108 consensus_queue.cc:1048] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.137900 28845 raft_consensus.cc:1275] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.139866 29108 consensus_queue.cc:1048] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.175498 28994 raft_consensus.cc:1275] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer b3bda356dbc749128232aabd729ab8d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.176831 29067 consensus_queue.cc:1048] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.185029 28845 raft_consensus.cc:1275] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer b3bda356dbc749128232aabd729ab8d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.187034 29067 consensus_queue.cc:1048] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.216853 28920 raft_consensus.cc:1275] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.218173 29041 consensus_queue.cc:1048] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.226151 28994 raft_consensus.cc:1275] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.227870 29112 consensus_queue.cc:1048] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:21.234345 28920 raft_consensus.cc:1275] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.235774 29112 consensus_queue.cc:1048] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.243952 28994 raft_consensus.cc:1275] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.246695 29062 consensus_queue.cc:1048] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.322721 28994 raft_consensus.cc:1275] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.324146 29062 consensus_queue.cc:1048] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.332581 28920 raft_consensus.cc:1275] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.334038 29062 consensus_queue.cc:1048] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.446841 28994 raft_consensus.cc:1275] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer b3bda356dbc749128232aabd729ab8d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.448211 29067 consensus_queue.cc:1048] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:21.456167 28845 raft_consensus.cc:1275] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer b3bda356dbc749128232aabd729ab8d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:21.457932 29042 consensus_queue.cc:1048] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:23.565826 28742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46950:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:23.568636 28742 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:23.632287 28829 tablet_service.cc:1511] Processing CreateTablet for tablet a95dcecec1cc4307b7fbdcc35cbc3654 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:23.634859 28829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95dcecec1cc4307b7fbdcc35cbc3654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.635841 28906 tablet_service.cc:1511] Processing CreateTablet for tablet a95dcecec1cc4307b7fbdcc35cbc3654 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:23.637928 28906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95dcecec1cc4307b7fbdcc35cbc3654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.639791 28835 tablet_service.cc:1511] Processing CreateTablet for tablet 49d487e6642345ab86291ca0fb5a31be (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:23.641091 28979 tablet_service.cc:1511] Processing CreateTablet for tablet a95dcecec1cc4307b7fbdcc35cbc3654 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:23.642130 28981 tablet_service.cc:1511] Processing CreateTablet for tablet 49d487e6642345ab86291ca0fb5a31be (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:23.643117 28979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95dcecec1cc4307b7fbdcc35cbc3654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.644110 28981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d487e6642345ab86291ca0fb5a31be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.646672 28904 tablet_service.cc:1511] Processing CreateTablet for tablet 49d487e6642345ab86291ca0fb5a31be (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:23.647789 28833 tablet_service.cc:1511] Processing CreateTablet for tablet b327cc5b7f4549e6bdd80e5df691f814 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:23.648367 28904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d487e6642345ab86291ca0fb5a31be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.650174 28908 tablet_service.cc:1511] Processing CreateTablet for tablet b327cc5b7f4549e6bdd80e5df691f814 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:23.651289 28977 tablet_service.cc:1511] Processing CreateTablet for tablet b327cc5b7f4549e6bdd80e5df691f814 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:23.652933 28977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b327cc5b7f4549e6bdd80e5df691f814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.654613 28908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b327cc5b7f4549e6bdd80e5df691f814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.641579 28835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d487e6642345ab86291ca0fb5a31be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.657565 28833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b327cc5b7f4549e6bdd80e5df691f814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.663067 28907 tablet_service.cc:1511] Processing CreateTablet for tablet 5235547c89e742f9be6065b0b24f9ed5 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:23.664494 28907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235547c89e742f9be6065b0b24f9ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.667928 28836 tablet_service.cc:1511] Processing CreateTablet for tablet 5235547c89e742f9be6065b0b24f9ed5 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:23.669384 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235547c89e742f9be6065b0b24f9ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.707175 28980 tablet_service.cc:1511] Processing CreateTablet for tablet 5235547c89e742f9be6065b0b24f9ed5 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:23.710958 28830 tablet_service.cc:1511] Processing CreateTablet for tablet 3e69389bea614d67b9bf2289921b6eda (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:23.712527 28830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e69389bea614d67b9bf2289921b6eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.713392 28905 tablet_service.cc:1511] Processing CreateTablet for tablet 3e69389bea614d67b9bf2289921b6eda (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:23.714865 28905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e69389bea614d67b9bf2289921b6eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.717309 28980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5235547c89e742f9be6065b0b24f9ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.729128 28978 tablet_service.cc:1511] Processing CreateTablet for tablet 3e69389bea614d67b9bf2289921b6eda (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:23.730651 28978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e69389bea614d67b9bf2289921b6eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.739753 28828 tablet_service.cc:1511] Processing CreateTablet for tablet e0d1caee7f824ef6b1b19efe7e4ca6db (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:23.741310 28828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d1caee7f824ef6b1b19efe7e4ca6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.748819 28910 tablet_service.cc:1511] Processing CreateTablet for tablet e0d1caee7f824ef6b1b19efe7e4ca6db (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:23.750317 28910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d1caee7f824ef6b1b19efe7e4ca6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.776995 28984 tablet_service.cc:1511] Processing CreateTablet for tablet e0d1caee7f824ef6b1b19efe7e4ca6db (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:23.778573 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d1caee7f824ef6b1b19efe7e4ca6db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.783272 28831 tablet_service.cc:1511] Processing CreateTablet for tablet e14b2598ec024826a975183c661ade87 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:23.784725 28831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14b2598ec024826a975183c661ade87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.787730 28911 tablet_service.cc:1511] Processing CreateTablet for tablet e14b2598ec024826a975183c661ade87 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:23.790445 28911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14b2598ec024826a975183c661ade87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.811039 29128 tablet_bootstrap.cc:492] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:23.822974 28828 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1dbcf345464b368863238dc3d47cb3 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:23.823879 29128 tablet_bootstrap.cc:654] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.824676 28828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1dbcf345464b368863238dc3d47cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.822978 28984 tablet_service.cc:1511] Processing CreateTablet for tablet e14b2598ec024826a975183c661ade87 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:23.826287 28984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e14b2598ec024826a975183c661ade87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.828895 29130 tablet_bootstrap.cc:492] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:23.830489 28908 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1dbcf345464b368863238dc3d47cb3 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:23.831598 28979 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1dbcf345464b368863238dc3d47cb3 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:23.836474 28981 tablet_service.cc:1511] Processing CreateTablet for tablet 233f432fffe74d5aac51e2508c40e1a3 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:23.837718 28907 tablet_service.cc:1511] Processing CreateTablet for tablet 233f432fffe74d5aac51e2508c40e1a3 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:23.839706 28835 tablet_service.cc:1511] Processing CreateTablet for tablet 233f432fffe74d5aac51e2508c40e1a3 (DEFAULT_TABLE table=soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:23.840898 28835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233f432fffe74d5aac51e2508c40e1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.843303 28979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1dbcf345464b368863238dc3d47cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.844220 28981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233f432fffe74d5aac51e2508c40e1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.845250 29129 tablet_bootstrap.cc:492] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:23.848071 29130 tablet_bootstrap.cc:654] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.832732 28908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1dbcf345464b368863238dc3d47cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.863965 29128 tablet_bootstrap.cc:492] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:23.864562 29128 ts_tablet_manager.cc:1403] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.010s
I20260709 12:29:23.865351 28907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 233f432fffe74d5aac51e2508c40e1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.868027 29128 raft_consensus.cc:359] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.869002 29128 raft_consensus.cc:385] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.870626 29128 raft_consensus.cc:740] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.871531 29128 consensus_queue.cc:260] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.874390 29128 ts_tablet_manager.cc:1434] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:29:23.875622 29128 tablet_bootstrap.cc:492] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:23.879649 29129 tablet_bootstrap.cc:654] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.883383 29130 tablet_bootstrap.cc:492] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:23.904785 29130 ts_tablet_manager.cc:1403] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.000s
I20260709 12:29:23.913540 29130 raft_consensus.cc:359] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.914315 29130 raft_consensus.cc:385] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.914628 29130 raft_consensus.cc:740] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.915093 29129 tablet_bootstrap.cc:492] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:23.915688 29129 ts_tablet_manager.cc:1403] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.005s
I20260709 12:29:23.891746 29128 tablet_bootstrap.cc:654] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.918989 29129 raft_consensus.cc:359] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.919814 29129 raft_consensus.cc:385] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.919579 29130 consensus_queue.cc:260] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.920135 29129 raft_consensus.cc:740] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.920945 29129 consensus_queue.cc:260] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.927022 29129 ts_tablet_manager.cc:1434] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:29:23.927362 29130 ts_tablet_manager.cc:1434] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.007s
I20260709 12:29:23.928264 29129 tablet_bootstrap.cc:492] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:23.928685 29130 tablet_bootstrap.cc:492] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:23.936139 29129 tablet_bootstrap.cc:654] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.938030 29130 tablet_bootstrap.cc:654] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.941221 29128 tablet_bootstrap.cc:492] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:23.941890 29128 ts_tablet_manager.cc:1403] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.067s	user 0.007s	sys 0.009s
I20260709 12:29:23.948992 29129 tablet_bootstrap.cc:492] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:23.949631 29129 ts_tablet_manager.cc:1403] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 12:29:23.954012 29129 raft_consensus.cc:359] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.954761 29129 raft_consensus.cc:385] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.949398 29128 raft_consensus.cc:359] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.955071 29129 raft_consensus.cc:740] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.955287 29128 raft_consensus.cc:385] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.955643 29128 raft_consensus.cc:740] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.955919 29129 consensus_queue.cc:260] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.956421 29128 consensus_queue.cc:260] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.958726 29129 ts_tablet_manager.cc:1434] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:23.959321 29128 ts_tablet_manager.cc:1434] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:29:23.959820 29129 tablet_bootstrap.cc:492] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:23.960704 29128 tablet_bootstrap.cc:492] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:23.965871 29070 raft_consensus.cc:493] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.966770 29070 raft_consensus.cc:515] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.968181 29128 tablet_bootstrap.cc:654] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.971506 29130 tablet_bootstrap.cc:492] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:23.972200 29130 ts_tablet_manager.cc:1403] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.044s	user 0.029s	sys 0.010s
I20260709 12:29:23.971930 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:23.973039 28994 raft_consensus.cc:2468] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:23.974710 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:23.975440 28845 raft_consensus.cc:2468] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:23.976044 29130 raft_consensus.cc:359] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:23.976909 29130 raft_consensus.cc:385] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.976089 28887 leader_election.cc:304] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:23.979772 29070 leader_election.cc:290] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:23.980423 29070 raft_consensus.cc:2804] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.980814 29070 raft_consensus.cc:493] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:23.981074 28792 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:23.981961 29070 raft_consensus.cc:3060] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.987102 29129 tablet_bootstrap.cc:654] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.003013 29138 raft_consensus.cc:493] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.003834 29138 raft_consensus.cc:515] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.010231 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.011221 29070 raft_consensus.cc:515] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.011783 29138 leader_election.cc:290] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:23.977353 29130 raft_consensus.cc:740] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.013314 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.018186 29130 consensus_queue.cc:260] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.019382 28845 raft_consensus.cc:2468] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
W20260709 12:29:24.021608 28887 leader_election.cc:343] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.022830 29129 tablet_bootstrap.cc:492] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:24.023613 29129 ts_tablet_manager.cc:1403] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.064s	user 0.005s	sys 0.031s
I20260709 12:29:24.023892 28886 leader_election.cc:304] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:24.026247 29140 raft_consensus.cc:2804] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.026669 29140 raft_consensus.cc:493] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.026937 29070 leader_election.cc:290] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.028244 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.028421 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:24.028901 28994 raft_consensus.cc:3060] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.029337 28845 raft_consensus.cc:3060] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.030196 29130 ts_tablet_manager.cc:1434] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 12:29:24.031361 29130 tablet_bootstrap.cc:492] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:24.032588 29128 tablet_bootstrap.cc:492] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:24.033155 29128 ts_tablet_manager.cc:1403] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.015s
I20260709 12:29:24.027010 29140 raft_consensus.cc:3060] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.039670 28994 raft_consensus.cc:2468] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.041160 28887 leader_election.cc:304] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:24.043169 29128 raft_consensus.cc:359] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.044337 29128 raft_consensus.cc:385] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.045349 29128 raft_consensus.cc:740] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.044878 29138 raft_consensus.cc:2804] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.046685 29138 raft_consensus.cc:697] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.042646 29129 raft_consensus.cc:359] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.049896 29129 raft_consensus.cc:385] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.050238 29129 raft_consensus.cc:740] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.050508 29138 consensus_queue.cc:237] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.055639 28845 raft_consensus.cc:2468] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.051026 29129 consensus_queue.cc:260] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.058421 29129 ts_tablet_manager.cc:1434] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:29:24.059607 29129 tablet_bootstrap.cc:492] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:24.059892 29140 raft_consensus.cc:515] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.052970 29130 tablet_bootstrap.cc:654] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.047423 29128 consensus_queue.cc:260] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.063730 29128 ts_tablet_manager.cc:1434] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 12:29:24.065899 29128 tablet_bootstrap.cc:492] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:24.071486 29129 tablet_bootstrap.cc:654] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.076009 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:24.076802 28845 raft_consensus.cc:3060] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.076862 29140 leader_election.cc:290] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.078269 29130 tablet_bootstrap.cc:492] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:24.078852 29130 ts_tablet_manager.cc:1403] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.011s
I20260709 12:29:24.081404 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.082867 29128 tablet_bootstrap.cc:654] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:24.085888 28887 leader_election.cc:343] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.086418 29138 raft_consensus.cc:493] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.086491 28845 raft_consensus.cc:2468] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.087100 29138 raft_consensus.cc:515] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.088083 28886 leader_election.cc:304] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:24.088966 29129 tablet_bootstrap.cc:492] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:24.089394 29140 raft_consensus.cc:2804] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.089605 29129 ts_tablet_manager.cc:1403] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 12:29:24.090019 29140 raft_consensus.cc:697] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.091022 29140 consensus_queue.cc:237] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.093299 29129 raft_consensus.cc:359] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.094156 29129 raft_consensus.cc:385] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.094494 29129 raft_consensus.cc:740] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.095377 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e69389bea614d67b9bf2289921b6eda" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.085837 29130 raft_consensus.cc:359] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.096423 29130 raft_consensus.cc:385] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.096879 29130 raft_consensus.cc:740] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.097426 29138 leader_election.cc:290] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.097940 29130 consensus_queue.cc:260] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.098999 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e69389bea614d67b9bf2289921b6eda" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.099097 28844 raft_consensus.cc:2468] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:24.092844 28744 catalog_manager.cc:5697] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:24.101197 28887 leader_election.cc:343] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.101944 28886 leader_election.cc:304] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:24.095350 29129 consensus_queue.cc:260] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.105643 29141 raft_consensus.cc:2804] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.106065 29141 raft_consensus.cc:493] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.106441 29141 raft_consensus.cc:3060] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.107475 29129 ts_tablet_manager.cc:1434] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:29:24.108928 29129 tablet_bootstrap.cc:492] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:24.111706 29138 raft_consensus.cc:493] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.112298 29138 raft_consensus.cc:515] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.116720 29129 tablet_bootstrap.cc:654] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.118942 29128 tablet_bootstrap.cc:492] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:24.119596 29128 ts_tablet_manager.cc:1403] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.019s
I20260709 12:29:24.120458 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235547c89e742f9be6065b0b24f9ed5" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.120987 29138 leader_election.cc:290] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
W20260709 12:29:24.122148 28887 leader_election.cc:343] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.123831 29128 raft_consensus.cc:359] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.124912 29128 raft_consensus.cc:385] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.125370 29128 raft_consensus.cc:740] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.128438 29141 raft_consensus.cc:515] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.131263 29130 ts_tablet_manager.cc:1434] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 12:29:24.132578 29130 tablet_bootstrap.cc:492] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:24.126524 29128 consensus_queue.cc:260] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.136132 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e69389bea614d67b9bf2289921b6eda" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.136862 28994 raft_consensus.cc:3060] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.146754 29141 leader_election.cc:290] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.153173 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235547c89e742f9be6065b0b24f9ed5" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.158665 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e69389bea614d67b9bf2289921b6eda" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:24.159518 28844 raft_consensus.cc:3060] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:24.170408 28886 leader_election.cc:343] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.171162 28886 leader_election.cc:304] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4; no voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9
I20260709 12:29:24.172211 29141 raft_consensus.cc:2749] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:24.187813 29128 ts_tablet_manager.cc:1434] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.068s	user 0.013s	sys 0.009s
I20260709 12:29:24.210711 28744 catalog_manager.cc:5697] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.211463 29129 tablet_bootstrap.cc:492] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:24.212376 29129 ts_tablet_manager.cc:1403] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.104s	user 0.054s	sys 0.037s
I20260709 12:29:24.212453 29130 tablet_bootstrap.cc:654] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.215217 29128 tablet_bootstrap.cc:492] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:24.216111 29129 raft_consensus.cc:359] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.216934 29129 raft_consensus.cc:385] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.217324 29129 raft_consensus.cc:740] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.218293 29129 consensus_queue.cc:260] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.220292 28994 raft_consensus.cc:2468] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.220988 29129 ts_tablet_manager.cc:1434] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:24.211380 28844 raft_consensus.cc:2468] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.222633 28886 leader_election.cc:304] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.223894 29070 raft_consensus.cc:2804] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.224433 29070 raft_consensus.cc:697] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.225373 29070 consensus_queue.cc:237] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.226208 29128 tablet_bootstrap.cc:654] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.228163 29114 raft_consensus.cc:493] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.228725 29114 raft_consensus.cc:515] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.231740 29130 tablet_bootstrap.cc:492] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:24.232209 29114 leader_election.cc:290] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:24.232673 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.232276 29130 ts_tablet_manager.cc:1403] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.003s
I20260709 12:29:24.234287 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:24.237005 29130 raft_consensus.cc:359] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.237799 29130 raft_consensus.cc:385] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.238090 29130 raft_consensus.cc:740] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.238317 29128 tablet_bootstrap.cc:492] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:24.238909 29128 ts_tablet_manager.cc:1403] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
W20260709 12:29:24.234551 28960 leader_election.cc:343] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:24.240192 28958 leader_election.cc:343] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.238881 29130 consensus_queue.cc:260] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.242921 28958 leader_election.cc:304] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd; no voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9
I20260709 12:29:24.243193 29129 tablet_bootstrap.cc:492] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:24.244032 29130 ts_tablet_manager.cc:1434] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.004s
I20260709 12:29:24.245294 29130 tablet_bootstrap.cc:492] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:24.246029 29141 raft_consensus.cc:493] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.246564 29141 raft_consensus.cc:515] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.247750 29114 raft_consensus.cc:2749] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:24.251749 29128 raft_consensus.cc:359] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.252779 29130 tablet_bootstrap.cc:654] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.252643 29128 raft_consensus.cc:385] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.256409 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.258042 28994 raft_consensus.cc:2468] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:24.254520 29141 leader_election.cc:290] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.253991 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.259368 28887 leader_election.cc:304] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:24.260126 29141 raft_consensus.cc:2804] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.260553 29141 raft_consensus.cc:493] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:24.260666 28886 leader_election.cc:343] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.261090 29141 raft_consensus.cc:3060] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.261859 29129 tablet_bootstrap.cc:654] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.257695 29128 raft_consensus.cc:740] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.262979 29128 consensus_queue.cc:260] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.269565 29128 ts_tablet_manager.cc:1434] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 12:29:24.269333 29141 raft_consensus.cc:515] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.278496 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:24.279266 29128 tablet_bootstrap.cc:492] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
W20260709 12:29:24.280211 28886 leader_election.cc:343] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.283990 29129 tablet_bootstrap.cc:492] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:24.284658 29129 ts_tablet_manager.cc:1403] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.008s
I20260709 12:29:24.286271 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.287178 28994 raft_consensus.cc:3060] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.287631 29128 tablet_bootstrap.cc:654] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.288350 29129 raft_consensus.cc:359] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.289309 29129 raft_consensus.cc:385] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.289662 29129 raft_consensus.cc:740] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.290598 29129 consensus_queue.cc:260] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.294068 29129 ts_tablet_manager.cc:1434] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:29:24.297108 29128 tablet_bootstrap.cc:492] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:24.297354 29141 leader_election.cc:290] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.297818 29128 ts_tablet_manager.cc:1403] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:29:24.301306 29128 raft_consensus.cc:359] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.302075 29128 raft_consensus.cc:385] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.302201 28994 raft_consensus.cc:2468] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.302410 29128 raft_consensus.cc:740] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.303372 29129 tablet_bootstrap.cc:492] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:24.303644 29128 consensus_queue.cc:260] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.304155 28887 leader_election.cc:304] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: e36c559027954e63b5050e833d0973e9
I20260709 12:29:24.305965 29141 raft_consensus.cc:2804] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.306874 29141 raft_consensus.cc:697] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.309520 29128 ts_tablet_manager.cc:1434] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:29:24.311302 29128 tablet_bootstrap.cc:492] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:24.312263 29129 tablet_bootstrap.cc:654] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.320425 29128 tablet_bootstrap.cc:654] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.324626 29129 tablet_bootstrap.cc:492] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:24.324640 29130 tablet_bootstrap.cc:492] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:24.325352 29129 ts_tablet_manager.cc:1403] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 12:29:24.325591 29130 ts_tablet_manager.cc:1403] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.036s
I20260709 12:29:24.330770 29130 raft_consensus.cc:359] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.331892 29130 raft_consensus.cc:385] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.332316 29130 raft_consensus.cc:740] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.332957 29129 raft_consensus.cc:359] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.333778 29129 raft_consensus.cc:385] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.334079 29129 raft_consensus.cc:740] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.333945 29130 consensus_queue.cc:260] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.308072 29141 consensus_queue.cc:237] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.339488 29130 ts_tablet_manager.cc:1434] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:29:24.339413 28742 catalog_manager.cc:5697] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.340768 29130 tablet_bootstrap.cc:492] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:24.340764 29128 tablet_bootstrap.cc:492] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:24.341725 29128 ts_tablet_manager.cc:1403] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.010s
I20260709 12:29:24.345319 29128 raft_consensus.cc:359] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.346182 29128 raft_consensus.cc:385] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.346581 29128 raft_consensus.cc:740] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.347576 29128 consensus_queue.cc:260] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.349629 29130 tablet_bootstrap.cc:654] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.350464 29128 ts_tablet_manager.cc:1434] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:29:24.351790 29128 tablet_bootstrap.cc:492] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:24.335057 29129 consensus_queue.cc:260] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.360416 29129 ts_tablet_manager.cc:1434] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 12:29:24.361141 29128 tablet_bootstrap.cc:654] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.361903 29129 tablet_bootstrap.cc:492] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:24.363070 29130 tablet_bootstrap.cc:492] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:24.363696 29130 ts_tablet_manager.cc:1403] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 12:29:24.368111 29130 raft_consensus.cc:359] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.369367 29130 raft_consensus.cc:385] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.369799 29130 raft_consensus.cc:740] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.370839 29130 consensus_queue.cc:260] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.373497 29128 tablet_bootstrap.cc:492] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:24.373504 29130 ts_tablet_manager.cc:1434] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 12:29:24.374382 29128 ts_tablet_manager.cc:1403] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 12:29:24.374979 29130 tablet_bootstrap.cc:492] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:24.377574 29128 raft_consensus.cc:359] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.378435 29128 raft_consensus.cc:385] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.378785 29128 raft_consensus.cc:740] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.379818 29128 consensus_queue.cc:260] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.381522 29128 ts_tablet_manager.cc:1434] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:24.382684 29128 tablet_bootstrap.cc:492] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd: Bootstrap starting.
I20260709 12:29:24.387528 29130 tablet_bootstrap.cc:654] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.389380 29128 tablet_bootstrap.cc:654] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.397675 29129 tablet_bootstrap.cc:654] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.399820 29130 tablet_bootstrap.cc:492] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:24.400373 29130 ts_tablet_manager.cc:1403] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.003s
I20260709 12:29:24.403738 29130 raft_consensus.cc:359] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.404219 29129 tablet_bootstrap.cc:492] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:24.404517 29130 raft_consensus.cc:385] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.404970 29130 raft_consensus.cc:740] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.405140 29129 ts_tablet_manager.cc:1403] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 12:29:24.406242 29127 raft_consensus.cc:493] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.406083 28742 catalog_manager.cc:5697] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.406720 29127 raft_consensus.cc:515] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.408710 29129 raft_consensus.cc:359] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.409312 29128 tablet_bootstrap.cc:492] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd: No bootstrap required, opened a new log
I20260709 12:29:24.409489 29129 raft_consensus.cc:385] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.409762 29129 raft_consensus.cc:740] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.409827 29128 ts_tablet_manager.cc:1403] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.010s
I20260709 12:29:24.410491 29129 consensus_queue.cc:260] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.410741 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.411399 28994 raft_consensus.cc:2468] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 0.
I20260709 12:29:24.413205 29129 ts_tablet_manager.cc:1434] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:24.412922 29128 raft_consensus.cc:359] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.413441 29127 leader_election.cc:290] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.413787 29128 raft_consensus.cc:385] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.413051 28812 leader_election.cc:304] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.414284 29129 tablet_bootstrap.cc:492] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4: Bootstrap starting.
I20260709 12:29:24.414600 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:24.415028 29127 raft_consensus.cc:2804] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.414887 29130 consensus_queue.cc:260] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.415297 28919 raft_consensus.cc:2468] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 0.
I20260709 12:29:24.415470 29127 raft_consensus.cc:493] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.415866 29127 raft_consensus.cc:3060] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.420485 29130 ts_tablet_manager.cc:1434] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 12:29:24.414184 29128 raft_consensus.cc:740] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.421759 29130 tablet_bootstrap.cc:492] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:24.422587 29128 consensus_queue.cc:260] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.424810 29128 ts_tablet_manager.cc:1434] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:29:24.421239 29129 tablet_bootstrap.cc:654] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.429643 29130 tablet_bootstrap.cc:654] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.429512 29141 raft_consensus.cc:493] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.430284 29141 raft_consensus.cc:515] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.434784 29141 leader_election.cc:290] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.434808 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.436262 29114 raft_consensus.cc:493] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:24.436908 28886 leader_election.cc:343] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:24.436817 29114 raft_consensus.cc:515] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.437296 29129 tablet_bootstrap.cc:492] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4: No bootstrap required, opened a new log
I20260709 12:29:24.437830 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.437851 29129 ts_tablet_manager.cc:1403] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 12:29:24.438505 28994 raft_consensus.cc:2468] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:24.439189 29114 leader_election.cc:290] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:24.439822 28887 leader_election.cc:304] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: e36c559027954e63b5050e833d0973e9
I20260709 12:29:24.441000 29141 raft_consensus.cc:2804] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.441401 29141 raft_consensus.cc:493] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.441736 29141 raft_consensus.cc:3060] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.442070 29129 raft_consensus.cc:359] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.442824 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:24.443061 29129 raft_consensus.cc:385] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.443488 29129 raft_consensus.cc:740] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.444528 29129 consensus_queue.cc:260] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.445977 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.446825 28844 raft_consensus.cc:2393] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0410b4c47e14f779bb1ba114b0261fd in current term 1: Already voted for candidate b3bda356dbc749128232aabd729ab8d4 in this term.
I20260709 12:29:24.447336 29129 ts_tablet_manager.cc:1434] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:24.448181 28960 leader_election.cc:304] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd; no voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9
I20260709 12:29:24.453293 29141 raft_consensus.cc:515] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.456280 29127 raft_consensus.cc:515] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.459793 29127 leader_election.cc:290] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.460172 29141 leader_election.cc:290] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.461573 29165 raft_consensus.cc:3060] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.463219 29130 tablet_bootstrap.cc:492] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:24.462857 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:24.463781 29130 ts_tablet_manager.cc:1403] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.007s
I20260709 12:29:24.463804 28919 raft_consensus.cc:3060] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.462857 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.464711 28994 raft_consensus.cc:3060] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.466946 29130 raft_consensus.cc:359] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.467686 29130 raft_consensus.cc:385] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.468230 29130 raft_consensus.cc:740] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.468919 29130 consensus_queue.cc:260] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.469780 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:24.469834 29165 raft_consensus.cc:2749] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:24.470610 28844 raft_consensus.cc:3060] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.471082 29130 ts_tablet_manager.cc:1434] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:24.471828 29130 tablet_bootstrap.cc:492] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9: Bootstrap starting.
I20260709 12:29:24.473683 28919 raft_consensus.cc:2468] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:24.474743 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.475430 28993 raft_consensus.cc:3060] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.475271 28809 leader_election.cc:304] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.476212 29127 raft_consensus.cc:2804] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.476559 29130 tablet_bootstrap.cc:654] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:24.477129 29127 raft_consensus.cc:697] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:24.478104 29127 consensus_queue.cc:237] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.480221 29141 consensus_queue.cc:1048] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.487818 28994 raft_consensus.cc:2468] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.489391 28887 leader_election.cc:304] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:24.490340 29141 raft_consensus.cc:2804] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.490258 28993 raft_consensus.cc:2468] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:24.492210 29141 raft_consensus.cc:697] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.493449 29141 consensus_queue.cc:237] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.500945 28844 raft_consensus.cc:2468] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.505779 29130 tablet_bootstrap.cc:492] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9: No bootstrap required, opened a new log
I20260709 12:29:24.506374 29130 ts_tablet_manager.cc:1403] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.016s
I20260709 12:29:24.509025 29130 raft_consensus.cc:359] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.509740 29130 raft_consensus.cc:385] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:24.510001 29130 raft_consensus.cc:740] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Initialized, Role: FOLLOWER
I20260709 12:29:24.510658 29130 consensus_queue.cc:260] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.512845 29130 ts_tablet_manager.cc:1434] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:24.524173 29141 consensus_queue.cc:1048] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.529572 28744 catalog_manager.cc:5697] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.541742 28742 catalog_manager.cc:5697] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.550683 29114 raft_consensus.cc:493] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.551288 29114 raft_consensus.cc:515] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.553285 29114 leader_election.cc:290] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:24.554539 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14b2598ec024826a975183c661ade87" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:24.555104 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14b2598ec024826a975183c661ade87" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.555282 28919 raft_consensus.cc:2468] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 0.
I20260709 12:29:24.555775 28845 raft_consensus.cc:2468] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 0.
I20260709 12:29:24.556509 28958 leader_election.cc:304] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:24.557739 29114 raft_consensus.cc:2804] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.558142 29114 raft_consensus.cc:493] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.558513 29114 raft_consensus.cc:3060] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.563971 29070 raft_consensus.cc:493] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.565194 29070 raft_consensus.cc:515] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.565255 29114 raft_consensus.cc:515] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.567880 29114 leader_election.cc:290] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:24.568408 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14b2598ec024826a975183c661ade87" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:24.568914 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14b2598ec024826a975183c661ade87" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:24.569095 28845 raft_consensus.cc:3060] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.569290 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1dbcf345464b368863238dc3d47cb3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:24.569619 28919 raft_consensus.cc:3060] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.570052 28844 raft_consensus.cc:2468] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:24.571012 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1dbcf345464b368863238dc3d47cb3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.571496 28886 leader_election.cc:304] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.571695 28993 raft_consensus.cc:2468] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 0.
I20260709 12:29:24.572496 29140 raft_consensus.cc:2804] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.569558 29070 leader_election.cc:290] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.572877 29140 raft_consensus.cc:493] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.573537 29140 raft_consensus.cc:3060] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.576265 28845 raft_consensus.cc:2468] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 1.
I20260709 12:29:24.577450 28919 raft_consensus.cc:2468] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 1.
I20260709 12:29:24.577574 28960 leader_election.cc:304] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.580516 29140 raft_consensus.cc:515] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.581341 29114 raft_consensus.cc:2804] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.581866 29114 raft_consensus.cc:697] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:24.582818 29140 leader_election.cc:290] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.582713 29114 consensus_queue.cc:237] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.583160 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1dbcf345464b368863238dc3d47cb3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:24.583519 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c1dbcf345464b368863238dc3d47cb3" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.583853 28845 raft_consensus.cc:3060] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.584168 28993 raft_consensus.cc:3060] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.590914 28845 raft_consensus.cc:2468] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.591610 28993 raft_consensus.cc:2468] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 1.
I20260709 12:29:24.592046 28886 leader_election.cc:304] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.593283 29140 raft_consensus.cc:2804] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.592903 28744 catalog_manager.cc:5697] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 0 to 1, leader changed from <none> to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 1 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:24.593858 29140 raft_consensus.cc:697] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.594743 29140 consensus_queue.cc:237] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.597500 29070 consensus_queue.cc:1048] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:24.602077 29062 raft_consensus.cc:493] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.602572 29062 raft_consensus.cc:515] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.605613 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235547c89e742f9be6065b0b24f9ed5" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:24.606267 28919 raft_consensus.cc:2468] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 0.
I20260709 12:29:24.607312 28809 leader_election.cc:304] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.608040 29127 raft_consensus.cc:2804] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:24.607882 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235547c89e742f9be6065b0b24f9ed5" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.608482 29127 raft_consensus.cc:493] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:24.608758 28993 raft_consensus.cc:2468] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 0.
I20260709 12:29:24.608897 29127 raft_consensus.cc:3060] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.613823 28741 catalog_manager.cc:5697] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.616932 29127 raft_consensus.cc:515] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.618803 29062 leader_election.cc:290] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.618989 29140 consensus_queue.cc:1048] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.620514 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235547c89e742f9be6065b0b24f9ed5" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:24.621145 28919 raft_consensus.cc:3060] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.623158 29127 leader_election.cc:290] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.624490 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5235547c89e742f9be6065b0b24f9ed5" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.625110 28994 raft_consensus.cc:3060] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.629158 28919 raft_consensus.cc:2468] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:24.632555 28809 leader_election.cc:304] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.633406 29127 raft_consensus.cc:2804] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:24.633872 29127 raft_consensus.cc:697] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:24.634680 29127 consensus_queue.cc:237] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.637081 28994 raft_consensus.cc:2468] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:24.653982 28744 catalog_manager.cc:5697] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 1 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.738792 28845 raft_consensus.cc:3060] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.745762 29127 raft_consensus.cc:493] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.746325 29140 consensus_queue.cc:1048] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:24.746403 29127 raft_consensus.cc:515] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.746809 29147 consensus_queue.cc:1048] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.752148 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:24.752987 29127 leader_election.cc:290] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.754077 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:24.754853 28994 raft_consensus.cc:2468] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 1.
I20260709 12:29:24.756033 28812 leader_election.cc:304] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:24.758499 29062 raft_consensus.cc:2804] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:24.758882 29062 raft_consensus.cc:493] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3bda356dbc749128232aabd729ab8d4)
I20260709 12:29:24.759258 29062 raft_consensus.cc:3060] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:24.766528 29141 consensus_queue.cc:1048] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:24.772605 29070 consensus_queue.cc:1048] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.773448 29062 raft_consensus.cc:515] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.774942 28845 raft_consensus.cc:1240] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Rejecting Update request from peer b3bda356dbc749128232aabd729ab8d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:24.776319 29062 leader_election.cc:290] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.777400 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.782666 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:24.781576 29140 consensus_queue.cc:1059] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:29:24.783941 29140 raft_consensus.cc:3055] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:24.784268 29140 raft_consensus.cc:740] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.785199 29140 consensus_queue.cc:260] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.785666 28809 leader_election.cc:304] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e36c559027954e63b5050e833d0973e9; no voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:24.786368 29140 raft_consensus.cc:3060] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:24.791203 29062 raft_consensus.cc:2749] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:24.817317 28920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
mode: GRACEFUL
new_leader_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:43702
I20260709 12:29:24.817975 28920 raft_consensus.cc:606] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Received request to transfer leadership to TS e36c559027954e63b5050e833d0973e9
I20260709 12:29:24.823377 28920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
mode: GRACEFUL
new_leader_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:43702
I20260709 12:29:24.823998 28920 raft_consensus.cc:606] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Received request to transfer leadership to TS e36c559027954e63b5050e833d0973e9
I20260709 12:29:24.836611 28994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e14b2598ec024826a975183c661ade87"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
mode: GRACEFUL
new_leader_uuid: "b3bda356dbc749128232aabd729ab8d4"
 from {username='slave'} at 127.0.0.1:53522
I20260709 12:29:24.837064 28994 raft_consensus.cc:606] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Received request to transfer leadership to TS b3bda356dbc749128232aabd729ab8d4
I20260709 12:29:24.845000 28920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
mode: GRACEFUL
new_leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:43702
I20260709 12:29:24.845615 28920 raft_consensus.cc:606] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Received request to transfer leadership to TS a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:24.939059 29070 raft_consensus.cc:993] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: : Instructing follower e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:24.939520 29140 raft_consensus.cc:1081] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Signalling peer e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:24.940979 28845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:29:24.941516 28845 raft_consensus.cc:493] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:24.941797 28845 raft_consensus.cc:3060] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:24.947026 28845 raft_consensus.cc:515] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.948716 28845 leader_election.cc:290] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:24.949712 28920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:24.949873 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b327cc5b7f4549e6bdd80e5df691f814" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:24.950372 28920 raft_consensus.cc:3055] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:24.950449 28994 raft_consensus.cc:3060] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:24.950690 28920 raft_consensus.cc:740] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:24.951474 28920 consensus_queue.cc:260] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.952633 28920 raft_consensus.cc:3060] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:24.956671 28994 raft_consensus.cc:2468] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:24.957726 28812 leader_election.cc:304] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:24.958453 29062 raft_consensus.cc:2804] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:24.958945 29062 raft_consensus.cc:697] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:24.959681 28920 raft_consensus.cc:2468] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:24.959841 29062 consensus_queue.cc:237] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:24.967514 28744 catalog_manager.cc:5697] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.992499 29114 consensus_queue.cc:1048] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.004395 29185 consensus_queue.cc:1048] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:25.016166 29062 consensus_queue.cc:1048] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.017454 29165 raft_consensus.cc:993] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: : Instructing follower b3bda356dbc749128232aabd729ab8d4 to start an election
I20260709 12:29:25.018035 29165 raft_consensus.cc:1081] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Signalling peer b3bda356dbc749128232aabd729ab8d4 to start an election
I20260709 12:29:25.019992 28920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e14b2598ec024826a975183c661ade87"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
 from {username='slave'} at 127.0.0.1:43686
I20260709 12:29:25.020723 28920 raft_consensus.cc:493] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:25.021129 28920 raft_consensus.cc:3060] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.030582 28920 raft_consensus.cc:515] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.031009 29127 consensus_queue.cc:1048] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.033408 28920 leader_election.cc:290] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:25.034199 28845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14b2598ec024826a975183c661ade87" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:25.034883 28845 raft_consensus.cc:3060] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.036187 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e14b2598ec024826a975183c661ade87" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:25.036821 28993 raft_consensus.cc:3055] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:25.037155 28993 raft_consensus.cc:740] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:25.040431 28993 consensus_queue.cc:260] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.041880 28993 raft_consensus.cc:3060] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.042349 29140 consensus_queue.cc:1048] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.044436 29141 consensus_queue.cc:1048] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.042701 28845 raft_consensus.cc:2468] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 2.
I20260709 12:29:25.055698 28886 leader_election.cc:304] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:25.058969 29141 raft_consensus.cc:2804] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.059160 28993 raft_consensus.cc:2468] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3bda356dbc749128232aabd729ab8d4 in term 2.
I20260709 12:29:25.059763 29141 raft_consensus.cc:697] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 2 LEADER]: Becoming Leader. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:25.060691 29141 consensus_queue.cc:237] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.077876 29170 consensus_queue.cc:1048] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.086503 29147 consensus_queue.cc:1048] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.092715 28741 catalog_manager.cc:5697] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 reported cstate change: term changed from 1 to 2, leader changed from a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67) to b3bda356dbc749128232aabd729ab8d4 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "b3bda356dbc749128232aabd729ab8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.106489 29127 consensus_queue.cc:1048] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:25.115674 29070 raft_consensus.cc:993] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: : Instructing follower e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:25.117348 29191 raft_consensus.cc:1081] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Signalling peer e36c559027954e63b5050e833d0973e9 to start an election
I20260709 12:29:25.119444 28844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
 from {username='slave'} at 127.0.0.1:48436
I20260709 12:29:25.120306 29141 consensus_queue.cc:1048] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:25.120594 28844 raft_consensus.cc:493] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:25.121309 28844 raft_consensus.cc:3060] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.129144 28844 raft_consensus.cc:515] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.131421 28844 leader_election.cc:290] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Requested vote from peers b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:25.131889 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:25.132579 28919 raft_consensus.cc:3055] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:25.132903 28919 raft_consensus.cc:740] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:25.133733 28919 consensus_queue.cc:260] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.134434 28994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d487e6642345ab86291ca0fb5a31be" candidate_uuid: "e36c559027954e63b5050e833d0973e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
I20260709 12:29:25.135002 28994 raft_consensus.cc:3060] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.135155 28919 raft_consensus.cc:3060] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.142354 28994 raft_consensus.cc:2468] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:25.142354 28919 raft_consensus.cc:2468] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36c559027954e63b5050e833d0973e9 in term 2.
I20260709 12:29:25.143788 28812 leader_election.cc:304] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:25.145202 29195 raft_consensus.cc:2804] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.146235 29140 raft_consensus.cc:993] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: : Instructing follower a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:25.146286 29195 raft_consensus.cc:697] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Becoming Leader. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:25.146927 29140 raft_consensus.cc:1081] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Signalling peer a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:25.147429 29195 consensus_queue.cc:237] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.148736 28993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:53502
I20260709 12:29:25.149377 28993 raft_consensus.cc:493] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:25.149762 28993 raft_consensus.cc:3060] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.154822 28744 catalog_manager.cc:5697] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to e36c559027954e63b5050e833d0973e9 (127.20.98.65). New cstate: current_term: 2 leader_uuid: "e36c559027954e63b5050e833d0973e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:25.157358 28993 raft_consensus.cc:515] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.159806 28993 leader_election.cc:290] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:25.160409 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:25.160442 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "233f432fffe74d5aac51e2508c40e1a3" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:25.161274 28919 raft_consensus.cc:3055] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:25.161334 28844 raft_consensus.cc:3060] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.161945 28919 raft_consensus.cc:740] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:25.162846 28919 consensus_queue.cc:260] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.164130 28919 raft_consensus.cc:3060] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.169407 28844 raft_consensus.cc:2468] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:25.170629 28960 leader_election.cc:304] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:25.171469 29165 raft_consensus.cc:2804] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.171587 28919 raft_consensus.cc:2468] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:25.171998 29165 raft_consensus.cc:697] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:25.172927 29165 consensus_queue.cc:237] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:25.179555 28744 catalog_manager.cc:5697] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 2 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.462508 28919 raft_consensus.cc:1275] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.463955 29062 consensus_queue.cc:1048] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.472002 28995 raft_consensus.cc:1275] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.472436 28993 raft_consensus.cc:1275] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer b3bda356dbc749128232aabd729ab8d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.473596 29127 consensus_queue.cc:1048] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.480218 29191 consensus_queue.cc:1048] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.481194 28844 raft_consensus.cc:1275] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer b3bda356dbc749128232aabd729ab8d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.482728 29140 consensus_queue.cc:1048] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.536628 28993 raft_consensus.cc:1275] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.538218 29127 consensus_queue.cc:1048] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.547521 28919 raft_consensus.cc:1275] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer e36c559027954e63b5050e833d0973e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.549223 29062 consensus_queue.cc:1048] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.680025 28844 raft_consensus.cc:1275] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.681253 29165 consensus_queue.cc:1048] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:25.691423 28919 raft_consensus.cc:1275] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:25.692840 29199 consensus_queue.cc:1048] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:26.020331 29140 raft_consensus.cc:493] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:26.020886 29140 raft_consensus.cc:515] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:26.023190 29140 leader_election.cc:290] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67:35231)
I20260709 12:29:26.024290 28993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd" is_pre_election: true
I20260709 12:29:26.024315 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "b3bda356dbc749128232aabd729ab8d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:26.026403 28886 leader_election.cc:304] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3bda356dbc749128232aabd729ab8d4; no voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9
I20260709 12:29:26.027237 29140 raft_consensus.cc:2749] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:26.271095 29199 raft_consensus.cc:493] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3bda356dbc749128232aabd729ab8d4)
I20260709 12:29:26.271643 29199 raft_consensus.cc:515] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:26.273511 29199 leader_election.cc:290] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:26.274451 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9" is_pre_election: true
I20260709 12:29:26.274577 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4" is_pre_election: true
I20260709 12:29:26.275259 28844 raft_consensus.cc:2393] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a0410b4c47e14f779bb1ba114b0261fd in current term 2: Already voted for candidate e36c559027954e63b5050e833d0973e9 in this term.
I20260709 12:29:26.275262 28919 raft_consensus.cc:2468] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:26.276600 28958 leader_election.cc:304] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: e36c559027954e63b5050e833d0973e9
I20260709 12:29:26.277324 29199 raft_consensus.cc:2804] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:26.277661 29199 raft_consensus.cc:493] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3bda356dbc749128232aabd729ab8d4)
I20260709 12:29:26.277935 29199 raft_consensus.cc:3060] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:26.283550 29199 raft_consensus.cc:515] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:26.285154 29199 leader_election.cc:290] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:26.286226 28844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:26.286406 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0d1caee7f824ef6b1b19efe7e4ca6db" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:26.287065 28844 raft_consensus.cc:2393] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a0410b4c47e14f779bb1ba114b0261fd in current term 2: Already voted for candidate e36c559027954e63b5050e833d0973e9 in this term.
I20260709 12:29:26.293416 28919 raft_consensus.cc:2468] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:26.294636 28958 leader_election.cc:304] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: e36c559027954e63b5050e833d0973e9
I20260709 12:29:26.295509 29198 raft_consensus.cc:2804] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:26.295966 29198 raft_consensus.cc:697] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:26.296654 29198 consensus_queue.cc:237] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:26.304804 28744 catalog_manager.cc:5697] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 2 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:26.816311 28844 raft_consensus.cc:1275] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:26.817837 29198 consensus_queue.cc:1048] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:26.831614 28919 raft_consensus.cc:1275] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:26.833051 29209 consensus_queue.cc:1048] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:27.849395 28744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46950:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:29:27.870661 28744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46950:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:29:27.948855 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:28.114595 28844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
mode: GRACEFUL
new_leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:44038
I20260709 12:29:28.115581 28844 raft_consensus.cc:606] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Received request to transfer leadership to TS a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:28.122910 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:29:28.123808 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:28.157769 29259 tablet.cc:1724] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:28.161484 28887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:35231, user_credentials={real_user=slave}} blocked reactor thread for 102781us
W20260709 12:29:28.164354 28958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.66:41075, user_credentials={real_user=slave}} blocked reactor thread for 88808.2us
I20260709 12:29:28.216217 29278 tablet.cc:1724] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.198933 29269 tablet.cc:1724] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.205147 29267 tablet.cc:1724] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.225914 29272 tablet.cc:1724] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.258033 29276 raft_consensus.cc:993] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: : Instructing follower a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:28.258924 29276 raft_consensus.cc:1081] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Signalling peer a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:28.206343 29273 tablet.cc:1724] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.290134 28991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:53516
I20260709 12:29:28.213820 29270 tablet.cc:1724] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.223901 29275 tablet.cc:1724] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.218693 29274 tablet.cc:1724] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.180088 28846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6"
dest_uuid: "e36c559027954e63b5050e833d0973e9"
mode: GRACEFUL
new_leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:44038
I20260709 12:29:28.298106 28846 raft_consensus.cc:606] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Received request to transfer leadership to TS a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:28.211326 29258 tablet.cc:1724] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:28.322050 28872 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:3e69389bea614d67b9bf2289921b6eda)
W20260709 12:29:28.328991 28872 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:3e69389bea614d67b9bf2289921b6eda)
W20260709 12:29:28.330518 28872 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:3e69389bea614d67b9bf2289921b6eda)
I20260709 12:29:28.374361 28919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f"
dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
mode: GRACEFUL
new_leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:44896
I20260709 12:29:28.375175 28919 raft_consensus.cc:606] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Received request to transfer leadership to TS a0410b4c47e14f779bb1ba114b0261fd
I20260709 12:29:28.376560 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:28.377198 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:28.378082 29278 tablet.cc:1724] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.380718 29267 tablet.cc:1724] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.409561 29282 tablet.cc:1724] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.410415 29269 tablet.cc:1724] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.414611 29267 tablet.cc:1724] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:28.417938 28887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:35231, user_credentials={real_user=slave}} blocked reactor thread for 66834.5us
I20260709 12:29:28.433327 28991 raft_consensus.cc:493] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.434021 28991 raft_consensus.cc:3060] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.450078 29269 tablet.cc:1724] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.456562 29267 tablet.cc:1724] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.459468 29258 tablet.cc:1724] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.433595 29280 tablet.cc:1724] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.479205 29259 tablet.cc:1724] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.481652 29273 tablet.cc:1724] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.482162 29274 tablet.cc:1724] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.484625 29270 tablet.cc:1724] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.493233 29282 tablet.cc:1724] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.470531 29267 tablet.cc:1724] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.442747 29272 tablet.cc:1724] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.475330 28991 raft_consensus.cc:515] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.510644 28991 leader_election.cc:290] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:28.511656 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:28.512424 28846 raft_consensus.cc:3055] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.512312 28918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95dcecec1cc4307b7fbdcc35cbc3654" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:28.512912 28846 raft_consensus.cc:740] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:28.513142 28918 raft_consensus.cc:3060] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.513922 28846 consensus_queue.cc:260] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.515432 28846 raft_consensus.cc:3060] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.524022 28918 raft_consensus.cc:2468] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:28.523912 29270 tablet.cc:1724] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:28.526419 28958 leader_election.cc:304] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:28.527509 29265 raft_consensus.cc:2804] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.528004 29265 raft_consensus.cc:697] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:28.528842 29265 consensus_queue.cc:237] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.542076 28846 raft_consensus.cc:2468] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:28.553676 28742 catalog_manager.cc:6242] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52: soft_deleted_table [id=5ba99e40ee9d4cccae2ed5565b55ac2c] alter complete (version 1)
I20260709 12:29:28.563908 28741 catalog_manager.cc:5697] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 1 to 2, leader changed from e36c559027954e63b5050e833d0973e9 (127.20.98.65) to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 2 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.741155 29276 raft_consensus.cc:993] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9: : Instructing follower a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:28.741653 29279 raft_consensus.cc:1081] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Signalling peer a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:28.743112 28991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:53516
I20260709 12:29:28.743641 28991 raft_consensus.cc:493] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.743949 28991 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:28.749225 29260 raft_consensus.cc:993] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4: : Instructing follower a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:28.749975 29261 raft_consensus.cc:1081] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Signalling peer a0410b4c47e14f779bb1ba114b0261fd to start an election
I20260709 12:29:28.751240 28991 raft_consensus.cc:515] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.751667 28995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f"
dest_uuid: "a0410b4c47e14f779bb1ba114b0261fd"
 from {username='slave'} at 127.0.0.1:53502
I20260709 12:29:28.752286 28995 raft_consensus.cc:493] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:28.752691 28995 raft_consensus.cc:3060] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.753559 28991 leader_election.cc:290] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 3 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:28.754209 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:28.754869 28846 raft_consensus.cc:3055] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:28.755205 28846 raft_consensus.cc:740] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e36c559027954e63b5050e833d0973e9, State: Running, Role: LEADER
I20260709 12:29:28.755846 28918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaed468b0c104dcdabdbb36c13a7c1d6" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:28.756060 28846 consensus_queue.cc:260] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.756493 28918 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:28.757460 28846 raft_consensus.cc:3060] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:28.760651 28995 raft_consensus.cc:515] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.763031 28995 leader_election.cc:290] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Requested vote from peers e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209), b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075)
I20260709 12:29:28.764185 28846 raft_consensus.cc:2468] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 3.
I20260709 12:29:28.764510 28918 raft_consensus.cc:2468] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 3.
I20260709 12:29:28.764662 28919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3bda356dbc749128232aabd729ab8d4"
I20260709 12:29:28.765380 28919 raft_consensus.cc:3055] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:28.765712 28919 raft_consensus.cc:740] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b3bda356dbc749128232aabd729ab8d4, State: Running, Role: LEADER
I20260709 12:29:28.765914 28958 leader_election.cc:304] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, b3bda356dbc749128232aabd729ab8d4; no voters: 
I20260709 12:29:28.766785 29265 raft_consensus.cc:2804] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:28.766554 28919 consensus_queue.cc:260] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.767338 29265 raft_consensus.cc:697] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 3 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:28.768482 28846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed151fd7ca6544468ea431cff007c13f" candidate_uuid: "a0410b4c47e14f779bb1ba114b0261fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36c559027954e63b5050e833d0973e9"
I20260709 12:29:28.768229 29265 consensus_queue.cc:237] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.769229 28846 raft_consensus.cc:3060] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.771996 28919 raft_consensus.cc:3060] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:28.778229 28846 raft_consensus.cc:2468] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:28.780628 28960 leader_election.cc:304] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0410b4c47e14f779bb1ba114b0261fd, e36c559027954e63b5050e833d0973e9; no voters: 
I20260709 12:29:28.781069 28919 raft_consensus.cc:2468] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0410b4c47e14f779bb1ba114b0261fd in term 2.
I20260709 12:29:28.781774 29264 raft_consensus.cc:2804] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:28.782884 29264 raft_consensus.cc:697] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Becoming Leader. State: Replica: a0410b4c47e14f779bb1ba114b0261fd, State: Running, Role: LEADER
I20260709 12:29:28.784025 29264 consensus_queue.cc:237] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } }
I20260709 12:29:28.791471 28742 catalog_manager.cc:5697] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 2 to 3, leader changed from e36c559027954e63b5050e833d0973e9 (127.20.98.65) to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 3 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:28.804636 28742 catalog_manager.cc:5697] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd reported cstate change: term changed from 1 to 2, leader changed from b3bda356dbc749128232aabd729ab8d4 (127.20.98.66) to a0410b4c47e14f779bb1ba114b0261fd (127.20.98.67). New cstate: current_term: 2 leader_uuid: "a0410b4c47e14f779bb1ba114b0261fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0410b4c47e14f779bb1ba114b0261fd" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:29.038012 28846 raft_consensus.cc:1275] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:29:29.039516 29264 consensus_queue.cc:1048] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:29.048837 28919 raft_consensus.cc:1275] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:29:29.050520 29264 consensus_queue.cc:1048] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:29.211263 28919 raft_consensus.cc:1275] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 3 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:29.212659 29264 consensus_queue.cc:1048] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:29.224278 28846 raft_consensus.cc:1275] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 3 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:29.227253 29292 consensus_queue.cc:1048] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:29.245352 28846 raft_consensus.cc:1275] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:29.247023 29264 consensus_queue.cc:1048] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36c559027954e63b5050e833d0973e9" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 40209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:29.262502 28919 raft_consensus.cc:1275] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Refusing update from remote peer a0410b4c47e14f779bb1ba114b0261fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:29.264084 29265 consensus_queue.cc:1048] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3bda356dbc749128232aabd729ab8d4" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 41075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:29.378698 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:29.385741 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:29.386209 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:29.391238 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:29.391662 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:30.392872 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:30.398662 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:30.399147 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:30.403926 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:30.404372 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:31.405390 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:31.411396 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:31.411926 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:31.416684 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:31.417064 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:32.418090 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:32.422992 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:32.423404 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:32.428449 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:32.428828 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:33.429840 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:33.435132 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:33.435612 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:33.441675 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:33.442140 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:34.443344 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:34.451870 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:34.452358 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:34.457418 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:34.457785 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:35.459293 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:35.466989 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:35.467490 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:35.472337 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:35.472821 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:36.473875 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:36.480263 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:36.480790 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:36.486039 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:36.486501 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:37.487537 20873 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:37.492633 20873 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:37.493083 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:37.498682 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:37.499215 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:38.559176 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
W20260709 12:29:38.582983 28960 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:29:38.591784 28960 consensus_peers.cc:597] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.598150 28960 consensus_peers.cc:597] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.610105 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:38.611084 20873 tablet_replica.cc:333] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.612047 20873 raft_consensus.cc:2243] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.612906 20873 raft_consensus.cc:2272] T 9c1dbcf345464b368863238dc3d47cb3 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.615689 20873 tablet_replica.cc:333] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.616423 20873 raft_consensus.cc:2243] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.617039 20873 raft_consensus.cc:2272] T e14b2598ec024826a975183c661ade87 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.619985 20873 tablet_replica.cc:333] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.620850 20873 raft_consensus.cc:2243] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.621873 20873 raft_consensus.cc:2272] T 5235547c89e742f9be6065b0b24f9ed5 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.624477 20873 tablet_replica.cc:333] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.625216 20873 raft_consensus.cc:2243] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.625805 20873 raft_consensus.cc:2272] T 3e69389bea614d67b9bf2289921b6eda P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.628512 20873 tablet_replica.cc:333] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.629236 20873 raft_consensus.cc:2243] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.630191 20873 raft_consensus.cc:2272] T b327cc5b7f4549e6bdd80e5df691f814 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.632820 20873 tablet_replica.cc:333] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.633698 20873 raft_consensus.cc:2243] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.634287 20873 raft_consensus.cc:2272] T aaed468b0c104dcdabdbb36c13a7c1d6 P e36c559027954e63b5050e833d0973e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.637164 20873 tablet_replica.cc:333] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.637899 20873 raft_consensus.cc:2243] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.638499 20873 raft_consensus.cc:2272] T 233f432fffe74d5aac51e2508c40e1a3 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.641310 20873 tablet_replica.cc:333] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.641911 20873 raft_consensus.cc:2243] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.642925 20873 raft_consensus.cc:2272] T 49d487e6642345ab86291ca0fb5a31be P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.646405 20873 tablet_replica.cc:333] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.647025 20873 raft_consensus.cc:2243] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.647588 20873 raft_consensus.cc:2272] T 585b41d7c794421398e81a52b5a935db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.650233 20873 tablet_replica.cc:333] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.650808 20873 raft_consensus.cc:2243] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.651801 20873 raft_consensus.cc:2272] T 4805c4b9992c492c9db07f4b8146c634 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.654531 20873 tablet_replica.cc:333] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.655184 20873 raft_consensus.cc:2243] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.655791 20873 raft_consensus.cc:2272] T ed151fd7ca6544468ea431cff007c13f P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.658207 20873 tablet_replica.cc:333] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.658787 20873 raft_consensus.cc:2243] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.659734 20873 raft_consensus.cc:2272] T 61ef4114dac34a739ee409d4a29763e7 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.662082 20873 tablet_replica.cc:333] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.662700 20873 raft_consensus.cc:2243] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.663290 20873 raft_consensus.cc:2272] T a95dcecec1cc4307b7fbdcc35cbc3654 P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.665759 20873 tablet_replica.cc:333] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.666340 20873 raft_consensus.cc:2243] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.666904 20873 raft_consensus.cc:2272] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.669252 20873 tablet_replica.cc:333] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.669823 20873 raft_consensus.cc:2243] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.670395 20873 raft_consensus.cc:2272] T 9728c0f18e9f4026a8ffad1a59efad3b P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.673672 20873 tablet_replica.cc:333] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.674225 20873 raft_consensus.cc:2243] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.675172 20873 raft_consensus.cc:2272] T 6894bf56d09a4ca89befe3ac36f35b9d P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.678058 20873 tablet_replica.cc:333] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.678632 20873 raft_consensus.cc:2243] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.679245 20873 raft_consensus.cc:2272] T e0d1caee7f824ef6b1b19efe7e4ca6db P e36c559027954e63b5050e833d0973e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.681694 20873 tablet_replica.cc:333] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9: stopping tablet replica
I20260709 12:29:38.682221 20873 raft_consensus.cc:2243] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.682685 20873 raft_consensus.cc:2272] T dc2ad640b1264286871e3b9e3eecb5a1 P e36c559027954e63b5050e833d0973e9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.689592 28960 consensus_peers.cc:597] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.700933 28886 consensus_peers.cc:597] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.733817 28960 consensus_peers.cc:597] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.736505 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
I20260709 12:29:38.784245 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
I20260709 12:29:38.817584 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:38.818531 20873 tablet_replica.cc:333] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.819499 20873 raft_consensus.cc:2243] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.820509 20873 raft_consensus.cc:2272] T 9c1dbcf345464b368863238dc3d47cb3 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.822999 20873 tablet_replica.cc:333] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.823711 20873 raft_consensus.cc:2243] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.824635 20873 raft_consensus.cc:2272] T e14b2598ec024826a975183c661ade87 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.827344 20873 tablet_replica.cc:333] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.828004 20873 raft_consensus.cc:2243] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.828563 20873 raft_consensus.cc:2272] T 5235547c89e742f9be6065b0b24f9ed5 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.831020 20873 tablet_replica.cc:333] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.831686 20873 raft_consensus.cc:2243] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.832615 20873 raft_consensus.cc:2272] T 3e69389bea614d67b9bf2289921b6eda P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.836680 20873 tablet_replica.cc:333] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.837576 20873 raft_consensus.cc:2243] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.838369 20873 raft_consensus.cc:2272] T b327cc5b7f4549e6bdd80e5df691f814 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:38.839222 28886 consensus_peers.cc:597] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.841306 20873 tablet_replica.cc:333] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.842020 20873 raft_consensus.cc:2243] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.842711 20873 raft_consensus.cc:2272] T 233f432fffe74d5aac51e2508c40e1a3 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.845257 20873 tablet_replica.cc:333] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.845878 20873 raft_consensus.cc:2243] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.846714 20873 raft_consensus.cc:2272] T 585b41d7c794421398e81a52b5a935db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.849112 20873 tablet_replica.cc:333] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.849701 20873 raft_consensus.cc:2243] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.850196 20873 raft_consensus.cc:2272] T 49d487e6642345ab86291ca0fb5a31be P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.852368 20873 tablet_replica.cc:333] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.852886 20873 raft_consensus.cc:2243] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.853395 20873 raft_consensus.cc:2272] T e0d1caee7f824ef6b1b19efe7e4ca6db P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.855614 20873 tablet_replica.cc:333] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.856173 20873 raft_consensus.cc:2243] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.857016 20873 raft_consensus.cc:2272] T dc2ad640b1264286871e3b9e3eecb5a1 P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.859294 20873 tablet_replica.cc:333] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.859786 20873 raft_consensus.cc:2243] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.860190 20873 raft_consensus.cc:2272] T 4805c4b9992c492c9db07f4b8146c634 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.862533 20873 tablet_replica.cc:333] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.863016 20873 raft_consensus.cc:2243] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.863441 20873 raft_consensus.cc:2272] T ed151fd7ca6544468ea431cff007c13f P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.865551 20873 tablet_replica.cc:333] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.866073 20873 raft_consensus.cc:2243] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.866557 20873 raft_consensus.cc:2272] T 9728c0f18e9f4026a8ffad1a59efad3b P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.868782 20873 tablet_replica.cc:333] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.869310 20873 raft_consensus.cc:2243] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.869707 20873 raft_consensus.cc:2272] T 6894bf56d09a4ca89befe3ac36f35b9d P b3bda356dbc749128232aabd729ab8d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.871786 20873 tablet_replica.cc:333] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.872238 20873 raft_consensus.cc:2243] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.872722 20873 raft_consensus.cc:2272] T aaed468b0c104dcdabdbb36c13a7c1d6 P b3bda356dbc749128232aabd729ab8d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.874927 20873 tablet_replica.cc:333] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.875388 20873 raft_consensus.cc:2243] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.875777 20873 raft_consensus.cc:2272] T a95dcecec1cc4307b7fbdcc35cbc3654 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.877771 20873 tablet_replica.cc:333] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.878234 20873 raft_consensus.cc:2243] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:38.879060 20873 raft_consensus.cc:2272] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.881433 20873 tablet_replica.cc:333] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4: stopping tablet replica
I20260709 12:29:38.882015 20873 raft_consensus.cc:2243] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:38.882429 20873 raft_consensus.cc:2272] T 61ef4114dac34a739ee409d4a29763e7 P b3bda356dbc749128232aabd729ab8d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:38.925110 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
W20260709 12:29:38.950135 28960 consensus_peers.cc:597] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:38.968266 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
W20260709 12:29:38.974977 28960 consensus_peers.cc:597] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd -> Peer e36c559027954e63b5050e833d0973e9 (127.20.98.65:40209): Couldn't send request to peer e36c559027954e63b5050e833d0973e9. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:40209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:38.989579 28958 consensus_peers.cc:597] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd -> Peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Couldn't send request to peer b3bda356dbc749128232aabd729ab8d4. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:41075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:39.004356 28958 consensus_peers.cc:597] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd -> Peer b3bda356dbc749128232aabd729ab8d4 (127.20.98.66:41075): Couldn't send request to peer b3bda356dbc749128232aabd729ab8d4. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:41075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:39.005765 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:39.006696 20873 tablet_replica.cc:333] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.007864 20873 raft_consensus.cc:2243] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.008673 20873 raft_consensus.cc:2272] T 9c1dbcf345464b368863238dc3d47cb3 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.011224 20873 tablet_replica.cc:333] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.011818 20873 raft_consensus.cc:2243] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.012352 20873 raft_consensus.cc:2272] T e14b2598ec024826a975183c661ade87 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.014583 20873 tablet_replica.cc:333] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.015111 20873 raft_consensus.cc:2243] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.015559 20873 raft_consensus.cc:2272] T b327cc5b7f4549e6bdd80e5df691f814 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.017740 20873 tablet_replica.cc:333] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.018275 20873 raft_consensus.cc:2243] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.018795 20873 raft_consensus.cc:2272] T 5235547c89e742f9be6065b0b24f9ed5 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.020859 20873 tablet_replica.cc:333] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.021519 20873 raft_consensus.cc:2243] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.021991 20873 raft_consensus.cc:2272] T 3e69389bea614d67b9bf2289921b6eda P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.024032 20873 tablet_replica.cc:333] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.024587 20873 raft_consensus.cc:2243] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:39.025519 20873 raft_consensus.cc:2272] T 233f432fffe74d5aac51e2508c40e1a3 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.027868 20873 tablet_replica.cc:333] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.028437 20873 raft_consensus.cc:2243] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.028915 20873 raft_consensus.cc:2272] T 585b41d7c794421398e81a52b5a935db P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.031018 20873 tablet_replica.cc:333] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.031589 20873 raft_consensus.cc:2243] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.032071 20873 raft_consensus.cc:2272] T 49d487e6642345ab86291ca0fb5a31be P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.034245 20873 tablet_replica.cc:333] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.034799 20873 raft_consensus.cc:2243] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:39.035668 20873 raft_consensus.cc:2272] T e0d1caee7f824ef6b1b19efe7e4ca6db P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.037616 20873 tablet_replica.cc:333] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.038175 20873 raft_consensus.cc:2243] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.038645 20873 raft_consensus.cc:2272] T dc2ad640b1264286871e3b9e3eecb5a1 P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.040962 20873 tablet_replica.cc:333] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.041556 20873 raft_consensus.cc:2243] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:39.042730 20873 raft_consensus.cc:2272] T 9728c0f18e9f4026a8ffad1a59efad3b P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.045831 20873 tablet_replica.cc:333] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.046620 20873 raft_consensus.cc:2243] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:39.047606 20873 raft_consensus.cc:2272] T ed151fd7ca6544468ea431cff007c13f P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.049808 20873 tablet_replica.cc:333] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.050315 20873 raft_consensus.cc:2243] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.050747 20873 raft_consensus.cc:2272] T 4805c4b9992c492c9db07f4b8146c634 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.052734 20873 tablet_replica.cc:333] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.053285 20873 raft_consensus.cc:2243] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:39.054064 20873 raft_consensus.cc:2272] T aaed468b0c104dcdabdbb36c13a7c1d6 P a0410b4c47e14f779bb1ba114b0261fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.056236 20873 tablet_replica.cc:333] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.056691 20873 raft_consensus.cc:2243] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:39.057562 20873 raft_consensus.cc:2272] T a95dcecec1cc4307b7fbdcc35cbc3654 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.059504 20873 tablet_replica.cc:333] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.059938 20873 raft_consensus.cc:2243] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.060322 20873 raft_consensus.cc:2272] T b7d1b3b3d9ca4e9ea5cb52f4369b198e P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.062392 20873 tablet_replica.cc:333] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.062831 20873 raft_consensus.cc:2243] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.063246 20873 raft_consensus.cc:2272] T 61ef4114dac34a739ee409d4a29763e7 P a0410b4c47e14f779bb1ba114b0261fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.065346 20873 tablet_replica.cc:333] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd: stopping tablet replica
I20260709 12:29:39.065762 20873 raft_consensus.cc:2243] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:39.066215 20873 raft_consensus.cc:2272] T 6894bf56d09a4ca89befe3ac36f35b9d P a0410b4c47e14f779bb1ba114b0261fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.110931 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
I20260709 12:29:39.149598 20873 master.cc:562] Master@127.20.98.126:43045 shutting down...
I20260709 12:29:39.173957 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:39.174639 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:39.175009 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P cc4d9cdbb73e4155bed0ad1919beae52: stopping tablet replica
I20260709 12:29:39.197540 20873 master.cc:584] Master@127.20.98.126:43045 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20443 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:29:39.252873 20873 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.98.126:37945
I20260709 12:29:39.254135 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:39.259980 29330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:39.260006 29329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:39.262976 20873 server_base.cc:1061] running on GCE node
W20260709 12:29:39.263125 29332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:39.264225 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:39.264492 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:39.264652 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600179264637 us; error 0 us; skew 500 ppm
I20260709 12:29:39.265244 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:39.267653 20873 webserver.cc:533] Webserver started at http://127.20.98.126:35417/ using document root <none> and password file <none>
I20260709 12:29:39.268155 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:39.268359 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:39.268642 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:39.270431 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/master-0-root/instance:
uuid: "0240079184f1420da604c1fce0f3c757"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.275000 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:29:39.278463 29337 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.279263 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:29:39.279561 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/master-0-root
uuid: "0240079184f1420da604c1fce0f3c757"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.279851 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:39.292469 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:39.293908 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:39.334669 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.126:37945
I20260709 12:29:39.334781 29388 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.126:37945 every 8 connection(s)
I20260709 12:29:39.338897 29389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.352154 29389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757: Bootstrap starting.
I20260709 12:29:39.358033 29389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.362910 29389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757: No bootstrap required, opened a new log
I20260709 12:29:39.365532 29389 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0240079184f1420da604c1fce0f3c757" member_type: VOTER }
I20260709 12:29:39.366048 29389 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.366317 29389 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0240079184f1420da604c1fce0f3c757, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.367017 29389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0240079184f1420da604c1fce0f3c757" member_type: VOTER }
I20260709 12:29:39.367550 29389 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:39.367796 29389 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:39.368130 29389 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.373679 29389 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0240079184f1420da604c1fce0f3c757" member_type: VOTER }
I20260709 12:29:39.374294 29389 leader_election.cc:304] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0240079184f1420da604c1fce0f3c757; no voters: 
I20260709 12:29:39.375689 29389 leader_election.cc:290] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:39.376272 29392 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:39.377826 29392 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 1 LEADER]: Becoming Leader. State: Replica: 0240079184f1420da604c1fce0f3c757, State: Running, Role: LEADER
I20260709 12:29:39.378599 29392 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0240079184f1420da604c1fce0f3c757" member_type: VOTER }
I20260709 12:29:39.379024 29389 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:39.383657 29393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0240079184f1420da604c1fce0f3c757" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0240079184f1420da604c1fce0f3c757" member_type: VOTER } }
I20260709 12:29:39.384258 29393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:39.385501 29394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0240079184f1420da604c1fce0f3c757. Latest consensus state: current_term: 1 leader_uuid: "0240079184f1420da604c1fce0f3c757" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0240079184f1420da604c1fce0f3c757" member_type: VOTER } }
I20260709 12:29:39.386246 29394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:39.386744 29398 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:39.392937 29398 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:39.398119 20873 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:39.403520 29398 catalog_manager.cc:1383] Generated new cluster ID: b5c100111730493ca3a6e5723c7c9588
I20260709 12:29:39.403818 29398 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:39.422931 29398 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:39.424358 29398 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:39.439692 29398 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757: Generated new TSK 0
I20260709 12:29:39.440348 29398 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:39.465497 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:39.472306 29410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:39.473706 29411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:39.475661 29413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:39.479447 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:39.480630 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:39.480813 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:39.481001 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600179480986 us; error 0 us; skew 500 ppm
I20260709 12:29:39.481700 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:39.484246 20873 webserver.cc:533] Webserver started at http://127.20.98.65:36537/ using document root <none> and password file <none>
I20260709 12:29:39.484736 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:39.484930 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:39.485276 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:39.486441 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-0-root/instance:
uuid: "65c489f88c374b6a851e01d97b006d1e"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.490975 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:39.494536 29418 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.495309 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:39.495626 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-0-root
uuid: "65c489f88c374b6a851e01d97b006d1e"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.495904 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:39.514079 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:39.515352 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:39.517041 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:39.519480 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:39.519726 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.519976 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:39.520174 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.561971 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.65:38645
I20260709 12:29:39.562077 29481 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.65:38645 every 8 connection(s)
I20260709 12:29:39.567209 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:39.574447 29486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:39.575773 29487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:39.577570 29489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:39.578321 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:39.579766 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:39.579953 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:39.580147 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600179580134 us; error 0 us; skew 500 ppm
I20260709 12:29:39.580768 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:39.583709 20873 webserver.cc:533] Webserver started at http://127.20.98.66:40263/ using document root <none> and password file <none>
I20260709 12:29:39.584270 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:39.584515 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:39.584812 29482 heartbeater.cc:344] Connected to a master server at 127.20.98.126:37945
I20260709 12:29:39.584837 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:39.585340 29482 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:39.586148 29482 heartbeater.cc:507] Master 127.20.98.126:37945 requested a full tablet report, sending...
I20260709 12:29:39.586526 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-1-root/instance:
uuid: "61694e986200461884bab12f4b16a183"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.588419 29354 ts_manager.cc:194] Registered new tserver with Master: 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645)
I20260709 12:29:39.590389 29354 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34292
I20260709 12:29:39.591892 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:29:39.595800 29494 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.596662 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:39.596988 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-1-root
uuid: "61694e986200461884bab12f4b16a183"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.597352 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:39.612414 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:39.613710 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:39.615272 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:39.617579 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:39.617810 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.618062 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:39.618234 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.658584 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.66:46129
I20260709 12:29:39.658725 29556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.66:46129 every 8 connection(s)
I20260709 12:29:39.663565 20873 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:39.672330 29560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:39.673650 29561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:39.677850 29563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:39.678771 29557 heartbeater.cc:344] Connected to a master server at 127.20.98.126:37945
I20260709 12:29:39.678892 20873 server_base.cc:1061] running on GCE node
I20260709 12:29:39.679376 29557 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:39.680074 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:29:39.680222 29557 heartbeater.cc:507] Master 127.20.98.126:37945 requested a full tablet report, sending...
W20260709 12:29:39.680392 20873 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:39.680706 20873 hybrid_clock.cc:648] HybridClock initialized: now 1783600179680686 us; error 0 us; skew 500 ppm
I20260709 12:29:39.681510 20873 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:39.682912 29354 ts_manager.cc:194] Registered new tserver with Master: 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:39.684451 20873 webserver.cc:533] Webserver started at http://127.20.98.67:46863/ using document root <none> and password file <none>
I20260709 12:29:39.685021 29354 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34304
I20260709 12:29:39.685194 20873 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:39.685510 20873 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:39.685848 20873 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:39.687225 20873 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-2-root/instance:
uuid: "8c06bd41a19e46a0825725c322fea562"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.691833 20873 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:39.695483 29568 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.696378 20873 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:39.696702 20873 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-2-root
uuid: "8c06bd41a19e46a0825725c322fea562"
format_stamp: "Formatted at 2026-07-09 12:29:39 on dist-test-slave-g3x6"
I20260709 12:29:39.696954 20873 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcTz2bG/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599888412524-20873-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:39.716202 20873 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:39.717684 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:39.719404 20873 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:39.723189 20873 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:39.723399 20873 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.723604 20873 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:39.723748 20873 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:39.766731 20873 rpc_server.cc:307] RPC server started. Bound to: 127.20.98.67:46057
I20260709 12:29:39.766860 29630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.98.67:46057 every 8 connection(s)
I20260709 12:29:39.782023 29631 heartbeater.cc:344] Connected to a master server at 127.20.98.126:37945
I20260709 12:29:39.782462 29631 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:39.783244 29631 heartbeater.cc:507] Master 127.20.98.126:37945 requested a full tablet report, sending...
I20260709 12:29:39.785653 29354 ts_manager.cc:194] Registered new tserver with Master: 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:39.786507 20873 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01629396s
I20260709 12:29:39.787245 29354 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34318
I20260709 12:29:39.813719 29354 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34328:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:39.816763 29354 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:39.903100 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3a77d92f74401081ea7c544e0e43c8 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:39.903808 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 35ec4305852d4153af8bcf8bbe1e5fbe (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:39.904640 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3a77d92f74401081ea7c544e0e43c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.905654 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ec4305852d4153af8bcf8bbe1e5fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.916219 29444 tablet_service.cc:1511] Processing CreateTablet for tablet e4b45c92c0394f65b0d53dc52ce677a2 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:39.917951 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b45c92c0394f65b0d53dc52ce677a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.924561 29442 tablet_service.cc:1511] Processing CreateTablet for tablet 752a1f2d9f604ee5b944fe7fb1914ec0 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:39.924863 29441 tablet_service.cc:1511] Processing CreateTablet for tablet 92d0982e7ba24a49b9ed68109b4472f8 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:39.926944 29440 tablet_service.cc:1511] Processing CreateTablet for tablet 8b91b8958ba947639f85be23ced183af (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:39.927196 29520 tablet_service.cc:1511] Processing CreateTablet for tablet e4b45c92c0394f65b0d53dc52ce677a2 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:39.928646 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b45c92c0394f65b0d53dc52ce677a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.928975 29443 tablet_service.cc:1511] Processing CreateTablet for tablet 60d47efb8f2e47e1ade6aafd433753bb (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:39.930205 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752a1f2d9f604ee5b944fe7fb1914ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.931481 29522 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3a77d92f74401081ea7c544e0e43c8 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:39.932950 29522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3a77d92f74401081ea7c544e0e43c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.944283 29592 tablet_service.cc:1511] Processing CreateTablet for tablet 752a1f2d9f604ee5b944fe7fb1914ec0 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:39.934496 29521 tablet_service.cc:1511] Processing CreateTablet for tablet 35ec4305852d4153af8bcf8bbe1e5fbe (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:39.944631 29515 tablet_service.cc:1511] Processing CreateTablet for tablet 086aa64888bc4f05b353712f483dee45 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:39.936430 29591 tablet_service.cc:1511] Processing CreateTablet for tablet 92d0982e7ba24a49b9ed68109b4472f8 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:39.945720 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752a1f2d9f604ee5b944fe7fb1914ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.946638 29591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d0982e7ba24a49b9ed68109b4472f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.938032 29440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b91b8958ba947639f85be23ced183af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.947230 29514 tablet_service.cc:1511] Processing CreateTablet for tablet 99dc477137b94a329c8a38c514a793b0 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:39.937677 29596 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3a77d92f74401081ea7c544e0e43c8 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:39.950135 29596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3a77d92f74401081ea7c544e0e43c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.938300 29590 tablet_service.cc:1511] Processing CreateTablet for tablet 8b91b8958ba947639f85be23ced183af (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:39.954087 29590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b91b8958ba947639f85be23ced183af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.938890 29595 tablet_service.cc:1511] Processing CreateTablet for tablet 35ec4305852d4153af8bcf8bbe1e5fbe (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:39.958248 29595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ec4305852d4153af8bcf8bbe1e5fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.939769 29517 tablet_service.cc:1511] Processing CreateTablet for tablet 92d0982e7ba24a49b9ed68109b4472f8 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:39.940196 29589 tablet_service.cc:1511] Processing CreateTablet for tablet 086aa64888bc4f05b353712f483dee45 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:39.940704 29594 tablet_service.cc:1511] Processing CreateTablet for tablet e4b45c92c0394f65b0d53dc52ce677a2 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:39.962188 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d0982e7ba24a49b9ed68109b4472f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.941996 29516 tablet_service.cc:1511] Processing CreateTablet for tablet 8b91b8958ba947639f85be23ced183af (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:39.942075 29588 tablet_service.cc:1511] Processing CreateTablet for tablet 99dc477137b94a329c8a38c514a793b0 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:39.942533 29593 tablet_service.cc:1511] Processing CreateTablet for tablet 60d47efb8f2e47e1ade6aafd433753bb (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:39.929039 29439 tablet_service.cc:1511] Processing CreateTablet for tablet 086aa64888bc4f05b353712f483dee45 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:39.965266 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086aa64888bc4f05b353712f483dee45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.965973 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d47efb8f2e47e1ade6aafd433753bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.936452 29519 tablet_service.cc:1511] Processing CreateTablet for tablet 60d47efb8f2e47e1ade6aafd433753bb (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:39.966441 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 99dc477137b94a329c8a38c514a793b0 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:39.967101 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d47efb8f2e47e1ade6aafd433753bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.967903 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99dc477137b94a329c8a38c514a793b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.937685 29518 tablet_service.cc:1511] Processing CreateTablet for tablet 752a1f2d9f604ee5b944fe7fb1914ec0 (DEFAULT_TABLE table=test-workload [id=c7b11fb35b3040dd887b6e3850eeae7b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:39.969630 29521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ec4305852d4153af8bcf8bbe1e5fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.970352 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752a1f2d9f604ee5b944fe7fb1914ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.962190 29589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086aa64888bc4f05b353712f483dee45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.972534 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b45c92c0394f65b0d53dc52ce677a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.974098 29593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d47efb8f2e47e1ade6aafd433753bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.974575 29516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b91b8958ba947639f85be23ced183af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.975751 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d0982e7ba24a49b9ed68109b4472f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.986570 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99dc477137b94a329c8a38c514a793b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.989676 29515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086aa64888bc4f05b353712f483dee45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.990694 29588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99dc477137b94a329c8a38c514a793b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:40.049875 29648 tablet_bootstrap.cc:492] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:40.063529 29647 tablet_bootstrap.cc:492] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.072781 29647 tablet_bootstrap.cc:654] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.078472 29646 tablet_bootstrap.cc:492] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.114591 29647 tablet_bootstrap.cc:492] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.115216 29647 ts_tablet_manager.cc:1403] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.009s
I20260709 12:29:40.116439 29646 tablet_bootstrap.cc:654] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.117291 29648 tablet_bootstrap.cc:654] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.120244 29647 raft_consensus.cc:359] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.121950 29647 raft_consensus.cc:385] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.122315 29647 raft_consensus.cc:740] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.123170 29647 consensus_queue.cc:260] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.130450 29648 tablet_bootstrap.cc:492] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.131271 29648 ts_tablet_manager.cc:1403] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 12:29:40.134927 29647 ts_tablet_manager.cc:1434] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.011s
I20260709 12:29:40.135809 29648 raft_consensus.cc:359] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.136472 29648 raft_consensus.cc:385] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.136729 29648 raft_consensus.cc:740] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.137552 29557 heartbeater.cc:499] Master 127.20.98.126:37945 was elected leader, sending a full tablet report...
I20260709 12:29:40.138120 29647 tablet_bootstrap.cc:492] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.137684 29648 consensus_queue.cc:260] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.138671 29646 tablet_bootstrap.cc:492] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.142432 29646 ts_tablet_manager.cc:1403] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.013s
I20260709 12:29:40.145685 29646 raft_consensus.cc:359] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.146646 29646 raft_consensus.cc:385] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.146968 29646 raft_consensus.cc:740] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.147118 29647 tablet_bootstrap.cc:654] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.148068 29631 heartbeater.cc:499] Master 127.20.98.126:37945 was elected leader, sending a full tablet report...
I20260709 12:29:40.148018 29646 consensus_queue.cc:260] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.156951 29482 heartbeater.cc:499] Master 127.20.98.126:37945 was elected leader, sending a full tablet report...
I20260709 12:29:40.158299 29646 ts_tablet_manager.cc:1434] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 12:29:40.147212 29648 ts_tablet_manager.cc:1434] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 12:29:40.159461 29646 tablet_bootstrap.cc:492] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.159936 29648 tablet_bootstrap.cc:492] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
W20260709 12:29:40.165355 29558 tablet.cc:2406] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:29:40.166458 29646 tablet_bootstrap.cc:654] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.169656 29648 tablet_bootstrap.cc:654] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.177922 29647 tablet_bootstrap.cc:492] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.178732 29647 ts_tablet_manager.cc:1403] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.021s
I20260709 12:29:40.180032 29646 tablet_bootstrap.cc:492] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.180785 29646 ts_tablet_manager.cc:1403] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.014s
I20260709 12:29:40.183240 29647 raft_consensus.cc:359] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.184155 29647 raft_consensus.cc:385] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.184128 29646 raft_consensus.cc:359] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.184794 29647 raft_consensus.cc:740] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.185066 29646 raft_consensus.cc:385] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.185494 29646 raft_consensus.cc:740] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.186350 29648 tablet_bootstrap.cc:492] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.186110 29647 consensus_queue.cc:260] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.187793 29648 ts_tablet_manager.cc:1403] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
I20260709 12:29:40.186565 29646 consensus_queue.cc:260] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.189924 29647 ts_tablet_manager.cc:1434] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:29:40.190222 29646 ts_tablet_manager.cc:1434] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:29:40.191118 29647 tablet_bootstrap.cc:492] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.191360 29646 tablet_bootstrap.cc:492] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.199682 29647 tablet_bootstrap.cc:654] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.199682 29646 tablet_bootstrap.cc:654] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.207574 29646 tablet_bootstrap.cc:492] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.208112 29646 ts_tablet_manager.cc:1403] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:29:40.208597 29647 tablet_bootstrap.cc:492] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.208166 29648 raft_consensus.cc:359] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.209095 29648 raft_consensus.cc:385] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.209220 29647 ts_tablet_manager.cc:1403] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 12:29:40.209486 29648 raft_consensus.cc:740] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.211387 29646 raft_consensus.cc:359] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.210932 29648 consensus_queue.cc:260] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.212172 29646 raft_consensus.cc:385] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.212618 29646 raft_consensus.cc:740] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.212523 29647 raft_consensus.cc:359] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.213384 29647 raft_consensus.cc:385] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.213685 29647 raft_consensus.cc:740] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.213641 29646 consensus_queue.cc:260] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.214433 29648 ts_tablet_manager.cc:1434] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:29:40.214634 29647 consensus_queue.cc:260] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.216086 29648 tablet_bootstrap.cc:492] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:40.216459 29646 ts_tablet_manager.cc:1434] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:29:40.216975 29647 ts_tablet_manager.cc:1434] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:40.217842 29647 tablet_bootstrap.cc:492] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.223750 29648 tablet_bootstrap.cc:654] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.224452 29647 tablet_bootstrap.cc:654] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.227684 29646 tablet_bootstrap.cc:492] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.230806 29653 raft_consensus.cc:493] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.231395 29653 raft_consensus.cc:515] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.234175 29653 leader_election.cc:290] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.238168 29646 tablet_bootstrap.cc:654] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.248006 29654 raft_consensus.cc:493] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.248829 29654 raft_consensus.cc:515] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.264578 29652 raft_consensus.cc:493] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.265410 29652 raft_consensus.cc:515] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.285099 29654 leader_election.cc:290] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.286158 29654 raft_consensus.cc:493] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.286681 29654 raft_consensus.cc:515] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.289062 29654 leader_election.cc:290] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.291816 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d47efb8f2e47e1ade6aafd433753bb" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.292332 29648 tablet_bootstrap.cc:492] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.293087 29648 ts_tablet_manager.cc:1403] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.007s
W20260709 12:29:40.293983 29570 leader_election.cc:343] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61694e986200461884bab12f4b16a183 (127.20.98.66:46129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.295490 29647 tablet_bootstrap.cc:492] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.295944 29647 ts_tablet_manager.cc:1403] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.026s
I20260709 12:29:40.299503 29647 raft_consensus.cc:359] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.300418 29647 raft_consensus.cc:385] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.299943 29648 raft_consensus.cc:359] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.300812 29647 raft_consensus.cc:740] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.291828 29652 leader_election.cc:290] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.321420 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d47efb8f2e47e1ade6aafd433753bb" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.301115 29648 raft_consensus.cc:385] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.324213 29648 raft_consensus.cc:740] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.307046 29646 tablet_bootstrap.cc:492] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.323179 29647 consensus_queue.cc:260] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
W20260709 12:29:40.325371 29570 leader_election.cc:343] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.326032 29570 leader_election.cc:304] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c06bd41a19e46a0825725c322fea562; no voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:40.327100 29647 ts_tablet_manager.cc:1434] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.031s	user 0.017s	sys 0.013s
I20260709 12:29:40.327596 29653 raft_consensus.cc:2749] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.328275 29647 tablet_bootstrap.cc:492] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.325606 29646 ts_tablet_manager.cc:1403] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.098s	user 0.027s	sys 0.002s
I20260709 12:29:40.328655 29648 consensus_queue.cc:260] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.334134 29646 raft_consensus.cc:359] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.334925 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.335592 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b45c92c0394f65b0d53dc52ce677a2" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.336597 29531 raft_consensus.cc:2468] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
W20260709 12:29:40.336951 29420 leader_election.cc:343] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61694e986200461884bab12f4b16a183 (127.20.98.66:46129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.334921 29646 raft_consensus.cc:385] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.338155 29646 raft_consensus.cc:740] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.338238 29420 leader_election.cc:304] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:40.339542 29666 raft_consensus.cc:2804] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.339813 29647 tablet_bootstrap.cc:654] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.340044 29666 raft_consensus.cc:493] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.340423 29666 raft_consensus.cc:3060] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.345294 29653 raft_consensus.cc:493] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.345885 29653 raft_consensus.cc:515] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.348536 29653 leader_election.cc:290] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.351822 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b91b8958ba947639f85be23ced183af" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.354342 29666 raft_consensus.cc:515] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
W20260709 12:29:40.355487 29570 leader_election.cc:343] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.339193 29646 consensus_queue.cc:260] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.356828 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b91b8958ba947639f85be23ced183af" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.357836 29531 raft_consensus.cc:2468] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:40.359597 29570 leader_election.cc:304] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:40.361232 29653 raft_consensus.cc:2804] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.361742 29653 raft_consensus.cc:493] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.362171 29653 raft_consensus.cc:3060] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.364462 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b45c92c0394f65b0d53dc52ce677a2" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:40.365545 29531 raft_consensus.cc:3060] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.335193 29648 ts_tablet_manager.cc:1434] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.005s
I20260709 12:29:40.376226 29646 ts_tablet_manager.cc:1434] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 12:29:40.377653 29646 tablet_bootstrap.cc:492] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.378165 29653 raft_consensus.cc:515] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.380666 29653 leader_election.cc:290] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.380897 29666 leader_election.cc:290] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.387537 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b91b8958ba947639f85be23ced183af" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:40.388823 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b91b8958ba947639f85be23ced183af" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:40.389531 29532 raft_consensus.cc:3060] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.389686 29648 tablet_bootstrap.cc:492] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
W20260709 12:29:40.390451 29570 leader_election.cc:343] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:40.392824 29402 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:40.399857 29647 tablet_bootstrap.cc:492] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.400553 29647 ts_tablet_manager.cc:1403] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.010s
I20260709 12:29:40.400823 29531 raft_consensus.cc:2468] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:40.405807 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.406165 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b45c92c0394f65b0d53dc52ce677a2" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.406172 29647 raft_consensus.cc:359] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.407472 29647 raft_consensus.cc:385] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.407703 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b45c92c0394f65b0d53dc52ce677a2" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:40.407887 29647 raft_consensus.cc:740] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.409103 29532 raft_consensus.cc:2468] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:40.410686 29570 leader_election.cc:304] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:40.412906 29653 raft_consensus.cc:2804] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:29:40.413672 29419 leader_election.cc:343] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.415139 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.415251 29420 leader_election.cc:304] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:40.416216 29666 raft_consensus.cc:2804] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.416728 29666 raft_consensus.cc:697] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
W20260709 12:29:40.416885 29495 leader_election.cc:343] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.414004 29648 tablet_bootstrap.cc:654] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.417666 29666 consensus_queue.cc:237] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.415169 29646 tablet_bootstrap.cc:654] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.423367 29419 leader_election.cc:304] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e; no voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:40.424721 29654 raft_consensus.cc:2749] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.428992 29647 consensus_queue.cc:260] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.431054 29653 raft_consensus.cc:697] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:40.433915 29653 consensus_queue.cc:237] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
W20260709 12:29:40.429917 29419 leader_election.cc:343] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:40.439973 29419 leader_election.cc:343] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.444140 29647 ts_tablet_manager.cc:1434] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.004s
I20260709 12:29:40.444480 29648 tablet_bootstrap.cc:492] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.445520 29647 tablet_bootstrap.cc:492] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.446069 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.445076 29648 ts_tablet_manager.cc:1403] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.015s
W20260709 12:29:40.447796 29496 leader_election.cc:343] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.448467 29496 leader_election.cc:304] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61694e986200461884bab12f4b16a183; no voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:40.447844 29351 catalog_manager.cc:5697] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.449779 29652 raft_consensus.cc:2749] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.454222 29648 raft_consensus.cc:359] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.455194 29648 raft_consensus.cc:385] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.455592 29648 raft_consensus.cc:740] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.456557 29648 consensus_queue.cc:260] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.460384 29648 ts_tablet_manager.cc:1434] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:29:40.461570 29648 tablet_bootstrap.cc:492] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:40.462600 29646 tablet_bootstrap.cc:492] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.463248 29646 ts_tablet_manager.cc:1403] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.002s
I20260709 12:29:40.465727 29647 tablet_bootstrap.cc:654] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.464778 29353 catalog_manager.cc:5697] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:40.469089 29648 tablet_bootstrap.cc:654] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.468988 29646 raft_consensus.cc:359] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.470074 29646 raft_consensus.cc:385] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.470438 29646 raft_consensus.cc:740] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.475397 29646 consensus_queue.cc:260] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.478193 29646 ts_tablet_manager.cc:1434] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 12:29:40.479393 29646 tablet_bootstrap.cc:492] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.480540 29647 tablet_bootstrap.cc:492] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.481613 29647 ts_tablet_manager.cc:1403] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.011s
I20260709 12:29:40.488287 29646 tablet_bootstrap.cc:654] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.486642 29647 raft_consensus.cc:359] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.489214 29647 raft_consensus.cc:385] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.489641 29647 raft_consensus.cc:740] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.490468 29648 tablet_bootstrap.cc:492] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.491098 29648 ts_tablet_manager.cc:1403] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.012s
I20260709 12:29:40.490975 29647 consensus_queue.cc:260] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.494364 29647 ts_tablet_manager.cc:1434] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:29:40.494951 29648 raft_consensus.cc:359] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.495632 29647 tablet_bootstrap.cc:492] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.495913 29648 raft_consensus.cc:385] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.496332 29648 raft_consensus.cc:740] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.497457 29648 consensus_queue.cc:260] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.500577 29648 ts_tablet_manager.cc:1434] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:29:40.501809 29648 tablet_bootstrap.cc:492] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:40.502547 29646 tablet_bootstrap.cc:492] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.503171 29646 ts_tablet_manager.cc:1403] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:29:40.504999 29647 tablet_bootstrap.cc:654] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.506965 29646 raft_consensus.cc:359] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.507910 29646 raft_consensus.cc:385] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.508265 29646 raft_consensus.cc:740] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.509473 29648 tablet_bootstrap.cc:654] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.509289 29646 consensus_queue.cc:260] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.512683 29646 ts_tablet_manager.cc:1434] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:29:40.513811 29646 tablet_bootstrap.cc:492] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.519847 29647 tablet_bootstrap.cc:492] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.520802 29647 ts_tablet_manager.cc:1403] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 12:29:40.522781 29646 tablet_bootstrap.cc:654] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.526703 29647 raft_consensus.cc:359] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.527663 29647 raft_consensus.cc:385] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.528084 29647 raft_consensus.cc:740] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.529184 29647 consensus_queue.cc:260] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.530628 29648 tablet_bootstrap.cc:492] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.531199 29648 ts_tablet_manager.cc:1403] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.011s
I20260709 12:29:40.534898 29647 ts_tablet_manager.cc:1434] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:29:40.534703 29648 raft_consensus.cc:359] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.535429 29646 tablet_bootstrap.cc:492] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.535529 29648 raft_consensus.cc:385] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.536121 29646 ts_tablet_manager.cc:1403] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 12:29:40.536087 29648 raft_consensus.cc:740] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.537267 29648 consensus_queue.cc:260] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.538880 29647 tablet_bootstrap.cc:492] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.540073 29648 ts_tablet_manager.cc:1434] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:29:40.540242 29646 raft_consensus.cc:359] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.541199 29646 raft_consensus.cc:385] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.541344 29648 tablet_bootstrap.cc:492] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:40.541565 29646 raft_consensus.cc:740] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.542755 29646 consensus_queue.cc:260] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.545711 29646 ts_tablet_manager.cc:1434] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.004s
I20260709 12:29:40.546801 29646 tablet_bootstrap.cc:492] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.547292 29647 tablet_bootstrap.cc:654] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.549463 29648 tablet_bootstrap.cc:654] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.553661 29646 tablet_bootstrap.cc:654] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.560141 29647 tablet_bootstrap.cc:492] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.560755 29647 ts_tablet_manager.cc:1403] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:29:40.560547 29648 tablet_bootstrap.cc:492] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.561540 29648 ts_tablet_manager.cc:1403] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 12:29:40.564083 29647 raft_consensus.cc:359] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.564993 29647 raft_consensus.cc:385] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.564720 29648 raft_consensus.cc:359] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.565407 29647 raft_consensus.cc:740] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.565604 29648 raft_consensus.cc:385] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.566511 29647 consensus_queue.cc:260] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.568718 29647 ts_tablet_manager.cc:1434] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:40.565970 29648 raft_consensus.cc:740] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.569851 29648 consensus_queue.cc:260] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.570922 29647 tablet_bootstrap.cc:492] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:40.572299 29648 ts_tablet_manager.cc:1434] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:29:40.573576 29648 tablet_bootstrap.cc:492] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:40.578269 29647 tablet_bootstrap.cc:654] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.580735 29648 tablet_bootstrap.cc:654] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.583465 29646 tablet_bootstrap.cc:492] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.584156 29646 ts_tablet_manager.cc:1403] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.005s
I20260709 12:29:40.588518 29646 raft_consensus.cc:359] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.589316 29646 raft_consensus.cc:385] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.589600 29646 raft_consensus.cc:740] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.590786 29646 consensus_queue.cc:260] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.602788 29646 ts_tablet_manager.cc:1434] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:29:40.603075 29666 raft_consensus.cc:493] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.604036 29646 tablet_bootstrap.cc:492] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:40.603689 29666 raft_consensus.cc:515] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.604163 29647 tablet_bootstrap.cc:492] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:40.604846 29647 ts_tablet_manager.cc:1403] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.014s
I20260709 12:29:40.606293 29666 leader_election.cc:290] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.606767 29648 tablet_bootstrap.cc:492] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.607106 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3a77d92f74401081ea7c544e0e43c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.607405 29648 ts_tablet_manager.cc:1403] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.017s
I20260709 12:29:40.607921 29647 raft_consensus.cc:359] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.608697 29647 raft_consensus.cc:385] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.608970 29647 raft_consensus.cc:740] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.609480 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3a77d92f74401081ea7c544e0e43c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.609822 29647 consensus_queue.cc:260] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.610796 29531 raft_consensus.cc:2468] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:40.610874 29666 raft_consensus.cc:493] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:40.611079 29419 leader_election.cc:343] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.611029 29648 raft_consensus.cc:359] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.611588 29666 raft_consensus.cc:515] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.612192 29648 raft_consensus.cc:385] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.612643 29648 raft_consensus.cc:740] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.612576 29420 leader_election.cc:304] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:40.614006 29666 leader_election.cc:290] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.613878 29648 consensus_queue.cc:260] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.614522 29654 raft_consensus.cc:2804] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.615028 29654 raft_consensus.cc:493] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.615449 29654 raft_consensus.cc:3060] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.615595 29652 raft_consensus.cc:493] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.616170 29652 raft_consensus.cc:515] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.618430 29646 tablet_bootstrap.cc:654] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.618609 29652 leader_election.cc:290] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.618816 29648 ts_tablet_manager.cc:1434] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:29:40.620074 29648 tablet_bootstrap.cc:492] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:40.620541 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.621390 29456 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:40.622314 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.621398 29647 ts_tablet_manager.cc:1434] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:29:40.623059 29531 raft_consensus.cc:2468] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:40.624516 29496 leader_election.cc:304] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:40.626557 29648 tablet_bootstrap.cc:654] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.627429 29652 raft_consensus.cc:2804] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.627873 29652 raft_consensus.cc:493] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.628109 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.628216 29652 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.631762 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.632754 29605 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:40.634824 29420 leader_election.cc:304] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:40.636060 29666 raft_consensus.cc:2804] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.636443 29666 raft_consensus.cc:493] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.636857 29666 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:40.641542 29419 leader_election.cc:343] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.644860 29654 raft_consensus.cc:515] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.648478 29654 leader_election.cc:290] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Requested vote from peers 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.648744 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3a77d92f74401081ea7c544e0e43c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:40.649547 29531 raft_consensus.cc:3060] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.650122 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3a77d92f74401081ea7c544e0e43c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:40.650847 29606 raft_consensus.cc:3060] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.657130 29666 raft_consensus.cc:515] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.661453 29606 raft_consensus.cc:2468] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:40.662885 29419 leader_election.cc:304] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:40.663247 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:40.663867 29654 raft_consensus.cc:2804] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.663949 29532 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.660233 29646 tablet_bootstrap.cc:492] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:40.668318 29646 ts_tablet_manager.cc:1403] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.013s
I20260709 12:29:40.673293 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:40.673674 29532 raft_consensus.cc:2468] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
W20260709 12:29:40.675109 29419 leader_election.cc:343] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.675880 29420 leader_election.cc:304] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:40.676494 29666 leader_election.cc:290] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.678453 29531 raft_consensus.cc:2468] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:40.679620 29646 raft_consensus.cc:359] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.680620 29646 raft_consensus.cc:385] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.682814 29666 raft_consensus.cc:2804] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.683569 29666 raft_consensus.cc:697] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:40.684746 29666 consensus_queue.cc:237] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.689234 29653 raft_consensus.cc:493] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.689821 29653 raft_consensus.cc:515] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.692049 29695 raft_consensus.cc:493] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.692422 29653 leader_election.cc:290] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.692839 29695 raft_consensus.cc:515] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.694988 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.695909 29456 raft_consensus.cc:2468] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:40.697337 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.697860 29570 leader_election.cc:304] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:40.698521 29455 raft_consensus.cc:2468] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:40.699724 29673 raft_consensus.cc:2804] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.700222 29673 raft_consensus.cc:493] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.700615 29673 raft_consensus.cc:3060] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.700891 29496 leader_election.cc:304] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:40.705451 29653 raft_consensus.cc:493] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.706774 29653 raft_consensus.cc:515] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.708302 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.713881 29532 raft_consensus.cc:2468] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:40.717873 29654 raft_consensus.cc:697] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:40.718954 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.719046 29654 consensus_queue.cc:237] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } }
I20260709 12:29:40.720124 29653 leader_election.cc:290] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.711609 29699 raft_consensus.cc:2804] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.674119 29652 raft_consensus.cc:515] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
W20260709 12:29:40.721082 29420 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.98.66:46129, user_credentials={real_user=slave}} blocked reactor thread for 46030.2us
I20260709 12:29:40.680958 29646 raft_consensus.cc:740] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.722458 29695 leader_election.cc:290] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.722898 29699 raft_consensus.cc:493] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.727423 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:40.727983 29699 raft_consensus.cc:3060] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.723774 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.723368 29648 tablet_bootstrap.cc:492] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:40.728914 29606 raft_consensus.cc:2468] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:40.729722 29648 ts_tablet_manager.cc:1403] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.110s	user 0.035s	sys 0.054s
I20260709 12:29:40.730608 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:40.731230 29605 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.725665 29673 raft_consensus.cc:515] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.728116 29456 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.732668 29648 raft_consensus.cc:359] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.734467 29648 raft_consensus.cc:385] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.734761 29648 raft_consensus.cc:740] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.735456 29648 consensus_queue.cc:260] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.737507 29648 ts_tablet_manager.cc:1434] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:40.737671 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:40.738356 29454 raft_consensus.cc:3060] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.727113 29646 consensus_queue.cc:260] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.720541 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.742969 29646 ts_tablet_manager.cc:1434] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 12:29:40.743745 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:40.744692 29532 raft_consensus.cc:3060] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.745424 29455 raft_consensus.cc:2468] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:40.749246 29570 leader_election.cc:304] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:40.750514 29653 raft_consensus.cc:2804] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.751024 29653 raft_consensus.cc:493] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.751461 29653 raft_consensus.cc:3060] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.754282 29454 raft_consensus.cc:2468] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:40.755578 29570 leader_election.cc:304] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:40.760223 29605 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:40.762095 29495 leader_election.cc:304] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:40.763463 29695 raft_consensus.cc:2804] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.765141 29673 leader_election.cc:290] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.766166 29701 raft_consensus.cc:2804] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.766693 29701 raft_consensus.cc:697] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:40.767412 29701 consensus_queue.cc:237] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.770622 29531 raft_consensus.cc:2468] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:40.764474 29652 leader_election.cc:290] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.773085 29653 raft_consensus.cc:515] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.773613 29532 raft_consensus.cc:2468] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:40.772825 29353 catalog_manager.cc:5697] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.774818 29695 raft_consensus.cc:697] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:40.777993 29653 leader_election.cc:290] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.777771 29695 consensus_queue.cc:237] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.774173 29456 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:40.784592 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:40.786518 29351 catalog_manager.cc:5697] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:40.785593 29456 raft_consensus.cc:3060] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.793522 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:40.799551 29531 raft_consensus.cc:3060] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.805143 29353 catalog_manager.cc:5697] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.807572 29456 raft_consensus.cc:2468] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:40.808827 29570 leader_election.cc:304] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:40.809796 29701 raft_consensus.cc:2804] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.810290 29701 raft_consensus.cc:697] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:40.811132 29701 consensus_queue.cc:237] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.783356 29699 raft_consensus.cc:515] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.816982 29352 catalog_manager.cc:5697] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.818096 29699 leader_election.cc:290] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.818744 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:40.819733 29605 raft_consensus.cc:3060] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.819876 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:40.820623 29456 raft_consensus.cc:3060] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.822526 29531 raft_consensus.cc:2468] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:40.831562 29653 raft_consensus.cc:493] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.832195 29653 raft_consensus.cc:515] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.833662 29456 raft_consensus.cc:2468] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:40.834425 29653 leader_election.cc:290] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.834475 29605 raft_consensus.cc:2468] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:40.835824 29495 leader_election.cc:304] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:40.836333 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.836694 29699 raft_consensus.cc:2804] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.836767 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.837458 29699 raft_consensus.cc:697] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:40.838542 29531 raft_consensus.cc:2393] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c06bd41a19e46a0825725c322fea562 in current term 1: Already voted for candidate 65c489f88c374b6a851e01d97b006d1e in this term.
I20260709 12:29:40.839092 29666 raft_consensus.cc:493] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.839658 29570 leader_election.cc:304] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c06bd41a19e46a0825725c322fea562; no voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:40.839852 29666 raft_consensus.cc:515] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.839146 29699 consensus_queue.cc:237] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.840600 29653 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.842130 29666 leader_election.cc:290] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.843468 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d47efb8f2e47e1ade6aafd433753bb" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:40.843920 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d47efb8f2e47e1ade6aafd433753bb" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.844424 29605 raft_consensus.cc:2468] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:40.844627 29531 raft_consensus.cc:2468] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:40.846011 29420 leader_election.cc:304] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:40.847381 29666 raft_consensus.cc:2804] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.847755 29666 raft_consensus.cc:493] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.848097 29666 raft_consensus.cc:3060] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.849493 29653 raft_consensus.cc:2749] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.838299 29353 catalog_manager.cc:5697] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:40.854862 29666 raft_consensus.cc:515] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.858143 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d47efb8f2e47e1ade6aafd433753bb" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:40.858376 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d47efb8f2e47e1ade6aafd433753bb" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:40.858865 29531 raft_consensus.cc:3060] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.859259 29605 raft_consensus.cc:3060] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.861328 29666 leader_election.cc:290] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:40.860097 29352 catalog_manager.cc:5697] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.866926 29531 raft_consensus.cc:2468] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:40.866926 29605 raft_consensus.cc:2468] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:40.868446 29420 leader_election.cc:304] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:40.869256 29666 raft_consensus.cc:2804] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.869812 29666 raft_consensus.cc:697] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:40.870699 29666 consensus_queue.cc:237] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.878253 29352 catalog_manager.cc:5697] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.909744 29653 consensus_queue.cc:1048] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.921548 29456 raft_consensus.cc:3060] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.930267 29701 raft_consensus.cc:493] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.930646 29673 consensus_queue.cc:1048] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.930810 29701 raft_consensus.cc:515] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:40.932849 29701 leader_election.cc:290] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:40.933598 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b45c92c0394f65b0d53dc52ce677a2" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:40.934136 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b45c92c0394f65b0d53dc52ce677a2" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:40.935037 29531 raft_consensus.cc:2393] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c06bd41a19e46a0825725c322fea562 in current term 1: Already voted for candidate 65c489f88c374b6a851e01d97b006d1e in this term.
I20260709 12:29:40.936426 29570 leader_election.cc:304] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c06bd41a19e46a0825725c322fea562; no voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:40.937255 29701 raft_consensus.cc:3060] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.943439 29666 consensus_queue.cc:1048] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:40.945245 29701 raft_consensus.cc:2749] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.955816 29666 consensus_queue.cc:1048] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.001869 29531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe"
dest_uuid: "61694e986200461884bab12f4b16a183"
mode: GRACEFUL
new_leader_uuid: "65c489f88c374b6a851e01d97b006d1e"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:29:41.002444 29531 raft_consensus.cc:606] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Received request to transfer leadership to TS 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:41.023165 29605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
mode: GRACEFUL
new_leader_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:51014
I20260709 12:29:41.023873 29605 raft_consensus.cc:606] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Received request to transfer leadership to TS 61694e986200461884bab12f4b16a183
I20260709 12:29:41.029629 29605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
mode: GRACEFUL
new_leader_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:51014
I20260709 12:29:41.030220 29605 raft_consensus.cc:606] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Received request to transfer leadership to TS 61694e986200461884bab12f4b16a183
I20260709 12:29:41.035396 29605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b91b8958ba947639f85be23ced183af"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
mode: GRACEFUL
new_leader_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:51014
I20260709 12:29:41.035923 29605 raft_consensus.cc:606] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Received request to transfer leadership to TS 61694e986200461884bab12f4b16a183
I20260709 12:29:41.049532 29456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "086aa64888bc4f05b353712f483dee45"
dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
mode: GRACEFUL
new_leader_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:51714
I20260709 12:29:41.050108 29456 raft_consensus.cc:606] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Received request to transfer leadership to TS 61694e986200461884bab12f4b16a183
I20260709 12:29:41.055948 29531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0"
dest_uuid: "61694e986200461884bab12f4b16a183"
mode: GRACEFUL
new_leader_uuid: "8c06bd41a19e46a0825725c322fea562"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:29:41.056437 29531 raft_consensus.cc:606] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Received request to transfer leadership to TS 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:41.070433 29666 consensus_queue.cc:1048] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.077021 29697 raft_consensus.cc:993] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e: : Instructing follower 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.077564 29697 raft_consensus.cc:1081] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Signalling peer 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.079636 29532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "086aa64888bc4f05b353712f483dee45"
dest_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:40054
I20260709 12:29:41.080282 29532 raft_consensus.cc:493] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:41.080639 29532 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.083907 29696 consensus_queue.cc:1048] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.088454 29532 raft_consensus.cc:515] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.089694 29531 raft_consensus.cc:1240] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Rejecting Update request from peer 65c489f88c374b6a851e01d97b006d1e for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:41.091351 29532 leader_election.cc:290] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:41.091769 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:41.092500 29456 raft_consensus.cc:3055] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:41.092411 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:41.093933 29696 consensus_queue.cc:1059] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.093022 29456 raft_consensus.cc:740] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:41.095485 29456 consensus_queue.cc:260] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.097002 29456 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.104714 29456 raft_consensus.cc:2468] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
W20260709 12:29:41.105212 29696 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:29:41.105790 29496 leader_election.cc:304] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:41.106667 29699 raft_consensus.cc:2804] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:41.107199 29699 raft_consensus.cc:697] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:41.108016 29699 consensus_queue.cc:237] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.114225 29353 catalog_manager.cc:5697] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 1 to 2, leader changed from 65c489f88c374b6a851e01d97b006d1e (127.20.98.65) to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.144708 29696 consensus_queue.cc:1048] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.155579 29666 consensus_queue.cc:1048] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.171640 29701 consensus_queue.cc:1048] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.178488 29673 raft_consensus.cc:993] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562: : Instructing follower 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.179003 29673 raft_consensus.cc:1081] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Signalling peer 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.181814 29532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0"
dest_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:40050
I20260709 12:29:41.183389 29532 raft_consensus.cc:493] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:41.183825 29532 raft_consensus.cc:3060] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.187471 29701 consensus_queue.cc:1048] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.194550 29532 raft_consensus.cc:515] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.198948 29532 leader_election.cc:290] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:41.199518 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:41.200287 29605 raft_consensus.cc:3055] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:41.199616 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752a1f2d9f604ee5b944fe7fb1914ec0" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:41.200765 29605 raft_consensus.cc:740] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:41.200984 29456 raft_consensus.cc:3060] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.201802 29605 consensus_queue.cc:260] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.203222 29605 raft_consensus.cc:3060] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.209230 29456 raft_consensus.cc:2468] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:41.210655 29496 leader_election.cc:304] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:41.211154 29605 raft_consensus.cc:2468] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:41.211702 29699 raft_consensus.cc:2804] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:41.212303 29699 raft_consensus.cc:697] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:41.213296 29699 consensus_queue.cc:237] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.220719 29353 catalog_manager.cc:5697] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 1 to 2, leader changed from 8c06bd41a19e46a0825725c322fea562 (127.20.98.67) to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.251803 29699 consensus_queue.cc:1048] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.263729 29702 consensus_queue.cc:1048] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.271672 29699 raft_consensus.cc:993] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183: : Instructing follower 8c06bd41a19e46a0825725c322fea562 to start an election
I20260709 12:29:41.272202 29702 raft_consensus.cc:1081] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Signalling peer 8c06bd41a19e46a0825725c322fea562 to start an election
I20260709 12:29:41.273852 29605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
 from {username='slave'} at 127.0.0.1:50996
I20260709 12:29:41.274394 29605 raft_consensus.cc:493] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:41.274757 29605 raft_consensus.cc:3060] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.280762 29605 raft_consensus.cc:515] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.283133 29605 leader_election.cc:290] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:41.283826 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:41.284304 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99dc477137b94a329c8a38c514a793b0" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:41.284535 29456 raft_consensus.cc:3060] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.284981 29532 raft_consensus.cc:3055] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:41.285363 29532 raft_consensus.cc:740] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:41.286379 29532 consensus_queue.cc:260] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.287737 29532 raft_consensus.cc:3060] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.292726 29456 raft_consensus.cc:2468] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 2.
I20260709 12:29:41.294065 29570 leader_election.cc:304] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:41.294931 29701 raft_consensus.cc:2804] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:41.295367 29673 consensus_queue.cc:1048] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.295447 29701 raft_consensus.cc:697] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 2 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:41.295358 29532 raft_consensus.cc:2468] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 2.
I20260709 12:29:41.296720 29701 consensus_queue.cc:237] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.303328 29673 raft_consensus.cc:993] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562: : Instructing follower 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.303916 29653 raft_consensus.cc:1081] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Signalling peer 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.306545 29531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8"
dest_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:40050
I20260709 12:29:41.307153 29531 raft_consensus.cc:493] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:41.307549 29531 raft_consensus.cc:3060] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.309679 29653 consensus_queue.cc:1048] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.309283 29352 catalog_manager.cc:5697] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 1 to 2, leader changed from 61694e986200461884bab12f4b16a183 (127.20.98.66) to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 2 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:41.314805 29531 raft_consensus.cc:515] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.319690 29531 leader_election.cc:290] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:41.319942 29532 raft_consensus.cc:1240] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Rejecting Update request from peer 8c06bd41a19e46a0825725c322fea562 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:41.320813 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:41.321542 29605 raft_consensus.cc:3055] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:41.321868 29605 raft_consensus.cc:740] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:41.322353 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d0982e7ba24a49b9ed68109b4472f8" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:41.323050 29456 raft_consensus.cc:3060] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.322921 29605 consensus_queue.cc:260] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.324318 29605 raft_consensus.cc:3060] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:41.324132 29653 consensus_queue.cc:1175] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "61694e986200461884bab12f4b16a183" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c06bd41a19e46a0825725c322fea562 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:29:41.331211 29456 raft_consensus.cc:2468] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:41.332098 29605 raft_consensus.cc:2468] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:41.332533 29496 leader_election.cc:304] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:41.333504 29702 raft_consensus.cc:2804] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:41.333976 29702 raft_consensus.cc:697] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:41.334829 29702 consensus_queue.cc:237] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.341914 29353 catalog_manager.cc:5697] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 1 to 2, leader changed from 8c06bd41a19e46a0825725c322fea562 (127.20.98.67) to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.344058 29702 consensus_queue.cc:1048] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.352084 29699 raft_consensus.cc:993] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183: : Instructing follower 65c489f88c374b6a851e01d97b006d1e to start an election
I20260709 12:29:41.352692 29652 raft_consensus.cc:1081] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Signalling peer 65c489f88c374b6a851e01d97b006d1e to start an election
I20260709 12:29:41.354738 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe"
dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
 from {username='slave'} at 127.0.0.1:51712
I20260709 12:29:41.356142 29454 raft_consensus.cc:493] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:41.356576 29454 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.360700 29702 consensus_queue.cc:1048] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.363806 29454 raft_consensus.cc:515] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.367213 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:41.367851 29532 raft_consensus.cc:3055] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:41.368183 29532 raft_consensus.cc:740] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:41.369026 29532 consensus_queue.cc:260] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.370014 29532 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.372366 29454 leader_election.cc:290] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 2 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:41.373615 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:41.374361 29605 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.379033 29654 consensus_queue.cc:1048] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.380594 29532 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 2.
I20260709 12:29:41.381768 29420 leader_election.cc:304] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:41.382676 29654 raft_consensus.cc:2804] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:41.383169 29654 raft_consensus.cc:697] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:41.383993 29654 consensus_queue.cc:237] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.384533 29605 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 2.
I20260709 12:29:41.398878 29697 consensus_queue.cc:1048] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.399560 29352 catalog_manager.cc:5697] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 1 to 2, leader changed from 61694e986200461884bab12f4b16a183 (127.20.98.66) to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.475520 29673 raft_consensus.cc:993] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562: : Instructing follower 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.476135 29701 raft_consensus.cc:1081] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Signalling peer 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:41.478189 29532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b91b8958ba947639f85be23ced183af"
dest_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:40050
I20260709 12:29:41.478735 29532 raft_consensus.cc:493] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:41.479092 29532 raft_consensus.cc:3060] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.488040 29532 raft_consensus.cc:515] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.490307 29532 leader_election.cc:290] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:41.491307 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b91b8958ba947639f85be23ced183af" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:41.492210 29454 raft_consensus.cc:3060] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.498260 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b91b8958ba947639f85be23ced183af" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:41.499022 29605 raft_consensus.cc:3055] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:41.499420 29605 raft_consensus.cc:740] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:41.500303 29605 consensus_queue.cc:260] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.501402 29605 raft_consensus.cc:3060] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.501273 29454 raft_consensus.cc:2468] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:41.502769 29496 leader_election.cc:304] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:41.503510 29702 raft_consensus.cc:2804] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:41.504051 29702 raft_consensus.cc:697] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:41.504904 29702 consensus_queue.cc:237] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:41.509156 29605 raft_consensus.cc:2468] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:41.512972 29353 catalog_manager.cc:5697] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 1 to 2, leader changed from 8c06bd41a19e46a0825725c322fea562 (127.20.98.67) to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.561124 29605 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:41.567905 29605 raft_consensus.cc:1275] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.569489 29702 consensus_queue.cc:1048] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.578342 29454 raft_consensus.cc:1275] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.580166 29699 consensus_queue.cc:1048] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.615345 29605 raft_consensus.cc:1275] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.616691 29699 consensus_queue.cc:1048] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.624231 29454 raft_consensus.cc:1275] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.626820 29702 consensus_queue.cc:1048] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.736593 29532 raft_consensus.cc:1275] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Refusing update from remote peer 8c06bd41a19e46a0825725c322fea562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.738000 29701 consensus_queue.cc:1048] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.745712 29454 raft_consensus.cc:1275] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 8c06bd41a19e46a0825725c322fea562: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.747464 29673 consensus_queue.cc:1048] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.833019 29454 raft_consensus.cc:1275] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.834369 29702 consensus_queue.cc:1048] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.845504 29605 raft_consensus.cc:1275] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.846989 29699 consensus_queue.cc:1048] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.921821 29605 raft_consensus.cc:1275] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.923207 29699 consensus_queue.cc:1048] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.931955 29454 raft_consensus.cc:1275] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.933502 29695 consensus_queue.cc:1048] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.940760 29605 raft_consensus.cc:1275] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 65c489f88c374b6a851e01d97b006d1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.942749 29696 consensus_queue.cc:1048] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:41.950934 29532 raft_consensus.cc:1275] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Refusing update from remote peer 65c489f88c374b6a851e01d97b006d1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:41.952224 29666 consensus_queue.cc:1048] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.110733 29351 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34338:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:44.116629 29351 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:44.179780 29441 tablet_service.cc:1511] Processing CreateTablet for tablet ab0fc6e7cc0a492c82f5a51e97370f19 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:44.180981 29522 tablet_service.cc:1511] Processing CreateTablet for tablet ab0fc6e7cc0a492c82f5a51e97370f19 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:44.181938 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab0fc6e7cc0a492c82f5a51e97370f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.183059 29522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab0fc6e7cc0a492c82f5a51e97370f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.183643 29589 tablet_service.cc:1511] Processing CreateTablet for tablet ab0fc6e7cc0a492c82f5a51e97370f19 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:44.185498 29589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab0fc6e7cc0a492c82f5a51e97370f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.188783 29514 tablet_service.cc:1511] Processing CreateTablet for tablet c5eea53c781c47c6bc9b73bb9e36bff9 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:44.190636 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5eea53c781c47c6bc9b73bb9e36bff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.193522 29591 tablet_service.cc:1511] Processing CreateTablet for tablet c5eea53c781c47c6bc9b73bb9e36bff9 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:44.195348 29591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5eea53c781c47c6bc9b73bb9e36bff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.200111 29516 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba9c8447a5c486495d4685938e0b1e5 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:44.203991 29439 tablet_service.cc:1511] Processing CreateTablet for tablet c5eea53c781c47c6bc9b73bb9e36bff9 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:44.205802 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5eea53c781c47c6bc9b73bb9e36bff9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.210189 29516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba9c8447a5c486495d4685938e0b1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.212332 29596 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba9c8447a5c486495d4685938e0b1e5 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:44.214510 29596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba9c8447a5c486495d4685938e0b1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.215065 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba9c8447a5c486495d4685938e0b1e5 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:44.217638 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba9c8447a5c486495d4685938e0b1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.227524 29443 tablet_service.cc:1511] Processing CreateTablet for tablet 39503e9f22fc459f8d7d322bb8b425c8 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:44.229344 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39503e9f22fc459f8d7d322bb8b425c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.237313 29517 tablet_service.cc:1511] Processing CreateTablet for tablet 39503e9f22fc459f8d7d322bb8b425c8 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:44.239020 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39503e9f22fc459f8d7d322bb8b425c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.243127 29592 tablet_service.cc:1511] Processing CreateTablet for tablet 39503e9f22fc459f8d7d322bb8b425c8 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:44.245499 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39503e9f22fc459f8d7d322bb8b425c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.273542 29442 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8e5a94fb8e452b97889920197bfede (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:44.275293 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8e5a94fb8e452b97889920197bfede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.278966 29519 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8e5a94fb8e452b97889920197bfede (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:44.281097 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8e5a94fb8e452b97889920197bfede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.296139 29594 tablet_service.cc:1511] Processing CreateTablet for tablet 4c8e5a94fb8e452b97889920197bfede (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:44.297932 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c8e5a94fb8e452b97889920197bfede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.299479 29443 tablet_service.cc:1511] Processing CreateTablet for tablet e73431653a274b19bda89efe245b1400 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:44.301445 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73431653a274b19bda89efe245b1400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.314786 29749 tablet_bootstrap.cc:492] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:44.337018 29749 tablet_bootstrap.cc:654] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.337473 29522 tablet_service.cc:1511] Processing CreateTablet for tablet e73431653a274b19bda89efe245b1400 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:44.339062 29522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73431653a274b19bda89efe245b1400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.338871 29591 tablet_service.cc:1511] Processing CreateTablet for tablet e73431653a274b19bda89efe245b1400 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:44.338057 29748 tablet_bootstrap.cc:492] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:44.342502 29591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73431653a274b19bda89efe245b1400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.342599 29750 tablet_bootstrap.cc:492] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.351778 29520 tablet_service.cc:1511] Processing CreateTablet for tablet c539ae1dc9c24e1fb7cf2a658e73dd00 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:44.349406 29442 tablet_service.cc:1511] Processing CreateTablet for tablet c539ae1dc9c24e1fb7cf2a658e73dd00 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:44.364528 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c539ae1dc9c24e1fb7cf2a658e73dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.363090 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c539ae1dc9c24e1fb7cf2a658e73dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.352689 29595 tablet_service.cc:1511] Processing CreateTablet for tablet c539ae1dc9c24e1fb7cf2a658e73dd00 (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:44.370978 29595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c539ae1dc9c24e1fb7cf2a658e73dd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.388468 29521 tablet_service.cc:1511] Processing CreateTablet for tablet e97c5e38c2fa4990ab955ca37622201b (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:44.390496 29521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97c5e38c2fa4990ab955ca37622201b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.391669 29439 tablet_service.cc:1511] Processing CreateTablet for tablet e97c5e38c2fa4990ab955ca37622201b (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:44.392843 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97c5e38c2fa4990ab955ca37622201b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.397404 29750 tablet_bootstrap.cc:654] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.398376 29441 tablet_service.cc:1511] Processing CreateTablet for tablet 824fb1fc0f524540b3023f4fe7fef8ef (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:44.398815 29592 tablet_service.cc:1511] Processing CreateTablet for tablet e97c5e38c2fa4990ab955ca37622201b (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:44.400868 29592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97c5e38c2fa4990ab955ca37622201b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.363034 29748 tablet_bootstrap.cc:654] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.405684 29594 tablet_service.cc:1511] Processing CreateTablet for tablet 824fb1fc0f524540b3023f4fe7fef8ef (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:44.410665 29749 tablet_bootstrap.cc:492] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:44.411240 29749 ts_tablet_manager.cc:1403] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.006s
I20260709 12:29:44.412985 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824fb1fc0f524540b3023f4fe7fef8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.415195 29749 raft_consensus.cc:359] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.416301 29749 raft_consensus.cc:385] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.416646 29749 raft_consensus.cc:740] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.417606 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824fb1fc0f524540b3023f4fe7fef8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.406333 29514 tablet_service.cc:1511] Processing CreateTablet for tablet 824fb1fc0f524540b3023f4fe7fef8ef (DEFAULT_TABLE table=soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:44.421836 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824fb1fc0f524540b3023f4fe7fef8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:44.446179 29749 consensus_queue.cc:260] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.449302 29749 ts_tablet_manager.cc:1434] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 12:29:44.450440 29749 tablet_bootstrap.cc:492] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
W20260709 12:29:44.451308 29402 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:44.484174 29750 tablet_bootstrap.cc:492] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.484220 29748 tablet_bootstrap.cc:492] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:44.485122 29748 ts_tablet_manager.cc:1403] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.147s	user 0.024s	sys 0.017s
I20260709 12:29:44.485131 29750 ts_tablet_manager.cc:1403] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.011s
I20260709 12:29:44.488271 29748 raft_consensus.cc:359] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.488847 29748 raft_consensus.cc:385] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.489054 29748 raft_consensus.cc:740] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.489764 29748 consensus_queue.cc:260] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.492264 29748 ts_tablet_manager.cc:1434] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:29:44.493494 29748 tablet_bootstrap.cc:492] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:44.493578 29749 tablet_bootstrap.cc:654] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.491807 29750 raft_consensus.cc:359] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.495326 29750 raft_consensus.cc:385] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.495714 29750 raft_consensus.cc:740] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.496877 29750 consensus_queue.cc:260] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.501818 29748 tablet_bootstrap.cc:654] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.505818 29750 ts_tablet_manager.cc:1434] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:29:44.507064 29750 tablet_bootstrap.cc:492] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.507164 29749 tablet_bootstrap.cc:492] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:44.508067 29749 ts_tablet_manager.cc:1403] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.008s
I20260709 12:29:44.511916 29749 raft_consensus.cc:359] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.513031 29749 raft_consensus.cc:385] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.513581 29749 raft_consensus.cc:740] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.514771 29749 consensus_queue.cc:260] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.516639 29750 tablet_bootstrap.cc:654] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.517922 29749 ts_tablet_manager.cc:1434] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:29:44.519794 29749 tablet_bootstrap.cc:492] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:44.536633 29749 tablet_bootstrap.cc:654] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.541102 29750 tablet_bootstrap.cc:492] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.542001 29750 ts_tablet_manager.cc:1403] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.007s
I20260709 12:29:44.546556 29750 raft_consensus.cc:359] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.547849 29750 raft_consensus.cc:385] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.548341 29750 raft_consensus.cc:740] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.549798 29750 consensus_queue.cc:260] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.553237 29750 ts_tablet_manager.cc:1434] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:29:44.555275 29750 tablet_bootstrap.cc:492] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.565654 29750 tablet_bootstrap.cc:654] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.580222 29750 tablet_bootstrap.cc:492] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.580757 29750 ts_tablet_manager.cc:1403] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 12:29:44.582031 29748 tablet_bootstrap.cc:492] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:44.582741 29748 ts_tablet_manager.cc:1403] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.089s	user 0.036s	sys 0.044s
I20260709 12:29:44.584041 29749 tablet_bootstrap.cc:492] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:44.584662 29749 ts_tablet_manager.cc:1403] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.019s
I20260709 12:29:44.584214 29750 raft_consensus.cc:359] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.585100 29750 raft_consensus.cc:385] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.585429 29750 raft_consensus.cc:740] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.587767 29750 consensus_queue.cc:260] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.588713 29748 raft_consensus.cc:359] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.589205 29749 raft_consensus.cc:359] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.589663 29748 raft_consensus.cc:385] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.590299 29750 ts_tablet_manager.cc:1434] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:29:44.590106 29748 raft_consensus.cc:740] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.591656 29750 tablet_bootstrap.cc:492] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.592185 29748 consensus_queue.cc:260] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.594923 29748 ts_tablet_manager.cc:1434] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:29:44.596211 29748 tablet_bootstrap.cc:492] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:44.589982 29749 raft_consensus.cc:385] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.607002 29749 raft_consensus.cc:740] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.608042 29695 raft_consensus.cc:493] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.608577 29750 tablet_bootstrap.cc:654] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.608950 29748 tablet_bootstrap.cc:654] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.608707 29695 raft_consensus.cc:515] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.608106 29749 consensus_queue.cc:260] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.612578 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
W20260709 12:29:44.615352 29496 leader_election.cc:343] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.618374 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:44.619134 29606 raft_consensus.cc:2468] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:44.620903 29495 leader_election.cc:304] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:44.621152 29748 tablet_bootstrap.cc:492] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:44.621961 29748 ts_tablet_manager.cc:1403] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 12:29:44.622385 29695 leader_election.cc:290] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.625495 29695 raft_consensus.cc:2804] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.625424 29748 raft_consensus.cc:359] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.626094 29695 raft_consensus.cc:493] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.626480 29748 raft_consensus.cc:385] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.626590 29695 raft_consensus.cc:3060] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.626842 29748 raft_consensus.cc:740] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.627758 29748 consensus_queue.cc:260] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.630017 29666 raft_consensus.cc:493] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.630861 29748 ts_tablet_manager.cc:1434] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:29:44.630589 29666 raft_consensus.cc:515] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.632138 29748 tablet_bootstrap.cc:492] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:44.638222 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39503e9f22fc459f8d7d322bb8b425c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:44.639009 29532 raft_consensus.cc:2468] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:44.640889 29420 leader_election.cc:304] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:44.641194 29749 ts_tablet_manager.cc:1434] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.056s	user 0.012s	sys 0.008s
I20260709 12:29:44.641258 29748 tablet_bootstrap.cc:654] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.642550 29749 tablet_bootstrap.cc:492] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:44.648061 29748 tablet_bootstrap.cc:492] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:44.648679 29748 ts_tablet_manager.cc:1403] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 12:29:44.650306 29749 tablet_bootstrap.cc:654] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.652758 29750 tablet_bootstrap.cc:492] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.654577 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39503e9f22fc459f8d7d322bb8b425c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:44.655130 29750 ts_tablet_manager.cc:1403] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.001s
I20260709 12:29:44.655660 29606 raft_consensus.cc:2468] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:44.652426 29748 raft_consensus.cc:359] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.658603 29748 raft_consensus.cc:385] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.658915 29748 raft_consensus.cc:740] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.659734 29748 consensus_queue.cc:260] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.660064 29750 raft_consensus.cc:359] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.661363 29750 raft_consensus.cc:385] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.661832 29750 raft_consensus.cc:740] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.662950 29750 consensus_queue.cc:260] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.666653 29750 ts_tablet_manager.cc:1434] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:29:44.668272 29750 tablet_bootstrap.cc:492] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.672221 29766 raft_consensus.cc:2804] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.672855 29766 raft_consensus.cc:493] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.677038 29666 leader_election.cc:290] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.678687 29750 tablet_bootstrap.cc:654] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.685322 29666 raft_consensus.cc:493] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.685891 29666 raft_consensus.cc:515] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.686728 29766 raft_consensus.cc:3060] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.688129 29764 raft_consensus.cc:493] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.693182 29764 raft_consensus.cc:515] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.679211 29695 raft_consensus.cc:515] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.700273 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
W20260709 12:29:44.701689 29496 leader_election.cc:343] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.705255 29750 tablet_bootstrap.cc:492] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.705674 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0fc6e7cc0a492c82f5a51e97370f19" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:44.706466 29532 raft_consensus.cc:2468] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:44.706511 29695 leader_election.cc:290] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.705269 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73431653a274b19bda89efe245b1400" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:44.707921 29420 leader_election.cc:304] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:44.705952 29750 ts_tablet_manager.cc:1403] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.005s
I20260709 12:29:44.709023 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:44.709780 29605 raft_consensus.cc:3060] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.705355 29606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73431653a274b19bda89efe245b1400" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
W20260709 12:29:44.709858 29420 leader_election.cc:343] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61694e986200461884bab12f4b16a183 (127.20.98.66:46129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.707026 29764 leader_election.cc:290] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.711225 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0fc6e7cc0a492c82f5a51e97370f19" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
W20260709 12:29:44.711467 29419 leader_election.cc:343] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.717250 29419 leader_election.cc:304] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e; no voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:44.712095 29666 leader_election.cc:290] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.713646 29750 raft_consensus.cc:359] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.714808 29768 raft_consensus.cc:2804] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.718209 29767 raft_consensus.cc:2749] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:44.718518 29768 raft_consensus.cc:493] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.718957 29768 raft_consensus.cc:3060] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.719480 29605 raft_consensus.cc:2468] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:44.720887 29748 ts_tablet_manager.cc:1434] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.010s
I20260709 12:29:44.721221 29495 leader_election.cc:304] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:44.722118 29748 tablet_bootstrap.cc:492] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:44.722966 29749 tablet_bootstrap.cc:492] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:44.723549 29749 ts_tablet_manager.cc:1403] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.081s	user 0.030s	sys 0.035s
I20260709 12:29:44.725116 29695 raft_consensus.cc:2804] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:44.725733 29695 raft_consensus.cc:697] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:44.725780 29750 raft_consensus.cc:385] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.726323 29750 raft_consensus.cc:740] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.726789 29695 consensus_queue.cc:237] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.727164 29750 consensus_queue.cc:260] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.728240 29604 raft_consensus.cc:2468] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 0.
I20260709 12:29:44.728024 29768 raft_consensus.cc:515] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.730074 29750 ts_tablet_manager.cc:1434] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:29:44.731338 29750 tablet_bootstrap.cc:492] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.732875 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0fc6e7cc0a492c82f5a51e97370f19" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:44.733628 29605 raft_consensus.cc:3060] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.734292 29766 raft_consensus.cc:515] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.735971 29673 raft_consensus.cc:493] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.736495 29673 raft_consensus.cc:515] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.737999 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39503e9f22fc459f8d7d322bb8b425c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:44.738691 29604 raft_consensus.cc:3060] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.738829 29750 tablet_bootstrap.cc:654] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.740118 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
W20260709 12:29:44.743330 29570 leader_election.cc:343] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.743083 29749 raft_consensus.cc:359] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.746157 29673 leader_election.cc:290] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:44.746296 29749 raft_consensus.cc:385] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.747493 29749 raft_consensus.cc:740] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.747987 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:44.749148 29749 consensus_queue.cc:260] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
W20260709 12:29:44.749689 29570 leader_election.cc:343] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61694e986200461884bab12f4b16a183 (127.20.98.66:46129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.751199 29570 leader_election.cc:304] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c06bd41a19e46a0825725c322fea562; no voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:44.751899 29748 tablet_bootstrap.cc:654] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.752702 29673 raft_consensus.cc:2749] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:44.754469 29749 ts_tablet_manager.cc:1434] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.009s
I20260709 12:29:44.754801 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0fc6e7cc0a492c82f5a51e97370f19" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:44.756300 29531 raft_consensus.cc:3060] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.756820 29750 tablet_bootstrap.cc:492] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.757283 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39503e9f22fc459f8d7d322bb8b425c8" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:44.757546 29750 ts_tablet_manager.cc:1403] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.003s
I20260709 12:29:44.757959 29532 raft_consensus.cc:3060] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.758948 29604 raft_consensus.cc:2468] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:44.760334 29419 leader_election.cc:304] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:44.761301 29764 raft_consensus.cc:2804] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:44.761057 29750 raft_consensus.cc:359] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.761848 29764 raft_consensus.cc:697] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:44.756774 29766 leader_election.cc:290] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.761891 29750 raft_consensus.cc:385] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.762814 29750 raft_consensus.cc:740] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.762840 29764 consensus_queue.cc:237] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.763839 29750 consensus_queue.cc:260] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.766688 29750 ts_tablet_manager.cc:1434] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:44.767881 29750 tablet_bootstrap.cc:492] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.772426 29531 raft_consensus.cc:2468] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:44.774479 29420 leader_election.cc:304] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:44.774868 29749 tablet_bootstrap.cc:492] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:44.776856 29750 tablet_bootstrap.cc:654] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.777894 29760 raft_consensus.cc:493] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.778450 29760 raft_consensus.cc:515] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.775388 29766 raft_consensus.cc:2804] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:44.782405 29748 tablet_bootstrap.cc:492] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:44.784363 29760 leader_election.cc:290] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.785265 29766 raft_consensus.cc:697] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:44.782629 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73431653a274b19bda89efe245b1400" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:44.786289 29604 raft_consensus.cc:2468] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:44.786608 29766 consensus_queue.cc:237] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.788403 29495 leader_election.cc:304] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:44.789589 29748 ts_tablet_manager.cc:1403] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.068s	user 0.004s	sys 0.014s
I20260709 12:29:44.789968 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73431653a274b19bda89efe245b1400" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:44.790942 29454 raft_consensus.cc:2468] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:44.794231 29760 raft_consensus.cc:2804] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.795239 29760 raft_consensus.cc:493] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.796058 29760 raft_consensus.cc:3060] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.797428 29768 leader_election.cc:290] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 1 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.778430 29532 raft_consensus.cc:2468] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:44.803906 29605 raft_consensus.cc:2468] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 1.
I20260709 12:29:44.811097 29750 tablet_bootstrap.cc:492] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.811985 29750 ts_tablet_manager.cc:1403] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.001s
I20260709 12:29:44.816530 29750 raft_consensus.cc:359] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.817584 29750 raft_consensus.cc:385] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.817972 29750 raft_consensus.cc:740] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.819061 29750 consensus_queue.cc:260] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.822580 29750 ts_tablet_manager.cc:1434] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.002s
I20260709 12:29:44.824154 29750 tablet_bootstrap.cc:492] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.827668 29749 tablet_bootstrap.cc:654] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.833675 29750 tablet_bootstrap.cc:654] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.836290 29673 raft_consensus.cc:493] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.842662 29673 raft_consensus.cc:515] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.848501 29748 raft_consensus.cc:359] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.838176 29760 raft_consensus.cc:515] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.850507 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:44.850627 29673 leader_election.cc:290] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:44.851256 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
W20260709 12:29:44.852981 29570 leader_election.cc:343] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61694e986200461884bab12f4b16a183 (127.20.98.66:46129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.855067 29354 catalog_manager.cc:5697] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:44.851296 29454 raft_consensus.cc:2468] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:44.862519 29570 leader_election.cc:304] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 61694e986200461884bab12f4b16a183
I20260709 12:29:44.865010 29673 raft_consensus.cc:2804] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.865581 29673 raft_consensus.cc:493] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.865933 29673 raft_consensus.cc:3060] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.869360 29749 tablet_bootstrap.cc:492] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:44.870241 29749 ts_tablet_manager.cc:1403] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.009s
I20260709 12:29:44.877933 29749 raft_consensus.cc:359] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.878801 29749 raft_consensus.cc:385] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.879160 29749 raft_consensus.cc:740] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.879930 29749 consensus_queue.cc:260] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.884274 29749 ts_tablet_manager.cc:1434] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:29:44.885411 29749 tablet_bootstrap.cc:492] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:44.849377 29748 raft_consensus.cc:385] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.892385 29748 raft_consensus.cc:740] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.893225 29748 consensus_queue.cc:260] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.900250 29748 ts_tablet_manager.cc:1434] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 12:29:44.901400 29748 tablet_bootstrap.cc:492] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:44.898856 29673 raft_consensus.cc:515] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.910274 29673 leader_election.cc:290] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:44.911736 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:44.912523 29532 raft_consensus.cc:3060] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.912351 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:44.913146 29748 tablet_bootstrap.cc:654] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.913230 29454 raft_consensus.cc:3060] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.910894 29353 catalog_manager.cc:5697] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 1 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:44.922706 29750 tablet_bootstrap.cc:492] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.923218 29750 ts_tablet_manager.cc:1403] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.099s	user 0.037s	sys 0.028s
I20260709 12:29:44.921149 29532 raft_consensus.cc:2468] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:44.927671 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73431653a274b19bda89efe245b1400" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:44.928399 29456 raft_consensus.cc:3060] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.928632 29570 leader_election.cc:304] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:44.934362 29673 raft_consensus.cc:2804] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:44.935014 29673 raft_consensus.cc:697] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:44.936120 29749 tablet_bootstrap.cc:654] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.935911 29673 consensus_queue.cc:237] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.936836 29750 raft_consensus.cc:359] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.940002 29750 raft_consensus.cc:385] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.940281 29750 raft_consensus.cc:740] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.941043 29750 consensus_queue.cc:260] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.943341 29750 ts_tablet_manager.cc:1434] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:29:44.944289 29750 tablet_bootstrap.cc:492] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: Bootstrap starting.
I20260709 12:29:44.946295 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73431653a274b19bda89efe245b1400" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:44.946949 29605 raft_consensus.cc:3060] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.947430 29352 catalog_manager.cc:5697] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:44.950860 29750 tablet_bootstrap.cc:654] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.955746 29605 raft_consensus.cc:2468] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:44.962925 29495 leader_election.cc:304] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:44.963812 29695 raft_consensus.cc:2804] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:44.964395 29695 raft_consensus.cc:697] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:44.956563 29760 leader_election.cc:290] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:44.965091 29695 consensus_queue.cc:237] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.970890 29749 tablet_bootstrap.cc:492] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:44.971695 29749 ts_tablet_manager.cc:1403] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.087s	user 0.004s	sys 0.010s
I20260709 12:29:44.958540 29454 raft_consensus.cc:2468] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:44.963903 29750 tablet_bootstrap.cc:492] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: No bootstrap required, opened a new log
I20260709 12:29:44.973325 29750 ts_tablet_manager.cc:1403] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 12:29:44.975977 29749 raft_consensus.cc:359] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.976341 29750 raft_consensus.cc:359] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.977267 29750 raft_consensus.cc:385] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.977672 29750 raft_consensus.cc:740] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.978600 29750 consensus_queue.cc:260] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.981629 29750 ts_tablet_manager.cc:1434] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:44.961231 29456 raft_consensus.cc:2468] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:44.984054 29352 catalog_manager.cc:5697] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:44.982898 29749 raft_consensus.cc:385] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.986421 29749 raft_consensus.cc:740] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.987242 29749 consensus_queue.cc:260] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.988643 29748 tablet_bootstrap.cc:492] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:44.989496 29748 ts_tablet_manager.cc:1403] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.088s	user 0.041s	sys 0.040s
I20260709 12:29:44.990010 29749 ts_tablet_manager.cc:1434] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 12:29:44.991508 29749 tablet_bootstrap.cc:492] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:44.992844 29748 raft_consensus.cc:359] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.993619 29748 raft_consensus.cc:385] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.993878 29748 raft_consensus.cc:740] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.994794 29748 consensus_queue.cc:260] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:44.996918 29748 ts_tablet_manager.cc:1434] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:29:44.997989 29748 tablet_bootstrap.cc:492] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:44.999464 29749 tablet_bootstrap.cc:654] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.997673 29353 catalog_manager.cc:5697] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.005925 29748 tablet_bootstrap.cc:654] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.032120 29673 raft_consensus.cc:493] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.032961 29673 raft_consensus.cc:515] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.035255 29673 leader_election.cc:290] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:45.035683 29748 tablet_bootstrap.cc:492] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:45.036161 29749 tablet_bootstrap.cc:492] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:45.036329 29748 ts_tablet_manager.cc:1403] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.020s
I20260709 12:29:45.036751 29749 ts_tablet_manager.cc:1403] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.045s	user 0.031s	sys 0.010s
I20260709 12:29:45.037317 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:45.038357 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
W20260709 12:29:45.039974 29570 leader_election.cc:343] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61694e986200461884bab12f4b16a183 (127.20.98.66:46129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.039947 29748 raft_consensus.cc:359] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.040896 29748 raft_consensus.cc:385] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.040659 29749 raft_consensus.cc:359] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.041292 29748 raft_consensus.cc:740] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.041536 29749 raft_consensus.cc:385] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.041869 29749 raft_consensus.cc:740] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.042187 29748 consensus_queue.cc:260] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.042668 29749 consensus_queue.cc:260] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.043265 29456 raft_consensus.cc:2468] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:45.044751 29748 ts_tablet_manager.cc:1434] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:29:45.045046 29570 leader_election.cc:304] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 61694e986200461884bab12f4b16a183
I20260709 12:29:45.046094 29748 tablet_bootstrap.cc:492] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:45.047217 29673 raft_consensus.cc:2804] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.045318 29749 ts_tablet_manager.cc:1434] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 12:29:45.048828 29749 tablet_bootstrap.cc:492] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:45.055037 29748 tablet_bootstrap.cc:654] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.055635 29749 tablet_bootstrap.cc:654] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.055840 29695 raft_consensus.cc:493] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.056383 29695 raft_consensus.cc:515] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.058611 29695 leader_election.cc:290] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.060199 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:45.060905 29456 raft_consensus.cc:2468] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:45.062162 29496 leader_election.cc:304] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:45.047709 29673 raft_consensus.cc:493] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.063539 29673 raft_consensus.cc:3060] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.064081 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:45.065989 29695 raft_consensus.cc:2804] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.066468 29695 raft_consensus.cc:493] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.066810 29695 raft_consensus.cc:3060] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.073156 29673 raft_consensus.cc:515] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.074604 29605 raft_consensus.cc:2393] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61694e986200461884bab12f4b16a183 in current term 1: Already voted for candidate 8c06bd41a19e46a0825725c322fea562 in this term.
I20260709 12:29:45.079512 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:45.080157 29456 raft_consensus.cc:3060] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.085587 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:45.080026 29673 leader_election.cc:290] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:45.088753 29748 tablet_bootstrap.cc:492] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:45.089546 29748 ts_tablet_manager.cc:1403] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.044s	user 0.028s	sys 0.013s
I20260709 12:29:45.090126 29456 raft_consensus.cc:2468] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:45.091044 29695 raft_consensus.cc:515] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.091413 29570 leader_election.cc:304] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:45.092459 29532 raft_consensus.cc:2393] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c06bd41a19e46a0825725c322fea562 in current term 1: Already voted for candidate 61694e986200461884bab12f4b16a183 in this term.
I20260709 12:29:45.092840 29673 raft_consensus.cc:2804] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.093482 29673 raft_consensus.cc:697] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:45.094457 29673 consensus_queue.cc:237] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.093501 29748 raft_consensus.cc:359] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.096262 29748 raft_consensus.cc:385] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.096707 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:45.097088 29748 raft_consensus.cc:740] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.096977 29695 leader_election.cc:290] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.098845 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:45.099345 29456 raft_consensus.cc:2393] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61694e986200461884bab12f4b16a183 in current term 1: Already voted for candidate 8c06bd41a19e46a0825725c322fea562 in this term.
I20260709 12:29:45.099925 29748 consensus_queue.cc:260] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.100941 29496 leader_election.cc:304] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61694e986200461884bab12f4b16a183; no voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:45.102160 29748 ts_tablet_manager.cc:1434] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:29:45.102228 29695 raft_consensus.cc:2749] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.103957 29748 tablet_bootstrap.cc:492] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e: Bootstrap starting.
I20260709 12:29:45.104115 29749 tablet_bootstrap.cc:492] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:45.104611 29749 ts_tablet_manager.cc:1403] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.030s
I20260709 12:29:45.107581 29749 raft_consensus.cc:359] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.108309 29749 raft_consensus.cc:385] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.108620 29749 raft_consensus.cc:740] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.109319 29749 consensus_queue.cc:260] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.111442 29748 tablet_bootstrap.cc:654] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.111517 29749 ts_tablet_manager.cc:1434] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:29:45.112941 29749 tablet_bootstrap.cc:492] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183: Bootstrap starting.
I20260709 12:29:45.116981 29748 tablet_bootstrap.cc:492] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e: No bootstrap required, opened a new log
I20260709 12:29:45.118654 29748 ts_tablet_manager.cc:1403] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:29:45.119694 29749 tablet_bootstrap.cc:654] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.119885 29353 catalog_manager.cc:5697] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.121470 29748 raft_consensus.cc:359] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.122225 29748 raft_consensus.cc:385] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.122489 29748 raft_consensus.cc:740] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.123274 29748 consensus_queue.cc:260] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.125480 29748 ts_tablet_manager.cc:1434] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:45.126382 29749 tablet_bootstrap.cc:492] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183: No bootstrap required, opened a new log
I20260709 12:29:45.126909 29749 ts_tablet_manager.cc:1403] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:29:45.129818 29749 raft_consensus.cc:359] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.130507 29749 raft_consensus.cc:385] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.130797 29749 raft_consensus.cc:740] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.131472 29749 consensus_queue.cc:260] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.133839 29749 ts_tablet_manager.cc:1434] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:29:45.141772 29456 raft_consensus.cc:3060] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.149936 29760 consensus_queue.cc:1048] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.162070 29762 consensus_queue.cc:1048] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.169056 29673 raft_consensus.cc:493] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.170511 29673 raft_consensus.cc:515] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.172816 29673 leader_election.cc:290] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:45.174273 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824fb1fc0f524540b3023f4fe7fef8ef" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:45.175014 29532 raft_consensus.cc:2468] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:45.175343 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824fb1fc0f524540b3023f4fe7fef8ef" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:45.176120 29454 raft_consensus.cc:2468] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:45.176357 29570 leader_election.cc:304] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:45.177665 29673 raft_consensus.cc:2804] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.178134 29673 raft_consensus.cc:493] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.178490 29673 raft_consensus.cc:3060] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.186273 29673 raft_consensus.cc:515] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.188359 29673 leader_election.cc:290] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:45.189227 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824fb1fc0f524540b3023f4fe7fef8ef" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:45.189544 29532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824fb1fc0f524540b3023f4fe7fef8ef" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:45.189944 29454 raft_consensus.cc:3060] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.190095 29532 raft_consensus.cc:3060] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.197948 29454 raft_consensus.cc:2468] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:45.198247 29532 raft_consensus.cc:2468] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:45.199261 29570 leader_election.cc:304] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:45.200102 29673 raft_consensus.cc:2804] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.200604 29673 raft_consensus.cc:697] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:45.201445 29673 consensus_queue.cc:237] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.208734 29353 catalog_manager.cc:5697] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.234710 29766 consensus_queue.cc:1048] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.246770 29768 consensus_queue.cc:1048] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.260418 29768 consensus_queue.cc:1048] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.272428 29767 consensus_queue.cc:1048] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.284061 29673 raft_consensus.cc:493] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.284704 29673 raft_consensus.cc:515] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.286945 29673 leader_election.cc:290] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:45.287626 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:45.287925 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183" is_pre_election: true
I20260709 12:29:45.288416 29454 raft_consensus.cc:2468] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:45.288606 29531 raft_consensus.cc:2468] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 0.
I20260709 12:29:45.289594 29570 leader_election.cc:304] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:45.290365 29673 raft_consensus.cc:2804] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.290721 29673 raft_consensus.cc:493] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.291059 29673 raft_consensus.cc:3060] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.297641 29673 raft_consensus.cc:515] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.299485 29673 leader_election.cc:290] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:45.300191 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:45.300527 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:45.300962 29454 raft_consensus.cc:3060] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.301209 29531 raft_consensus.cc:3060] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.309111 29454 raft_consensus.cc:2468] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:45.309111 29531 raft_consensus.cc:2468] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 1.
I20260709 12:29:45.310591 29570 leader_election.cc:304] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:45.311295 29673 raft_consensus.cc:2804] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.311939 29673 raft_consensus.cc:697] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:45.312825 29673 consensus_queue.cc:237] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.321466 29353 catalog_manager.cc:5697] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 1 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:45.365492 29760 raft_consensus.cc:493] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.366071 29760 raft_consensus.cc:515] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.368297 29760 leader_election.cc:290] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.369367 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e" is_pre_election: true
I20260709 12:29:45.369586 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562" is_pre_election: true
I20260709 12:29:45.370314 29454 raft_consensus.cc:2468] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:45.370404 29604 raft_consensus.cc:2468] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 0.
I20260709 12:29:45.371457 29496 leader_election.cc:304] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:45.372259 29760 raft_consensus.cc:2804] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.372654 29760 raft_consensus.cc:493] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.372910 29760 raft_consensus.cc:3060] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.378557 29760 raft_consensus.cc:515] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.380518 29760 leader_election.cc:290] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.381381 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:45.381785 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:45.382117 29454 raft_consensus.cc:3060] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.382508 29604 raft_consensus.cc:3060] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.387146 29673 consensus_queue.cc:1048] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.389999 29604 raft_consensus.cc:2468] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:45.390003 29454 raft_consensus.cc:2468] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 1.
I20260709 12:29:45.391454 29495 leader_election.cc:304] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:45.392568 29760 raft_consensus.cc:2804] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.393872 29760 raft_consensus.cc:697] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:45.395713 29760 consensus_queue.cc:237] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.405628 29807 consensus_queue.cc:1048] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.408766 29353 catalog_manager.cc:5697] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 1 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.485678 29807 consensus_queue.cc:1048] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.496981 29807 consensus_queue.cc:1048] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:45.540318 29762 consensus_queue.cc:1048] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.551229 29762 consensus_queue.cc:1048] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.643571 29807 consensus_queue.cc:1048] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.655397 29673 consensus_queue.cc:1048] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.689158 29531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9"
dest_uuid: "61694e986200461884bab12f4b16a183"
mode: GRACEFUL
new_leader_uuid: "65c489f88c374b6a851e01d97b006d1e"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:29:45.690062 29531 raft_consensus.cc:606] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Received request to transfer leadership to TS 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:45.696043 29531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5"
dest_uuid: "61694e986200461884bab12f4b16a183"
mode: GRACEFUL
new_leader_uuid: "65c489f88c374b6a851e01d97b006d1e"
 from {username='slave'} at 127.0.0.1:40060
I20260709 12:29:45.696789 29531 raft_consensus.cc:606] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Received request to transfer leadership to TS 65c489f88c374b6a851e01d97b006d1e
I20260709 12:29:45.704802 29604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
mode: GRACEFUL
new_leader_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:51014
I20260709 12:29:45.705349 29604 raft_consensus.cc:606] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Received request to transfer leadership to TS 61694e986200461884bab12f4b16a183
I20260709 12:29:45.713145 29604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
mode: GRACEFUL
new_leader_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:51014
I20260709 12:29:45.713703 29604 raft_consensus.cc:606] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Received request to transfer leadership to TS 61694e986200461884bab12f4b16a183
I20260709 12:29:45.718647 29604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
mode: GRACEFUL
new_leader_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:51014
I20260709 12:29:45.719134 29604 raft_consensus.cc:606] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Received request to transfer leadership to TS 61694e986200461884bab12f4b16a183
I20260709 12:29:45.735469 29673 consensus_queue.cc:1048] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.750126 29673 consensus_queue.cc:1048] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.758188 29762 raft_consensus.cc:993] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: : Instructing follower 65c489f88c374b6a851e01d97b006d1e to start an election
I20260709 12:29:45.758705 29762 raft_consensus.cc:1081] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Signalling peer 65c489f88c374b6a851e01d97b006d1e to start an election
I20260709 12:29:45.763087 29673 raft_consensus.cc:993] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: : Instructing follower 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:45.763626 29673 raft_consensus.cc:1081] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Signalling peer 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:45.765787 29532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00"
dest_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:40050
I20260709 12:29:45.766353 29532 raft_consensus.cc:493] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:45.766760 29532 raft_consensus.cc:3060] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.760648 29456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9"
dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
 from {username='slave'} at 127.0.0.1:51712
I20260709 12:29:45.768249 29456 raft_consensus.cc:493] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:45.768620 29456 raft_consensus.cc:3060] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.772748 29532 raft_consensus.cc:515] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.775076 29456 raft_consensus.cc:515] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.776382 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:45.777051 29454 raft_consensus.cc:3060] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.777092 29456 leader_election.cc:290] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 2 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.778617 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:45.779129 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5eea53c781c47c6bc9b73bb9e36bff9" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:45.779284 29531 raft_consensus.cc:3055] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:45.779701 29531 raft_consensus.cc:740] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:45.779738 29604 raft_consensus.cc:3060] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.780608 29531 consensus_queue.cc:260] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.784590 29531 raft_consensus.cc:3060] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.786224 29454 raft_consensus.cc:2468] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:45.787575 29496 leader_election.cc:304] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:45.788350 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c539ae1dc9c24e1fb7cf2a658e73dd00" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:45.788637 29760 raft_consensus.cc:2804] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.788432 29604 raft_consensus.cc:2468] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 2.
I20260709 12:29:45.789041 29605 raft_consensus.cc:3055] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:45.789476 29605 raft_consensus.cc:740] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:45.789281 29760 raft_consensus.cc:697] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:45.790087 29532 leader_election.cc:290] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.790310 29605 consensus_queue.cc:260] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.791045 29760 consensus_queue.cc:237] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.791496 29605 raft_consensus.cc:3060] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.792321 29531 raft_consensus.cc:2468] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 2.
I20260709 12:29:45.793967 29420 leader_election.cc:304] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:45.795243 29767 raft_consensus.cc:2804] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.795751 29767 raft_consensus.cc:697] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:45.796562 29767 consensus_queue.cc:237] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.801122 29605 raft_consensus.cc:2468] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:45.803208 29352 catalog_manager.cc:5697] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 1 to 2, leader changed from 8c06bd41a19e46a0825725c322fea562 (127.20.98.67) to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.806317 29353 catalog_manager.cc:5697] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 1 to 2, leader changed from 61694e986200461884bab12f4b16a183 (127.20.98.66) to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.807245 29813 consensus_queue.cc:1048] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:45.816083 29760 raft_consensus.cc:993] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: : Instructing follower 65c489f88c374b6a851e01d97b006d1e to start an election
I20260709 12:29:45.816712 29695 raft_consensus.cc:1081] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Signalling peer 65c489f88c374b6a851e01d97b006d1e to start an election
I20260709 12:29:45.818403 29456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5"
dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
 from {username='slave'} at 127.0.0.1:51712
I20260709 12:29:45.819711 29456 raft_consensus.cc:493] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:45.820099 29456 raft_consensus.cc:3060] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.823237 29760 consensus_queue.cc:1048] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:45.827394 29456 raft_consensus.cc:515] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.837893 29456 leader_election.cc:290] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 2 election: Requested vote from peers 61694e986200461884bab12f4b16a183 (127.20.98.66:46129), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.838155 29531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:45.838472 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ba9c8447a5c486495d4685938e0b1e5" candidate_uuid: "65c489f88c374b6a851e01d97b006d1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:45.838891 29531 raft_consensus.cc:3055] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:45.839073 29604 raft_consensus.cc:3060] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.839288 29531 raft_consensus.cc:740] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:45.840179 29531 consensus_queue.cc:260] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.841495 29531 raft_consensus.cc:3060] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.846963 29604 raft_consensus.cc:2468] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 2.
I20260709 12:29:45.848263 29419 leader_election.cc:304] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c489f88c374b6a851e01d97b006d1e, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:45.848444 29531 raft_consensus.cc:2468] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c489f88c374b6a851e01d97b006d1e in term 2.
I20260709 12:29:45.848976 29767 raft_consensus.cc:2804] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.849480 29767 raft_consensus.cc:697] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Becoming Leader. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:45.850214 29767 consensus_queue.cc:237] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.856604 29354 catalog_manager.cc:5697] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e reported cstate change: term changed from 1 to 2, leader changed from 61694e986200461884bab12f4b16a183 (127.20.98.66) to 65c489f88c374b6a851e01d97b006d1e (127.20.98.65). New cstate: current_term: 2 leader_uuid: "65c489f88c374b6a851e01d97b006d1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.931818 29673 raft_consensus.cc:993] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: : Instructing follower 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:45.932355 29783 raft_consensus.cc:1081] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Signalling peer 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:45.933853 29531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede"
dest_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:40050
I20260709 12:29:45.934336 29531 raft_consensus.cc:493] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:45.934612 29531 raft_consensus.cc:3060] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.939527 29531 raft_consensus.cc:515] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.940889 29531 leader_election.cc:290] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:45.941838 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:45.942003 29604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c8e5a94fb8e452b97889920197bfede" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:45.942389 29456 raft_consensus.cc:3060] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.942620 29604 raft_consensus.cc:3055] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:45.942984 29604 raft_consensus.cc:740] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:45.943696 29604 consensus_queue.cc:260] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.944665 29604 raft_consensus.cc:3060] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:45.949187 29456 raft_consensus.cc:2468] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:45.950528 29496 leader_election.cc:304] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:45.951028 29604 raft_consensus.cc:2468] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:45.951354 29760 raft_consensus.cc:2804] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:45.951980 29760 raft_consensus.cc:697] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:45.952780 29760 consensus_queue.cc:237] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:45.959717 29354 catalog_manager.cc:5697] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 1 to 2, leader changed from 8c06bd41a19e46a0825725c322fea562 (127.20.98.67) to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:46.118259 29673 raft_consensus.cc:993] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: : Instructing follower 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:46.118827 29783 raft_consensus.cc:1081] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Signalling peer 61694e986200461884bab12f4b16a183 to start an election
I20260709 12:29:46.120395 29531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b"
dest_uuid: "61694e986200461884bab12f4b16a183"
 from {username='slave'} at 127.0.0.1:40050
I20260709 12:29:46.120870 29531 raft_consensus.cc:493] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:46.121230 29531 raft_consensus.cc:3060] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:46.128556 29531 raft_consensus.cc:515] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:46.130846 29531 leader_election.cc:290] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 8c06bd41a19e46a0825725c322fea562 (127.20.98.67:46057)
I20260709 12:29:46.131516 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:46.132020 29605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97c5e38c2fa4990ab955ca37622201b" candidate_uuid: "61694e986200461884bab12f4b16a183" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c06bd41a19e46a0825725c322fea562"
I20260709 12:29:46.132241 29454 raft_consensus.cc:3060] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:46.132627 29605 raft_consensus.cc:3055] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:46.133544 29605 raft_consensus.cc:740] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:46.134368 29605 consensus_queue.cc:260] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:46.135577 29605 raft_consensus.cc:3060] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:46.139891 29454 raft_consensus.cc:2468] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:46.141150 29496 leader_election.cc:304] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 65c489f88c374b6a851e01d97b006d1e; no voters: 
I20260709 12:29:46.141933 29760 raft_consensus.cc:2804] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:46.142431 29760 raft_consensus.cc:697] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Leader. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:46.142640 29605 raft_consensus.cc:2468] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61694e986200461884bab12f4b16a183 in term 2.
I20260709 12:29:46.143329 29760 consensus_queue.cc:237] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:46.150045 29354 catalog_manager.cc:5697] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 reported cstate change: term changed from 1 to 2, leader changed from 8c06bd41a19e46a0825725c322fea562 (127.20.98.67) to 61694e986200461884bab12f4b16a183 (127.20.98.66). New cstate: current_term: 2 leader_uuid: "61694e986200461884bab12f4b16a183" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:46.220253 29605 raft_consensus.cc:1275] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 65c489f88c374b6a851e01d97b006d1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.221444 29767 consensus_queue.cc:1048] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.223469 29454 raft_consensus.cc:1275] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.224876 29760 consensus_queue.cc:1048] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.230320 29531 raft_consensus.cc:1275] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Refusing update from remote peer 65c489f88c374b6a851e01d97b006d1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.231786 29766 consensus_queue.cc:1048] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.240295 29604 raft_consensus.cc:1275] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 65c489f88c374b6a851e01d97b006d1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.241997 29764 consensus_queue.cc:1048] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.243687 29604 raft_consensus.cc:1275] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.245240 29762 consensus_queue.cc:1048] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.257810 29531 raft_consensus.cc:1275] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Refusing update from remote peer 65c489f88c374b6a851e01d97b006d1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.260269 29764 consensus_queue.cc:1048] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:46.349067 29454 raft_consensus.cc:1275] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.350461 29762 consensus_queue.cc:1048] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:46.358373 29604 raft_consensus.cc:1275] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.360436 29813 consensus_queue.cc:1048] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.554715 29604 raft_consensus.cc:1275] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.556143 29813 consensus_queue.cc:1048] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.566114 29454 raft_consensus.cc:1275] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Refusing update from remote peer 61694e986200461884bab12f4b16a183: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:46.569140 29695 consensus_queue.cc:1048] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:48.724419 29353 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34338:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:29:48.743741 29353 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34338:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:29:48.781322 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:29:48.804324 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:46057, user_credentials={real_user=slave}} blocked reactor thread for 44768.4us
W20260709 12:29:48.906351 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.98.67:46057, user_credentials={real_user=slave}} blocked reactor thread for 88741us
W20260709 12:29:49.025856 29874 log.cc:927] Time spent T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:29:49.055675 29878 tablet.cc:1724] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.060082 29883 tablet.cc:1724] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.074355 29884 tablet.cc:1724] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.096853 29880 tablet.cc:1724] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.056994 29879 tablet.cc:1724] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.116357 29873 tablet.cc:1724] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.121699 29882 tablet.cc:1724] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.092949 29868 tablet.cc:1724] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.174943 29885 tablet.cc:1724] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.198724 29888 tablet.cc:1724] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.202921 29883 tablet.cc:1724] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.206916 29884 tablet.cc:1724] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.214243 29897 tablet.cc:1724] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.221845 29530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "086aa64888bc4f05b353712f483dee45"
dest_uuid: "61694e986200461884bab12f4b16a183"
mode: GRACEFUL
new_leader_uuid: "8c06bd41a19e46a0825725c322fea562"
 from {username='slave'} at 127.0.0.1:60606
I20260709 12:29:49.222864 29530 raft_consensus.cc:606] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Received request to transfer leadership to TS 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:49.240267 29879 tablet.cc:1724] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.199625 29878 tablet.cc:1724] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.253059 29868 tablet.cc:1724] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.278939 29880 tablet.cc:1724] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.264185 29873 tablet.cc:1724] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.295658 29882 tablet.cc:1724] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.242049 29898 tablet.cc:1724] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.276885 29878 tablet.cc:1724] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.322539 29885 tablet.cc:1724] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.323472 29879 tablet.cc:1724] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.331243 29883 tablet.cc:1724] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.340884 29851 raft_consensus.cc:993] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183: : Instructing follower 8c06bd41a19e46a0825725c322fea562 to start an election
I20260709 12:29:49.341629 29851 raft_consensus.cc:1081] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Signalling peer 8c06bd41a19e46a0825725c322fea562 to start an election
I20260709 12:29:49.343612 29601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "086aa64888bc4f05b353712f483dee45"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
 from {username='slave'} at 127.0.0.1:50996
I20260709 12:29:49.344832 29601 raft_consensus.cc:493] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:49.344709 29868 tablet.cc:1724] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.345721 29601 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:49.373351 29454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe"
dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
mode: GRACEFUL
new_leader_uuid: "8c06bd41a19e46a0825725c322fea562"
 from {username='slave'} at 127.0.0.1:43906
I20260709 12:29:49.374082 29454 raft_consensus.cc:606] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Received request to transfer leadership to TS 8c06bd41a19e46a0825725c322fea562
I20260709 12:29:49.375797 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:49.376272 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:49.381531 29897 tablet.cc:1724] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.383553 29601 raft_consensus.cc:515] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:49.386068 29601 leader_election.cc:290] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 3 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:49.387734 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:49.387615 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086aa64888bc4f05b353712f483dee45" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:49.388438 29454 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:49.388513 29530 raft_consensus.cc:3055] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:49.388990 29530 raft_consensus.cc:740] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61694e986200461884bab12f4b16a183, State: Running, Role: LEADER
I20260709 12:29:49.389914 29530 consensus_queue.cc:260] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:49.393364 29530 raft_consensus.cc:3060] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:49.398644 29898 tablet.cc:1724] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:49.416159 29530 raft_consensus.cc:2468] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 3.
I20260709 12:29:49.417587 29570 leader_election.cc:304] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:49.418684 29807 raft_consensus.cc:2804] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:49.419211 29807 raft_consensus.cc:697] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 3 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:49.416980 29454 raft_consensus.cc:2468] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 3.
I20260709 12:29:49.420111 29807 consensus_queue.cc:237] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:49.430718 29353 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757: soft_deleted_table [id=a4f27d97817d4c3a967adda9fad92922] alter complete (version 1)
I20260709 12:29:49.446048 29354 catalog_manager.cc:5697] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 2 to 3, leader changed from 61694e986200461884bab12f4b16a183 (127.20.98.66) to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:49.671023 29891 raft_consensus.cc:993] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e: : Instructing follower 8c06bd41a19e46a0825725c322fea562 to start an election
I20260709 12:29:49.671710 29827 raft_consensus.cc:1081] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Signalling peer 8c06bd41a19e46a0825725c322fea562 to start an election
I20260709 12:29:49.673288 29601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe"
dest_uuid: "8c06bd41a19e46a0825725c322fea562"
 from {username='slave'} at 127.0.0.1:51012
I20260709 12:29:49.673805 29601 raft_consensus.cc:493] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:49.674127 29601 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:49.681421 29601 raft_consensus.cc:515] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:49.683573 29601 leader_election.cc:290] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 3 election: Requested vote from peers 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645), 61694e986200461884bab12f4b16a183 (127.20.98.66:46129)
I20260709 12:29:49.684749 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65c489f88c374b6a851e01d97b006d1e"
I20260709 12:29:49.685149 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ec4305852d4153af8bcf8bbe1e5fbe" candidate_uuid: "8c06bd41a19e46a0825725c322fea562" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61694e986200461884bab12f4b16a183"
I20260709 12:29:49.685480 29454 raft_consensus.cc:3055] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:49.685861 29530 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:49.685875 29454 raft_consensus.cc:740] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65c489f88c374b6a851e01d97b006d1e, State: Running, Role: LEADER
I20260709 12:29:49.686748 29454 consensus_queue.cc:260] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:49.687795 29454 raft_consensus.cc:3060] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:49.691885 29530 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 3.
I20260709 12:29:49.692875 29454 raft_consensus.cc:2468] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c06bd41a19e46a0825725c322fea562 in term 3.
I20260709 12:29:49.693341 29570 leader_election.cc:304] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61694e986200461884bab12f4b16a183, 8c06bd41a19e46a0825725c322fea562; no voters: 
I20260709 12:29:49.694252 29807 raft_consensus.cc:2804] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:49.694664 29807 raft_consensus.cc:697] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 3 LEADER]: Becoming Leader. State: Replica: 8c06bd41a19e46a0825725c322fea562, State: Running, Role: LEADER
I20260709 12:29:49.695469 29807 consensus_queue.cc:237] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } }
I20260709 12:29:49.704540 29354 catalog_manager.cc:5697] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 reported cstate change: term changed from 2 to 3, leader changed from 65c489f88c374b6a851e01d97b006d1e (127.20.98.65) to 8c06bd41a19e46a0825725c322fea562 (127.20.98.67). New cstate: current_term: 3 leader_uuid: "8c06bd41a19e46a0825725c322fea562" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c06bd41a19e46a0825725c322fea562" member_type: VOTER last_known_addr { host: "127.20.98.67" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:49.924377 29454 raft_consensus.cc:1275] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Refusing update from remote peer 8c06bd41a19e46a0825725c322fea562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:49.925794 29807 consensus_queue.cc:1048] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:49.936030 29530 raft_consensus.cc:1275] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Refusing update from remote peer 8c06bd41a19e46a0825725c322fea562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:49.937808 29861 consensus_queue.cc:1048] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:50.116150 29454 raft_consensus.cc:1275] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Refusing update from remote peer 8c06bd41a19e46a0825725c322fea562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:50.117695 29807 consensus_queue.cc:1048] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c489f88c374b6a851e01d97b006d1e" member_type: VOTER last_known_addr { host: "127.20.98.65" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:50.131202 29530 raft_consensus.cc:1275] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Refusing update from remote peer 8c06bd41a19e46a0825725c322fea562: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:50.133595 29909 consensus_queue.cc:1048] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61694e986200461884bab12f4b16a183" member_type: VOTER last_known_addr { host: "127.20.98.66" port: 46129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:50.377282 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:50.383198 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:50.383646 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:51.384507 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:51.389628 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:51.390008 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:52.390970 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:52.396184 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:52.396696 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:53.397931 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:53.404037 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:53.404523 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:54.405828 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:54.413765 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:54.414259 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:55.415535 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:55.422024 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:55.422459 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:56.423672 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:56.429991 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:56.430444 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:57.431439 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:57.436625 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:57.437143 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:58.438205 20873 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:58.444871 20873 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:58.445394 20873 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:59.509920 20873 tablet_server.cc:179] TabletServer@127.20.98.65:0 shutting down...
W20260709 12:29:59.520753 29496 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 12:29:59.526216 29496 consensus_peers.cc:597] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:59.555733 29496 consensus_peers.cc:597] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:59.562888 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:59.563845 20873 tablet_replica.cc:333] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.564920 20873 raft_consensus.cc:2243] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.565881 20873 raft_consensus.cc:2272] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.568807 20873 tablet_replica.cc:333] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.569600 20873 raft_consensus.cc:2243] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.570250 20873 raft_consensus.cc:2272] T 824fb1fc0f524540b3023f4fe7fef8ef P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.572724 20873 tablet_replica.cc:333] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.573482 20873 raft_consensus.cc:2243] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.574466 20873 raft_consensus.cc:2272] T 6ba9c8447a5c486495d4685938e0b1e5 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.577013 20873 tablet_replica.cc:333] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.577667 20873 raft_consensus.cc:2243] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.578640 20873 raft_consensus.cc:2272] T c5eea53c781c47c6bc9b73bb9e36bff9 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.582294 20873 tablet_replica.cc:333] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.583030 20873 raft_consensus.cc:2243] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.583606 20873 raft_consensus.cc:2272] T e73431653a274b19bda89efe245b1400 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.586123 20873 tablet_replica.cc:333] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.586771 20873 raft_consensus.cc:2243] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.587831 20873 raft_consensus.cc:2272] T 39503e9f22fc459f8d7d322bb8b425c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.590544 20873 tablet_replica.cc:333] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.591228 20873 raft_consensus.cc:2243] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.591912 20873 raft_consensus.cc:2272] T 4c8e5a94fb8e452b97889920197bfede P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.595016 20873 tablet_replica.cc:333] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.595781 20873 raft_consensus.cc:2243] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.597136 20873 raft_consensus.cc:2272] T ab0fc6e7cc0a492c82f5a51e97370f19 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.600497 20873 tablet_replica.cc:333] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.601244 20873 raft_consensus.cc:2243] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.601837 20873 raft_consensus.cc:2272] T e97c5e38c2fa4990ab955ca37622201b P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.605103 20873 tablet_replica.cc:333] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.606057 20873 raft_consensus.cc:2243] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.606846 20873 raft_consensus.cc:2272] T 99dc477137b94a329c8a38c514a793b0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:59.608383 29496 consensus_peers.cc:597] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:59.610075 29496 consensus_peers.cc:597] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:59.610850 20873 tablet_replica.cc:333] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.611665 20873 raft_consensus.cc:2243] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.612990 20873 raft_consensus.cc:2272] T 60d47efb8f2e47e1ade6aafd433753bb P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:59.616083 29496 consensus_peers.cc:597] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:59.616613 20873 tablet_replica.cc:333] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.617559 20873 raft_consensus.cc:2243] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.618407 20873 raft_consensus.cc:2272] T 086aa64888bc4f05b353712f483dee45 P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.620838 20873 tablet_replica.cc:333] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.621448 20873 raft_consensus.cc:2243] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.621963 20873 raft_consensus.cc:2272] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.624477 20873 tablet_replica.cc:333] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.625082 20873 raft_consensus.cc:2243] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.625669 20873 raft_consensus.cc:2272] T 92d0982e7ba24a49b9ed68109b4472f8 P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.628151 20873 tablet_replica.cc:333] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.628744 20873 raft_consensus.cc:2243] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.629434 20873 raft_consensus.cc:2272] T 35ec4305852d4153af8bcf8bbe1e5fbe P 65c489f88c374b6a851e01d97b006d1e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.633014 20873 tablet_replica.cc:333] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.633605 20873 raft_consensus.cc:2243] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.634404 20873 raft_consensus.cc:2272] T 3c3a77d92f74401081ea7c544e0e43c8 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.636585 20873 tablet_replica.cc:333] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.637082 20873 raft_consensus.cc:2243] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.637985 20873 raft_consensus.cc:2272] T e4b45c92c0394f65b0d53dc52ce677a2 P 65c489f88c374b6a851e01d97b006d1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.640184 20873 tablet_replica.cc:333] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e: stopping tablet replica
I20260709 12:29:59.640748 20873 raft_consensus.cc:2243] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.641294 20873 raft_consensus.cc:2272] T 8b91b8958ba947639f85be23ced183af P 65c489f88c374b6a851e01d97b006d1e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:59.655133 29570 consensus_peers.cc:597] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:59.672632 29570 consensus_peers.cc:597] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:59.689432 20873 tablet_server.cc:196] TabletServer@127.20.98.65:0 shutdown complete.
W20260709 12:29:59.711263 29496 consensus_peers.cc:597] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:59.712764 29570 consensus_peers.cc:597] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:59.747155 20873 tablet_server.cc:179] TabletServer@127.20.98.66:0 shutting down...
I20260709 12:29:59.785068 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:59.786309 20873 tablet_replica.cc:333] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.787528 20873 raft_consensus.cc:2243] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.788503 20873 raft_consensus.cc:2272] T 824fb1fc0f524540b3023f4fe7fef8ef P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.792062 20873 tablet_replica.cc:333] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.792768 20873 raft_consensus.cc:2243] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.793774 20873 raft_consensus.cc:2272] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.796218 20873 tablet_replica.cc:333] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.796907 20873 raft_consensus.cc:2243] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.797540 20873 raft_consensus.cc:2272] T 6ba9c8447a5c486495d4685938e0b1e5 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.800257 20873 tablet_replica.cc:333] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.800911 20873 raft_consensus.cc:2243] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.802090 20873 raft_consensus.cc:2272] T e73431653a274b19bda89efe245b1400 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.805239 20873 tablet_replica.cc:333] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.805866 20873 raft_consensus.cc:2243] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.806407 20873 raft_consensus.cc:2272] T 39503e9f22fc459f8d7d322bb8b425c8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.808818 20873 tablet_replica.cc:333] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.809490 20873 raft_consensus.cc:2243] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.809989 20873 raft_consensus.cc:2272] T c5eea53c781c47c6bc9b73bb9e36bff9 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.812203 20873 tablet_replica.cc:333] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.812764 20873 raft_consensus.cc:2243] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.813709 20873 raft_consensus.cc:2272] T e97c5e38c2fa4990ab955ca37622201b P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.816118 20873 tablet_replica.cc:333] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.816740 20873 raft_consensus.cc:2243] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.817230 20873 raft_consensus.cc:2272] T 60d47efb8f2e47e1ade6aafd433753bb P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.819499 20873 tablet_replica.cc:333] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.820101 20873 raft_consensus.cc:2243] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.820603 20873 raft_consensus.cc:2272] T 086aa64888bc4f05b353712f483dee45 P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.823141 20873 tablet_replica.cc:333] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.823756 20873 raft_consensus.cc:2243] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.824240 20873 raft_consensus.cc:2272] T 99dc477137b94a329c8a38c514a793b0 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.826627 20873 tablet_replica.cc:333] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.827217 20873 raft_consensus.cc:2243] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.827697 20873 raft_consensus.cc:2272] T 3c3a77d92f74401081ea7c544e0e43c8 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.829877 20873 tablet_replica.cc:333] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.830446 20873 raft_consensus.cc:2243] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.831056 20873 raft_consensus.cc:2272] T 35ec4305852d4153af8bcf8bbe1e5fbe P 61694e986200461884bab12f4b16a183 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.833352 20873 tablet_replica.cc:333] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.833892 20873 raft_consensus.cc:2243] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.834290 20873 raft_consensus.cc:2272] T e4b45c92c0394f65b0d53dc52ce677a2 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.836457 20873 tablet_replica.cc:333] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.836967 20873 raft_consensus.cc:2243] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.837881 20873 raft_consensus.cc:2272] T 8b91b8958ba947639f85be23ced183af P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.840283 20873 tablet_replica.cc:333] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.840793 20873 raft_consensus.cc:2243] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.841679 20873 raft_consensus.cc:2272] T 4c8e5a94fb8e452b97889920197bfede P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.843905 20873 tablet_replica.cc:333] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.844400 20873 raft_consensus.cc:2243] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.844830 20873 raft_consensus.cc:2272] T ab0fc6e7cc0a492c82f5a51e97370f19 P 61694e986200461884bab12f4b16a183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.847018 20873 tablet_replica.cc:333] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.847486 20873 raft_consensus.cc:2243] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.848322 20873 raft_consensus.cc:2272] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.850485 20873 tablet_replica.cc:333] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183: stopping tablet replica
I20260709 12:29:59.850936 20873 raft_consensus.cc:2243] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.851794 20873 raft_consensus.cc:2272] T 92d0982e7ba24a49b9ed68109b4472f8 P 61694e986200461884bab12f4b16a183 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.896194 20873 tablet_server.cc:196] TabletServer@127.20.98.66:0 shutdown complete.
W20260709 12:29:59.913208 29570 consensus_peers.cc:597] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 -> Peer 61694e986200461884bab12f4b16a183 (127.20.98.66:46129): Couldn't send request to peer 61694e986200461884bab12f4b16a183. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.66:46129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:59.940281 20873 tablet_server.cc:179] TabletServer@127.20.98.67:0 shutting down...
W20260709 12:29:59.963575 29570 consensus_peers.cc:597] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 -> Peer 65c489f88c374b6a851e01d97b006d1e (127.20.98.65:38645): Couldn't send request to peer 65c489f88c374b6a851e01d97b006d1e. Status: Network error: Client connection negotiation failed: client connection to 127.20.98.65:38645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:59.974507 20873 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:59.975466 20873 tablet_replica.cc:333] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:29:59.976573 20873 raft_consensus.cc:2243] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:59.977795 20873 raft_consensus.cc:2272] T 824fb1fc0f524540b3023f4fe7fef8ef P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.980247 20873 tablet_replica.cc:333] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:29:59.980850 20873 raft_consensus.cc:2243] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.981459 20873 raft_consensus.cc:2272] T c539ae1dc9c24e1fb7cf2a658e73dd00 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.983777 20873 tablet_replica.cc:333] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:29:59.984426 20873 raft_consensus.cc:2243] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.984992 20873 raft_consensus.cc:2272] T e73431653a274b19bda89efe245b1400 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.987418 20873 tablet_replica.cc:333] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:29:59.987998 20873 raft_consensus.cc:2243] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.988521 20873 raft_consensus.cc:2272] T 6ba9c8447a5c486495d4685938e0b1e5 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.990880 20873 tablet_replica.cc:333] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:29:59.991570 20873 raft_consensus.cc:2243] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.992111 20873 raft_consensus.cc:2272] T 39503e9f22fc459f8d7d322bb8b425c8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.994356 20873 tablet_replica.cc:333] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:29:59.994968 20873 raft_consensus.cc:2243] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.995477 20873 raft_consensus.cc:2272] T ab0fc6e7cc0a492c82f5a51e97370f19 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:59.997747 20873 tablet_replica.cc:333] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:29:59.998301 20873 raft_consensus.cc:2243] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:59.998821 20873 raft_consensus.cc:2272] T 4c8e5a94fb8e452b97889920197bfede P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.001235 20873 tablet_replica.cc:333] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.001914 20873 raft_consensus.cc:2243] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.002489 20873 raft_consensus.cc:2272] T c5eea53c781c47c6bc9b73bb9e36bff9 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.004817 20873 tablet_replica.cc:333] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.005515 20873 raft_consensus.cc:2243] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.006108 20873 raft_consensus.cc:2272] T e97c5e38c2fa4990ab955ca37622201b P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.008471 20873 tablet_replica.cc:333] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.009138 20873 raft_consensus.cc:2243] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.009740 20873 raft_consensus.cc:2272] T 60d47efb8f2e47e1ade6aafd433753bb P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.011987 20873 tablet_replica.cc:333] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.012626 20873 raft_consensus.cc:2243] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:00.013582 20873 raft_consensus.cc:2272] T 99dc477137b94a329c8a38c514a793b0 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.015920 20873 tablet_replica.cc:333] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.016541 20873 raft_consensus.cc:2243] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:00.017582 20873 raft_consensus.cc:2272] T 086aa64888bc4f05b353712f483dee45 P 8c06bd41a19e46a0825725c322fea562 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.020038 20873 tablet_replica.cc:333] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.020952 20873 raft_consensus.cc:2243] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.021598 20873 raft_consensus.cc:2272] T 92d0982e7ba24a49b9ed68109b4472f8 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.023947 20873 tablet_replica.cc:333] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.024554 20873 raft_consensus.cc:2243] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.025108 20873 raft_consensus.cc:2272] T 752a1f2d9f604ee5b944fe7fb1914ec0 P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.027424 20873 tablet_replica.cc:333] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.028036 20873 raft_consensus.cc:2243] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:00.028980 20873 raft_consensus.cc:2272] T 35ec4305852d4153af8bcf8bbe1e5fbe P 8c06bd41a19e46a0825725c322fea562 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.031316 20873 tablet_replica.cc:333] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.031903 20873 raft_consensus.cc:2243] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.032397 20873 raft_consensus.cc:2272] T 3c3a77d92f74401081ea7c544e0e43c8 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.034804 20873 tablet_replica.cc:333] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.035365 20873 raft_consensus.cc:2243] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.035843 20873 raft_consensus.cc:2272] T e4b45c92c0394f65b0d53dc52ce677a2 P 8c06bd41a19e46a0825725c322fea562 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.038131 20873 tablet_replica.cc:333] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562: stopping tablet replica
I20260709 12:30:00.038686 20873 raft_consensus.cc:2243] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:00.039178 20873 raft_consensus.cc:2272] T 8b91b8958ba947639f85be23ced183af P 8c06bd41a19e46a0825725c322fea562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.082366 20873 tablet_server.cc:196] TabletServer@127.20.98.67:0 shutdown complete.
I20260709 12:30:00.121809 20873 master.cc:562] Master@127.20.98.126:37945 shutting down...
I20260709 12:30:00.146446 20873 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:00.147074 20873 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:00.147425 20873 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0240079184f1420da604c1fce0f3c757: stopping tablet replica
I20260709 12:30:00.169641 20873 master.cc:584] Master@127.20.98.126:37945 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20975 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41419 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (311643 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:30:00.231518 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2213 messages since previous log ~31 seconds ago
I20260709 12:30:00.231859 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2213 messages since previous log ~31 seconds ago
I20260709 12:30:00.232036 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2213 messages since previous log ~31 seconds ago
I20260709 12:30:00.232299 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:30:00.232517 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:30:00.232704 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~126 seconds ago
I20260709 12:30:00.233026 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:30:00.233598 20873 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
